2020-01-26T15:04:29.032 INFO:root:teuthology version: 1.0.0-7063d1e 2020-01-26T15:04:29.032 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.7sIAa9.tmp -- --verbose --lock --description upgrade:cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}} --name sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317 2020-01-26T15:04:29.095 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-26T15:04:29.176 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317 branch: wip-sage2-testing-2020-01-24-1408 description: upgrade:cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}} email: null first_in_suite: false job_id: '4709317' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/mimic latest ' name: sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi nuke-on-error: false openstack: - volumes: count: 4 size: 10 overrides: admin_socket: branch: wip-sage2-testing-2020-01-24-1408 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - missing required features max_mds: 2 mon_bind_addrvec: false mon_bind_msgr2: false sha1: 084f0502288c3898c3a27b35934ea510597b049d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 084f0502288c3898c3a27b35934ea510597b049d nuke-on-error: false thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage-testing-2020-01-26-0849 sha1: aa93311c28f80541753eb7d86d811f1316c8e0c7 owner: scheduled_sage@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 sha1: 084f0502288c3898c3a27b35934ea510597b049d suite: upgrade:cephfs suite_branch: wip-sage-testing-2020-01-26-0849 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci suite_sha1: aa93311c28f80541753eb7d86d811f1316c8e0c7 tasks: - install: branch: mimic exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm extra_packages: - librados2 - print: '**** done installing mimic' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-whitelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon mon_bind_addrvec: false mon_bind_msgr2: false - exec: osd.0: - ceph osd set-require-min-compat-client mimic - print: '**** done ceph' - ceph-fuse: null - print: '**** done mimic client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: null mon.b: null - print: '**** done install.upgrade both hosts' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - exec: mon.a: - ceph config set global mon_warn_on_msgr2_not_enabled false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph mon enable-msgr2 - ceph versions - ceph osd dump -f json-pretty - ceph config rm global mon_warn_on_msgr2_not_enabled - ceph osd require-osd-release octopus - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs set cephfs min_compat_client octopus - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2498 2020-01-26T15:04:29.176 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa; will attempt to use it 2020-01-26T15:04:29.177 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks 2020-01-26T15:04:29.177 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-01-26T15:04:29.178 INFO:teuthology.task.internal:Checking packages... 2020-01-26T15:04:29.179 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash '084f0502288c3898c3a27b35934ea510597b049d' 2020-01-26T15:04:29.179 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-01-26T15:04:29.191 INFO:teuthology.task.internal:no buildpackages task found 2020-01-26T15:04:29.191 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-01-26T15:04:29.208 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-01-26T15:04:29.208 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-26T15:04:29.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:04:39.279 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:04:49.298 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:04:59.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:09.330 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:19.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:29.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:39.402 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:49.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:05:59.439 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:09.460 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:19.484 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:29.503 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:39.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:49.541 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:59.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:07:09.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:07:19.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:07:29.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:07:39.634 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:07:49.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:07:59.670 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:08:09.687 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:08:19.708 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:08:29.726 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:08:39.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:08:49.755 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:08:59.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:09:09.786 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:09:19.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:09:29.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:09:39.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:09:49.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:09:59.867 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:10:09.883 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:10:19.899 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:10:29.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:10:39.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:10:49.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:10:59.962 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:11:09.978 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:11:19.990 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:11:30.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:11:40.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:11:50.044 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:12:00.058 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:12:10.072 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:12:20.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:12:30.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:12:40.117 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:12:50.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:13:00.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:13:10.166 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:13:20.182 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:13:30.198 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:13:40.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:13:50.227 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:14:00.242 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:14:10.262 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:14:20.281 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:14:30.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:14:40.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:14:50.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:15:00.350 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:15:10.368 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:15:20.388 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:15:30.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:15:40.411 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:15:50.426 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:16:00.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:16:10.459 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317', 'machine_type': 'smithi'} 2020-01-26T15:16:10.480 ERROR:teuthology.lock.ops:Insufficient nodes available to lock 3 smithi nodes. 2020-01-26T15:16:10.480 ERROR:teuthology.lock.ops:{"message": "only 2 nodes available"} 2020-01-26T15:16:10.480 INFO:teuthology.task.internal.lock_machines:0 smithi machines locked this try, 0/3 locked so far 2020-01-26T15:16:10.480 INFO:teuthology.task.internal.lock_machines:0 machines locked (0 new); need 3 more 2020-01-26T15:16:10.481 WARNING:teuthology.task.internal.lock_machines:Could not lock enough machines, waiting... 2020-01-26T15:16:20.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:16:30.511 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:16:40.528 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:16:50.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:17:00.560 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:17:10.574 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317', 'machine_type': 'smithi'} 2020-01-26T15:17:10.593 DEBUG:teuthology.lock.ops:locked ubuntu@smithi163.front.sepia.ceph.com, ubuntu@smithi008.front.sepia.ceph.com, ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:17:10.669 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-01-26T15:17:10.852 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 18.04 2020-01-26T15:17:10.857 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of ubuntu 18.04 2020-01-26T15:17:10.870 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of ubuntu 18.04 2020-01-26T15:17:11.144 INFO:teuthology.orchestra.console:Power off smithi163 2020-01-26T15:17:11.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-26T15:17:11.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:11.178 INFO:teuthology.orchestra.console:Power off smithi008 2020-01-26T15:17:11.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-26T15:17:11.192 INFO:teuthology.orchestra.console:Power off smithi170 2020-01-26T15:17:11.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-26T15:17:11.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:11.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:11.299 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2020-01-26T15:17:11.400 INFO:teuthology.orchestra.console:Power on smithi163 2020-01-26T15:17:11.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-26T15:17:11.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:15.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:15.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:15.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:19.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:19.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:19.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:19.560 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2020-01-26T15:17:19.661 INFO:teuthology.orchestra.console:Power on smithi170 2020-01-26T15:17:19.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-26T15:17:19.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:19.874 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2020-01-26T15:17:19.975 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2020-01-26T15:17:23.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:23.663 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2020-01-26T15:17:23.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:23.764 INFO:teuthology.orchestra.console:Power on smithi008 2020-01-26T15:17:23.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-26T15:17:23.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:27.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:27.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:17:28.018 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2020-01-26T15:17:28.083 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2020-01-26T15:17:28.120 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2020-01-26T15:17:28.184 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2020-01-26T15:20:14.251 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:23.320 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:29.332 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:32.375 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:36.209 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:38.395 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:41.432 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:45.271 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:47.447 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:50.487 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:54.329 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:56.504 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:20:59.543 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:03.383 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:05.559 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:12.443 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:14.622 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:21.495 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:23.704 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:30.552 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:39.614 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:48.698 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:21:55.179 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:21:57.753 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:01.182 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:01.192 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:05.548 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:05.656 INFO:teuthology.orchestra.run.smithi008:> hostname 2020-01-26T15:22:06.432 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2020-01-26T15:22:06.433 INFO:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2020-01-26T15:22:06.440 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2020-01-26T15:22:06.441 INFO:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2020-01-26T15:22:06.505 INFO:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2020-01-26T15:22:06.573 INFO:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2020-01-26T15:22:06.629 INFO:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2020-01-26T15:22:06.698 INFO:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2020-01-26T15:22:06.752 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2020-01-26T15:22:06.754 DEBUG:teuthology.parallel:result is None 2020-01-26T15:22:07.194 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:07.205 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:13.206 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:13.217 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:19.218 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:19.231 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:25.234 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:25.404 INFO:teuthology.orchestra.run.smithi170:> hostname 2020-01-26T15:22:26.036 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2020-01-26T15:22:26.037 INFO:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2020-01-26T15:22:26.044 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2020-01-26T15:22:26.044 INFO:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2020-01-26T15:22:26.141 INFO:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2020-01-26T15:22:26.157 INFO:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2020-01-26T15:22:26.217 INFO:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2020-01-26T15:22:26.283 INFO:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2020-01-26T15:22:26.337 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2020-01-26T15:22:26.339 DEBUG:teuthology.parallel:result is None 2020-01-26T15:22:29.428 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:35.429 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:35.441 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:41.446 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:47.458 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:47.473 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:53.474 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:53.484 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:22:59.486 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:22:59.584 INFO:teuthology.orchestra.run.smithi163:> hostname 2020-01-26T15:23:00.323 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2020-01-26T15:23:00.323 INFO:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2020-01-26T15:23:00.330 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2020-01-26T15:23:00.330 INFO:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2020-01-26T15:23:00.388 INFO:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2020-01-26T15:23:00.445 INFO:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2020-01-26T15:23:00.499 INFO:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2020-01-26T15:23:00.564 INFO:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2020-01-26T15:23:00.620 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2020-01-26T15:23:00.621 DEBUG:teuthology.parallel:result is None 2020-01-26T15:23:00.803 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2020-01-26T15:23:00.803 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-26T15:23:00.847 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2020-01-26T15:23:00.848 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-26T15:23:00.863 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2020-01-26T15:23:00.863 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-26T15:23:00.882 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2020-01-26T15:23:00.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:23:00.883 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:23:00.960 INFO:teuthology.orchestra.run.smithi170:> true 2020-01-26T15:23:01.207 INFO:teuthology.orchestra.run.smithi170:> uname -m 2020-01-26T15:23:01.256 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2020-01-26T15:23:01.256 INFO:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2020-01-26T15:23:01.303 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2020-01-26T15:23:01.304 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:23:01.304 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2020-01-26T15:23:01.304 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2020-01-26T15:23:01.304 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:23:01.304 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="18.04" 2020-01-26T15:23:01.304 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:23:01.305 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:23:01.305 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:23:01.305 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:23:01.305 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=bionic 2020-01-26T15:23:01.305 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:23:01.306 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2020-01-26T15:23:01.324 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2020-01-26T15:23:01.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:23:01.325 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:23:01.448 INFO:teuthology.orchestra.run.smithi008:> true 2020-01-26T15:23:01.695 INFO:teuthology.orchestra.run.smithi008:> uname -m 2020-01-26T15:23:01.746 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2020-01-26T15:23:01.746 INFO:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2020-01-26T15:23:01.792 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Ubuntu" 2020-01-26T15:23:01.792 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:23:01.792 INFO:teuthology.orchestra.run.smithi008.stdout:ID=ubuntu 2020-01-26T15:23:01.792 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE=debian 2020-01-26T15:23:01.792 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:23:01.792 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="18.04" 2020-01-26T15:23:01.793 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:23:01.793 INFO:teuthology.orchestra.run.smithi008.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:23:01.793 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:23:01.793 INFO:teuthology.orchestra.run.smithi008.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:23:01.793 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_CODENAME=bionic 2020-01-26T15:23:01.793 INFO:teuthology.orchestra.run.smithi008.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:23:01.794 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2020-01-26T15:23:01.811 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2020-01-26T15:23:01.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:23:01.811 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:23:01.887 INFO:teuthology.orchestra.run.smithi163:> true 2020-01-26T15:23:02.127 INFO:teuthology.orchestra.run.smithi163:> uname -m 2020-01-26T15:23:02.175 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2020-01-26T15:23:02.175 INFO:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2020-01-26T15:23:02.223 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2020-01-26T15:23:02.223 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:23:02.223 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="18.04" 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:23:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:23:02.225 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=bionic 2020-01-26T15:23:02.225 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:23:02.225 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2020-01-26T15:23:02.240 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-01-26T15:23:02.284 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/eVQjVuHp2YS9MLG0ryFZ4HDHMF5Gd+gYPrtUroD7DQruFsnx4Nf17KZLM1Qz7d0isolKpg15+RYCDctcuPx/Sdic4XbzcnsSTrzpIOQclUOpzn0vssBGIuAkpQ7EVw8fmljDP7MjmCld/J3QPjOb8AdYHS4TJ28CSQZznP+rU6vxxbTiCbd+Vw0orm86dqAN60cvu+ywrqW6rdcmWZBfoC38hFmBgozXgzjTAuMjLHDTLvX5aSwQ5qsiMz8fbYOHEnDzx35AvpI+X22it6mqbkjwRCN8/NhHXmev8oO0GYR2D2RnJvkfzIDt4hYl+ngeJ8tNHTEFotMZjNUWRT4v smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5F5RAYnX4LTWpMFIqdtDscqsLO79u1FShDnaXxdrEovnDGA+RJmon9ZSkztI1NpqCfirntsVimNbnZgjTDXsCBB/5vwIvHvVH6Kf1EjwGJdPnpXKj59uPn8bqX9zdeZGRbptX+f0hZFkPFtYmwz9yT+qWVG0B+m2yvQMOHOONYE2VlBNl9eXKcoCPsGJ/mPUUai/1jj60UGvxavQe+d+DiiBdsyPX+pyggfubA0Gi2y0k41osVr7vm5WseC6EGMUzBRetJn68Ldpe6sPt7pp4Y9Y1AXrcrkzXECFVj4UnR1qSz7Ii4/XECgyzpfZBmoveqR/JHD/QLRkIiFzyAJvb smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7nAMPRKTdRqwToa7xphmYqXwjrrUMLuQ8+HPqLKWEUcIkLTyd6hHQljSYytlSIhaHreH+liYtodBaza7SRIbsGG5fjBSIPmIL4riF8V/npeSnEqwIh0AWJNJtZl8hEJTx3EoycCCzssx+GWXpgz17bHeWj9s6EsUzpBnH3IWOFTDekClpELsoxxFHvD9sgO7c1IS0akESN0IKCUox7wRD4wkEx19X4jteRDS1zuLcOk8mS3zr19CvaZmorlONSv9CQa2uwlhRSUMHoY/u65hqhFJpF/FOBlspvrS34D3+jmsCIP/Wm6gl4KG/Kp4qGnumt925uQmeoko5Mq0RIVh/ 2020-01-26T15:23:02.284 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-26T15:23:02.341 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-01-26T15:23:02.351 INFO:teuthology.task.internal:Saving configuration 2020-01-26T15:23:02.378 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-01-26T15:23:02.388 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-01-26T15:23:02.402 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-26 15:17:10.581488', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi170.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKTuL0QQfeKA/JNMjaGKakH48Cf3pxD43JjI4Ag2474d', u'description': u'/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317'} 2020-01-26T15:23:02.418 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-26 15:17:10.581507', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi008.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOFem+WLNHHF39zFHULpvkSpDEJroEIbdIkrPW2z8Ip3', u'description': u'/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317'} 2020-01-26T15:23:02.431 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-26 15:17:10.581523', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi163.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOkg41FcjV8OGXBSM9dgy9Bn/Cns60PMzil2ejx+vIoO', u'description': u'/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317'} 2020-01-26T15:23:02.432 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-01-26T15:23:02.442 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2020-01-26T15:23:02.442 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['client.0'] 2020-01-26T15:23:02.442 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['client.1'] 2020-01-26T15:23:02.442 INFO:teuthology.run_tasks:Running task console_log... 2020-01-26T15:23:02.531 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-01-26T15:23:02.532 INFO:teuthology.run_tasks:Running task internal.connect... 2020-01-26T15:23:02.565 INFO:teuthology.task.internal:Opening connections... 2020-01-26T15:23:02.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2020-01-26T15:23:02.566 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:23:02.659 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:23:02.659 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:23:02.733 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:23:02.734 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:23:02.812 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-01-26T15:23:02.824 INFO:teuthology.orchestra.run.smithi008:> uname -m 2020-01-26T15:23:02.859 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2020-01-26T15:23:02.859 INFO:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2020-01-26T15:23:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Ubuntu" 2020-01-26T15:23:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:23:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:ID=ubuntu 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE=debian 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="18.04" 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:23:02.910 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_CODENAME=bionic 2020-01-26T15:23:02.911 INFO:teuthology.orchestra.run.smithi008.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:23:02.911 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2020-01-26T15:23:02.926 INFO:teuthology.orchestra.run.smithi170:> uname -m 2020-01-26T15:23:02.933 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2020-01-26T15:23:02.933 INFO:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2020-01-26T15:23:02.979 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2020-01-26T15:23:02.979 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:23:02.979 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2020-01-26T15:23:02.980 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2020-01-26T15:23:02.980 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:23:02.980 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="18.04" 2020-01-26T15:23:02.981 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:23:02.981 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:23:02.981 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:23:02.982 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:23:02.982 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=bionic 2020-01-26T15:23:02.982 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:23:02.983 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2020-01-26T15:23:02.996 INFO:teuthology.orchestra.run.smithi163:> uname -m 2020-01-26T15:23:03.011 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2020-01-26T15:23:03.012 INFO:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="18.04" 2020-01-26T15:23:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:23:03.060 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:23:03.060 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:23:03.060 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:23:03.060 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=bionic 2020-01-26T15:23:03.060 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:23:03.060 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2020-01-26T15:23:03.073 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-01-26T15:23:03.091 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-01-26T15:23:03.111 INFO:teuthology.task.internal:Checking for old test directory... 2020-01-26T15:23:03.111 INFO:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2020-01-26T15:23:03.113 INFO:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2020-01-26T15:23:03.115 INFO:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2020-01-26T15:23:03.121 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-01-26T15:23:03.131 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-01-26T15:23:03.132 INFO:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2020-01-26T15:23:03.160 INFO:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2020-01-26T15:23:03.163 INFO:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2020-01-26T15:23:03.173 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-01-26T15:23:03.232 INFO:teuthology.run_tasks:Running task kernel... 2020-01-26T15:23:03.251 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.c': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-01-26T15:23:03.251 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-01-26T15:23:03.251 INFO:teuthology.orchestra.run.smithi170:> uname -r 2020-01-26T15:23:03.258 INFO:teuthology.orchestra.run.smithi170.stdout:4.15.0-72-generic 2020-01-26T15:23:03.258 INFO:teuthology.task.kernel:Running kernel on smithi170: 4.15.0-72-generic 2020-01-26T15:23:03.259 INFO:teuthology.orchestra.run.smithi170:> sudo apt-get clean 2020-01-26T15:23:03.387 INFO:teuthology.orchestra.run.smithi170:> sudo apt-get update 2020-01-26T15:23:03.647 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:23:03.647 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:23:03.714 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:23:03.993 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:23:04.094 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [611 kB] 2020-01-26T15:23:04.230 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [632 kB] 2020-01-26T15:23:04.437 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [422 kB] 2020-01-26T15:23:04.473 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [199 kB] 2020-01-26T15:23:04.520 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [18.4 kB] 2020-01-26T15:23:04.521 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,408 B] 2020-01-26T15:23:04.521 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [634 kB] 2020-01-26T15:23:04.530 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [833 kB] 2020-01-26T15:23:04.575 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [608 kB] 2020-01-26T15:23:04.620 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-26T15:23:04.620 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [292 kB] 2020-01-26T15:23:04.624 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-26T15:23:04.624 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-26T15:23:04.643 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [27.4 kB] 2020-01-26T15:23:04.646 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,356 B] 2020-01-26T15:23:04.646 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,044 kB] 2020-01-26T15:23:04.708 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,005 kB] 2020-01-26T15:23:04.747 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [322 kB] 2020-01-26T15:23:04.758 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-26T15:23:04.758 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-26T15:23:04.758 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-26T15:23:04.759 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-01-26T15:23:04.781 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,032 B] 2020-01-26T15:23:04.782 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-26T15:23:05.459 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 7,167 kB in 2s (3,838 kB/s) 2020-01-26T15:23:06.788 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:23:06.833 INFO:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:23:06.914 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:23:07.145 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2020-01-26T15:23:07.146 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2020-01-26T15:23:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:23:07.220 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:23:07.220 INFO:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:23:07.297 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:23:07.517 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2020-01-26T15:23:07.517 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2020-01-26T15:23:07.674 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2020-01-26T15:23:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:23:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-26T15:23:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-26T15:23:07.676 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2020-01-26T15:23:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-26T15:23:07.677 INFO:teuthology.orchestra.run.smithi170.stdout:Recommended packages: 2020-01-26T15:23:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: thermald 2020-01-26T15:23:07.709 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2020-01-26T15:23:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:23:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-26T15:23:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-26T15:23:07.711 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages will be upgraded: 2020-01-26T15:23:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-26T15:23:07.894 INFO:teuthology.orchestra.run.smithi170.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:23:07.894 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 65.9 MB of archives. 2020-01-26T15:23:07.894 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-26T15:23:07.894 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-26T15:23:08.896 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-26T15:23:09.090 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-26T15:23:10.013 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-26T15:23:10.013 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-26T15:23:10.014 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-26T15:23:10.315 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-26T15:23:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-26T15:23:10.833 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 65.9 MB in 3s (25.0 MB/s) 2020-01-26T15:23:10.984 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-26T15:23:11.027 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-26T15:23:11.030 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:12.606 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-26T15:23:12.617 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:12.717 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:13.218 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-26T15:23:13.231 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:13.267 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:16.951 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:23:17.078 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:23:17.393 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:23:17.515 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:23:17.843 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-26T15:23:17.858 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-26T15:23:17.910 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:23:22.578 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-26T15:23:22.599 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:22.636 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:25.786 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:23:25.909 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:23:26.229 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:23:26.364 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:26.899 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:27.338 INFO:teuthology.orchestra.run.smithi170.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:23:27.338 INFO:teuthology.orchestra.run.smithi170.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-26T15:23:27.468 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:27.961 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:28.087 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-26T15:23:28.214 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-26T15:23:28.339 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-26T15:23:28.449 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:28.657 INFO:teuthology.orchestra.run.smithi170.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-26T15:23:28.657 INFO:teuthology.orchestra.run.smithi170.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:23:43.531 INFO:teuthology.orchestra.run.smithi170.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-26T15:23:43.532 INFO:teuthology.orchestra.run.smithi170.stdout:Sourcing file `/etc/default/grub' 2020-01-26T15:23:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:Generating grub configuration file ... 2020-01-26T15:23:43.914 INFO:teuthology.orchestra.run.smithi170.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:23:43.953 INFO:teuthology.orchestra.run.smithi170.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:23:44.293 INFO:teuthology.orchestra.run.smithi170.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:23:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:23:45.908 INFO:teuthology.orchestra.run.smithi170.stdout:done 2020-01-26T15:23:46.314 INFO:teuthology.orchestra.run.smithi170:> dpkg -s linux-image-generic 2020-01-26T15:23:46.339 INFO:teuthology.orchestra.run.smithi170.stdout:Package: linux-image-generic 2020-01-26T15:23:46.339 INFO:teuthology.orchestra.run.smithi170.stdout:Status: install ok installed 2020-01-26T15:23:46.339 INFO:teuthology.orchestra.run.smithi170.stdout:Priority: optional 2020-01-26T15:23:46.339 INFO:teuthology.orchestra.run.smithi170.stdout:Section: kernel 2020-01-26T15:23:46.339 INFO:teuthology.orchestra.run.smithi170.stdout:Installed-Size: 15 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: amd64 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Source: linux-meta 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Version: 4.15.0.74.76 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Recommends: thermald 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout:Description: Generic Linux kernel image 2020-01-26T15:23:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:23:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: available. 2020-01-26T15:23:46.341 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-26T15:23:46.341 INFO:teuthology.orchestra.run.smithi008:> uname -r 2020-01-26T15:23:46.350 INFO:teuthology.orchestra.run.smithi008.stdout:4.15.0-72-generic 2020-01-26T15:23:46.350 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.15.0-72-generic 2020-01-26T15:23:46.350 INFO:teuthology.orchestra.run.smithi008:> sudo apt-get clean 2020-01-26T15:23:46.462 INFO:teuthology.orchestra.run.smithi008:> sudo apt-get update 2020-01-26T15:23:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:23:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:23:46.790 INFO:teuthology.orchestra.run.smithi008.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:23:47.070 INFO:teuthology.orchestra.run.smithi008.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:23:47.187 INFO:teuthology.orchestra.run.smithi008.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [611 kB] 2020-01-26T15:23:47.324 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [632 kB] 2020-01-26T15:23:47.532 INFO:teuthology.orchestra.run.smithi008.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [422 kB] 2020-01-26T15:23:47.568 INFO:teuthology.orchestra.run.smithi008.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [199 kB] 2020-01-26T15:23:47.618 INFO:teuthology.orchestra.run.smithi008.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [18.4 kB] 2020-01-26T15:23:47.619 INFO:teuthology.orchestra.run.smithi008.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,408 B] 2020-01-26T15:23:47.619 INFO:teuthology.orchestra.run.smithi008.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [634 kB] 2020-01-26T15:23:47.627 INFO:teuthology.orchestra.run.smithi008.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [833 kB] 2020-01-26T15:23:47.670 INFO:teuthology.orchestra.run.smithi008.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [608 kB] 2020-01-26T15:23:47.707 INFO:teuthology.orchestra.run.smithi008.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-26T15:23:47.718 INFO:teuthology.orchestra.run.smithi008.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-26T15:23:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-26T15:23:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [292 kB] 2020-01-26T15:23:47.742 INFO:teuthology.orchestra.run.smithi008.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [27.4 kB] 2020-01-26T15:23:47.744 INFO:teuthology.orchestra.run.smithi008.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,356 B] 2020-01-26T15:23:47.745 INFO:teuthology.orchestra.run.smithi008.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,044 kB] 2020-01-26T15:23:47.809 INFO:teuthology.orchestra.run.smithi008.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,005 kB] 2020-01-26T15:23:47.849 INFO:teuthology.orchestra.run.smithi008.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [322 kB] 2020-01-26T15:23:47.856 INFO:teuthology.orchestra.run.smithi008.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-26T15:23:47.856 INFO:teuthology.orchestra.run.smithi008.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-26T15:23:47.857 INFO:teuthology.orchestra.run.smithi008.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-26T15:23:47.857 INFO:teuthology.orchestra.run.smithi008.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-01-26T15:23:47.881 INFO:teuthology.orchestra.run.smithi008.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,032 B] 2020-01-26T15:23:47.882 INFO:teuthology.orchestra.run.smithi008.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-26T15:23:48.581 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 7,167 kB in 2s (3,717 kB/s) 2020-01-26T15:23:49.934 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:23:49.981 INFO:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:23:50.063 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:23:50.292 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2020-01-26T15:23:50.293 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2020-01-26T15:23:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:23:50.379 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:23:50.379 INFO:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:23:50.460 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:23:50.694 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2020-01-26T15:23:50.694 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2020-01-26T15:23:50.869 INFO:teuthology.orchestra.run.smithi008.stdout:The following additional packages will be installed: 2020-01-26T15:23:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:23:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-26T15:23:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-26T15:23:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:Suggested packages: 2020-01-26T15:23:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-26T15:23:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:Recommended packages: 2020-01-26T15:23:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: thermald 2020-01-26T15:23:50.904 INFO:teuthology.orchestra.run.smithi008.stdout:The following NEW packages will be installed: 2020-01-26T15:23:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:23:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-26T15:23:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-26T15:23:50.906 INFO:teuthology.orchestra.run.smithi008.stdout:The following packages will be upgraded: 2020-01-26T15:23:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-26T15:23:51.086 INFO:teuthology.orchestra.run.smithi008.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:23:51.087 INFO:teuthology.orchestra.run.smithi008.stdout:Need to get 65.9 MB of archives. 2020-01-26T15:23:51.087 INFO:teuthology.orchestra.run.smithi008.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-26T15:23:51.087 INFO:teuthology.orchestra.run.smithi008.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-26T15:23:52.091 INFO:teuthology.orchestra.run.smithi008.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-26T15:23:52.282 INFO:teuthology.orchestra.run.smithi008.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-26T15:23:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-26T15:23:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-26T15:23:53.240 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-26T15:23:53.545 INFO:teuthology.orchestra.run.smithi008.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-26T15:23:53.566 INFO:teuthology.orchestra.run.smithi008.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-26T15:23:54.060 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 65.9 MB in 3s (24.9 MB/s) 2020-01-26T15:23:54.220 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-26T15:23:54.261 INFO:teuthology.orchestra.run.smithi008.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-26T15:23:54.264 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:54.317 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:55.968 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-26T15:23:55.980 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:56.076 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:23:56.613 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-26T15:23:56.625 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:23:56.663 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:00.414 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:24:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:24:00.848 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:24:00.954 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:24:01.290 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-26T15:24:01.305 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-26T15:24:01.348 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:24:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-26T15:24:06.243 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:24:06.279 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:08.867 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:24:08.972 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:24:09.287 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:24:09.444 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:09.988 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:10.612 INFO:teuthology.orchestra.run.smithi008.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:24:10.613 INFO:teuthology.orchestra.run.smithi008.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-26T15:24:11.131 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:11.635 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:11.778 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-26T15:24:11.904 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-26T15:24:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-26T15:24:12.115 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-26T15:24:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:24:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-26T15:24:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:Sourcing file `/etc/default/grub' 2020-01-26T15:24:27.714 INFO:teuthology.orchestra.run.smithi008.stdout:Generating grub configuration file ... 2020-01-26T15:24:28.062 INFO:teuthology.orchestra.run.smithi008.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:24:28.083 INFO:teuthology.orchestra.run.smithi008.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:24:28.384 INFO:teuthology.orchestra.run.smithi008.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:24:28.425 INFO:teuthology.orchestra.run.smithi008.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:24:30.020 INFO:teuthology.orchestra.run.smithi008.stdout:done 2020-01-26T15:24:30.415 INFO:teuthology.orchestra.run.smithi008:> dpkg -s linux-image-generic 2020-01-26T15:24:30.436 INFO:teuthology.orchestra.run.smithi008.stdout:Package: linux-image-generic 2020-01-26T15:24:30.436 INFO:teuthology.orchestra.run.smithi008.stdout:Status: install ok installed 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Priority: optional 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Section: kernel 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Installed-Size: 15 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: amd64 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Source: linux-meta 2020-01-26T15:24:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Version: 4.15.0.74.76 2020-01-26T15:24:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:24:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:Recommends: thermald 2020-01-26T15:24:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:Description: Generic Linux kernel image 2020-01-26T15:24:30.438 INFO:teuthology.orchestra.run.smithi008.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:24:30.438 INFO:teuthology.orchestra.run.smithi008.stdout: available. 2020-01-26T15:24:30.438 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-26T15:24:30.439 INFO:teuthology.orchestra.run.smithi163:> uname -r 2020-01-26T15:24:30.445 INFO:teuthology.orchestra.run.smithi163.stdout:4.15.0-72-generic 2020-01-26T15:24:30.445 INFO:teuthology.task.kernel:Running kernel on smithi163: 4.15.0-72-generic 2020-01-26T15:24:30.445 INFO:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2020-01-26T15:24:30.581 INFO:teuthology.orchestra.run.smithi163:> sudo apt-get update 2020-01-26T15:24:30.714 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:24:30.839 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:24:30.919 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:24:30.973 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [422 kB] 2020-01-26T15:24:31.050 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [611 kB] 2020-01-26T15:24:31.071 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [199 kB] 2020-01-26T15:24:31.077 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [18.4 kB] 2020-01-26T15:24:31.077 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,408 B] 2020-01-26T15:24:31.077 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [608 kB] 2020-01-26T15:24:31.095 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [634 kB] 2020-01-26T15:24:31.096 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-26T15:24:31.098 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-26T15:24:31.098 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-26T15:24:31.189 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:24:31.310 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [632 kB] 2020-01-26T15:24:31.524 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [833 kB] 2020-01-26T15:24:31.615 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [292 kB] 2020-01-26T15:24:31.636 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [27.4 kB] 2020-01-26T15:24:31.638 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,356 B] 2020-01-26T15:24:31.639 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,044 kB] 2020-01-26T15:24:31.687 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,005 kB] 2020-01-26T15:24:31.724 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [322 kB] 2020-01-26T15:24:31.733 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-26T15:24:31.733 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-26T15:24:31.734 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-26T15:24:31.734 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,032 B] 2020-01-26T15:24:31.776 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-01-26T15:24:31.776 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-26T15:24:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 7,167 kB in 1s (4,988 kB/s) 2020-01-26T15:24:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:24:33.636 INFO:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:24:33.718 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:24:33.967 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2020-01-26T15:24:33.968 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2020-01-26T15:24:34.042 INFO:teuthology.orchestra.run.smithi163.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:24:34.044 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:24:34.044 INFO:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:24:34.114 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:24:34.335 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2020-01-26T15:24:34.336 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2020-01-26T15:24:34.493 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2020-01-26T15:24:34.493 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:24:34.493 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-26T15:24:34.494 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-26T15:24:34.495 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2020-01-26T15:24:34.495 INFO:teuthology.orchestra.run.smithi163.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-26T15:24:34.495 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2020-01-26T15:24:34.496 INFO:teuthology.orchestra.run.smithi163.stdout: thermald 2020-01-26T15:24:34.529 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2020-01-26T15:24:34.529 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:24:34.529 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-26T15:24:34.530 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-26T15:24:34.531 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2020-01-26T15:24:34.532 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-26T15:24:34.710 INFO:teuthology.orchestra.run.smithi163.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:24:34.710 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 65.9 MB of archives. 2020-01-26T15:24:34.710 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-26T15:24:34.711 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-26T15:24:35.721 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-26T15:24:35.914 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-26T15:24:36.856 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-26T15:24:36.856 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-26T15:24:36.857 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-26T15:24:37.166 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-26T15:24:37.670 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 65.9 MB in 3s (24.9 MB/s) 2020-01-26T15:24:37.834 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-26T15:24:37.874 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-26T15:24:37.877 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:24:37.931 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:39.593 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-26T15:24:39.606 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:24:39.699 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:40.189 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-26T15:24:40.199 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:24:40.230 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:43.985 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:24:44.089 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:24:44.404 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:24:44.526 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:24:44.863 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-26T15:24:44.876 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-26T15:24:44.913 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:24:49.668 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-26T15:24:49.689 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:24:49.742 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:52.048 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:24:52.172 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:24:52.481 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:24:52.618 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:53.162 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:53.602 INFO:teuthology.orchestra.run.smithi163.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:24:53.602 INFO:teuthology.orchestra.run.smithi163.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-26T15:24:53.730 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:54.199 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:54.317 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-26T15:24:54.442 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-26T15:24:54.568 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-26T15:24:54.694 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:24:54.885 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-26T15:24:54.885 INFO:teuthology.orchestra.run.smithi163.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:25:09.677 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-26T15:25:09.677 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub' 2020-01-26T15:25:09.692 INFO:teuthology.orchestra.run.smithi163.stdout:Generating grub configuration file ... 2020-01-26T15:25:10.018 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:25:10.047 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:25:10.366 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:25:10.400 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:25:11.313 INFO:teuthology.orchestra.run.smithi163.stdout:done 2020-01-26T15:25:11.727 INFO:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2020-01-26T15:25:11.747 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 15 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2020-01-26T15:25:11.748 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2020-01-26T15:25:11.749 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 4.15.0.74.76 2020-01-26T15:25:11.749 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:25:11.749 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2020-01-26T15:25:11.749 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2020-01-26T15:25:11.749 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:25:11.749 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2020-01-26T15:25:11.750 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-26T15:25:11.750 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-01-26T15:25:11.750 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-26T15:25:11.750 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-26T15:25:11.750 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-26T15:25:11.750 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-01-26T15:25:11.750 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2020-01-26T15:25:11.751 INFO:teuthology.orchestra.run.smithi170:> sudo apt-get clean 2020-01-26T15:25:11.815 INFO:teuthology.orchestra.run.smithi170:> sudo apt-get update 2020-01-26T15:25:12.065 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:25:12.065 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:25:12.139 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:25:12.220 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:25:13.855 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:25:13.903 INFO:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:25:13.984 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:25:14.210 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2020-01-26T15:25:14.210 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2020-01-26T15:25:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:25:14.286 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:25:14.286 INFO:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:25:14.370 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:25:14.615 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2020-01-26T15:25:14.616 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2020-01-26T15:25:14.803 INFO:teuthology.orchestra.run.smithi170.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-26T15:25:14.803 INFO:teuthology.orchestra.run.smithi170.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:25:14.805 INFO:teuthology.orchestra.run.smithi170:> dpkg -s linux-image-generic 2020-01-26T15:25:14.828 INFO:teuthology.orchestra.run.smithi170.stdout:Package: linux-image-generic 2020-01-26T15:25:14.828 INFO:teuthology.orchestra.run.smithi170.stdout:Status: install ok installed 2020-01-26T15:25:14.828 INFO:teuthology.orchestra.run.smithi170.stdout:Priority: optional 2020-01-26T15:25:14.829 INFO:teuthology.orchestra.run.smithi170.stdout:Section: kernel 2020-01-26T15:25:14.829 INFO:teuthology.orchestra.run.smithi170.stdout:Installed-Size: 15 2020-01-26T15:25:14.829 INFO:teuthology.orchestra.run.smithi170.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:25:14.829 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: amd64 2020-01-26T15:25:14.829 INFO:teuthology.orchestra.run.smithi170.stdout:Source: linux-meta 2020-01-26T15:25:14.829 INFO:teuthology.orchestra.run.smithi170.stdout:Version: 4.15.0.74.76 2020-01-26T15:25:14.830 INFO:teuthology.orchestra.run.smithi170.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:25:14.830 INFO:teuthology.orchestra.run.smithi170.stdout:Recommends: thermald 2020-01-26T15:25:14.830 INFO:teuthology.orchestra.run.smithi170.stdout:Description: Generic Linux kernel image 2020-01-26T15:25:14.830 INFO:teuthology.orchestra.run.smithi170.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:25:14.830 INFO:teuthology.orchestra.run.smithi170.stdout: available. 2020-01-26T15:25:14.830 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:25:14.877 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.KEuuTDmdI0 2020-01-26T15:25:14.877 INFO:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KEuuTDmdI0 2020-01-26T15:25:14.934 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.KEuuTDmdI0 2020-01-26T15:25:15.043 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.KEuuTDmdI0 is 8KB 2020-01-26T15:25:15.093 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.KEuuTDmdI0 2020-01-26T15:25:15.099 INFO:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-26T15:25:15.154 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-26T15:25:15.251 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-26T15:25:15.252 INFO:teuthology.orchestra.run.smithi170:> sudo update-grub 2020-01-26T15:25:16.463 INFO:teuthology.orchestra.run.smithi170.stderr:Sourcing file `/etc/default/grub' 2020-01-26T15:25:16.479 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2020-01-26T15:25:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:25:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:25:17.073 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:25:17.086 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:25:18.374 INFO:teuthology.orchestra.run.smithi170.stderr:done 2020-01-26T15:25:18.376 INFO:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2020-01-26T15:25:18.378 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2020-01-26T15:25:18.378 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2020-01-26T15:25:18.378 INFO:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2020-01-26T15:25:18.669 INFO:teuthology.orchestra.run.smithi163:> sudo apt-get update 2020-01-26T15:25:18.933 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:25:18.934 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:25:19.002 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:25:19.085 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:25:20.738 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:25:20.783 INFO:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:25:20.859 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:25:21.099 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2020-01-26T15:25:21.100 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2020-01-26T15:25:21.178 INFO:teuthology.orchestra.run.smithi163.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:25:21.179 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:25:21.180 INFO:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:25:21.253 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:25:21.476 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2020-01-26T15:25:21.477 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2020-01-26T15:25:21.658 INFO:teuthology.orchestra.run.smithi163.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-26T15:25:21.658 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:25:21.659 INFO:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2020-01-26T15:25:21.676 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2020-01-26T15:25:21.676 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2020-01-26T15:25:21.677 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2020-01-26T15:25:21.677 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2020-01-26T15:25:21.677 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 15 2020-01-26T15:25:21.677 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:25:21.677 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2020-01-26T15:25:21.677 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2020-01-26T15:25:21.678 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 4.15.0.74.76 2020-01-26T15:25:21.678 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:25:21.678 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2020-01-26T15:25:21.678 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2020-01-26T15:25:21.678 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:25:21.678 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2020-01-26T15:25:21.679 INFO:teuthology.orchestra.run.smithi163:> mktemp 2020-01-26T15:25:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.ZFpoWYKBaZ 2020-01-26T15:25:21.727 INFO:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZFpoWYKBaZ 2020-01-26T15:25:21.782 INFO:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.ZFpoWYKBaZ 2020-01-26T15:25:21.900 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.ZFpoWYKBaZ is 8KB 2020-01-26T15:25:21.950 INFO:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.ZFpoWYKBaZ 2020-01-26T15:25:21.957 INFO:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-26T15:25:22.014 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-26T15:25:22.112 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-26T15:25:22.112 INFO:teuthology.orchestra.run.smithi163:> sudo update-grub 2020-01-26T15:25:23.367 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub' 2020-01-26T15:25:23.373 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2020-01-26T15:25:23.614 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:25:23.626 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:25:23.932 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:25:23.946 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:25:24.505 INFO:teuthology.orchestra.run.smithi163.stderr:done 2020-01-26T15:25:24.506 INFO:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2020-01-26T15:25:24.508 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2020-01-26T15:25:24.509 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2020-01-26T15:25:24.509 INFO:teuthology.orchestra.run.smithi008:> sudo apt-get clean 2020-01-26T15:25:24.572 INFO:teuthology.orchestra.run.smithi008:> sudo apt-get update 2020-01-26T15:25:24.825 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:25:24.826 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:25:24.895 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:25:24.976 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:25:26.677 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:25:26.724 INFO:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:25:26.800 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:25:27.040 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2020-01-26T15:25:27.040 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2020-01-26T15:25:27.126 INFO:teuthology.orchestra.run.smithi008.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:25:27.127 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:25:27.127 INFO:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:25:27.205 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:25:27.460 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2020-01-26T15:25:27.461 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2020-01-26T15:25:27.663 INFO:teuthology.orchestra.run.smithi008.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-26T15:25:27.663 INFO:teuthology.orchestra.run.smithi008.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:25:27.665 INFO:teuthology.orchestra.run.smithi008:> dpkg -s linux-image-generic 2020-01-26T15:25:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:Package: linux-image-generic 2020-01-26T15:25:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:Status: install ok installed 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Priority: optional 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Section: kernel 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Installed-Size: 15 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: amd64 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Source: linux-meta 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Version: 4.15.0.74.76 2020-01-26T15:25:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:25:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:Recommends: thermald 2020-01-26T15:25:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:Description: Generic Linux kernel image 2020-01-26T15:25:27.688 INFO:teuthology.orchestra.run.smithi008.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:25:27.688 INFO:teuthology.orchestra.run.smithi008.stdout: available. 2020-01-26T15:25:27.689 INFO:teuthology.orchestra.run.smithi008:> mktemp 2020-01-26T15:25:27.734 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.M42Gcns3sh 2020-01-26T15:25:27.734 INFO:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub/grub.cfg /tmp/tmp.M42Gcns3sh 2020-01-26T15:25:27.809 INFO:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.M42Gcns3sh 2020-01-26T15:25:27.928 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.M42Gcns3sh is 8KB 2020-01-26T15:25:27.978 INFO:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.M42Gcns3sh 2020-01-26T15:25:27.984 INFO:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-26T15:25:28.038 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-26T15:25:28.136 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-26T15:25:28.136 INFO:teuthology.orchestra.run.smithi008:> sudo update-grub 2020-01-26T15:25:29.335 INFO:teuthology.orchestra.run.smithi008.stderr:Sourcing file `/etc/default/grub' 2020-01-26T15:25:29.344 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2020-01-26T15:25:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:25:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:25:29.832 INFO:teuthology.orchestra.run.smithi008.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:25:29.845 INFO:teuthology.orchestra.run.smithi008.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:25:31.211 INFO:teuthology.orchestra.run.smithi008.stderr:done 2020-01-26T15:25:31.213 INFO:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2020-01-26T15:25:31.216 INFO:teuthology.misc:Re-opening connections... 2020-01-26T15:25:31.217 INFO:teuthology.misc:trying to connect to ubuntu@smithi008.front.sepia.ceph.com 2020-01-26T15:25:31.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:25:31.219 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:25:31.291 INFO:teuthology.orchestra.run.smithi008:> true 2020-01-26T15:25:31.786 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:25:31.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:25:31.787 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:26:06.314 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:26:06.314 DEBUG:teuthology.misc:waited 35.0975270271 2020-01-26T15:26:07.315 INFO:teuthology.misc:trying to connect to ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:26:07.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:26:07.315 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:07.317 DEBUG:teuthology.orchestra.remote:timed out 2020-01-26T15:27:07.317 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:07.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:07.317 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:10.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:10.374 DEBUG:teuthology.misc:waited 99.1573150158 2020-01-26T15:27:11.375 INFO:teuthology.misc:trying to connect to ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:27:11.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:11.375 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:11.479 INFO:teuthology.orchestra.run.smithi170:> true 2020-01-26T15:27:11.989 DEBUG:teuthology.misc:waited 100.772328138 2020-01-26T15:27:12.990 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:12.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:12.991 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:13.446 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:13.446 DEBUG:teuthology.misc:waited 102.229333162 2020-01-26T15:27:14.446 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:14.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:14.447 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:17.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:17.510 DEBUG:teuthology.misc:waited 106.293395042 2020-01-26T15:27:18.511 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:18.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:18.512 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:20.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:20.582 DEBUG:teuthology.misc:waited 109.365389109 2020-01-26T15:27:21.583 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:21.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:21.584 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:21.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:21.606 DEBUG:teuthology.misc:waited 110.389507055 2020-01-26T15:27:22.607 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:22.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:22.609 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:22.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:22.610 DEBUG:teuthology.misc:waited 111.393577099 2020-01-26T15:27:23.612 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:23.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:23.613 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:23.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:23.614 DEBUG:teuthology.misc:waited 112.397725105 2020-01-26T15:27:24.615 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:24.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:24.617 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:24.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2020-01-26T15:27:24.619 DEBUG:teuthology.misc:waited 113.402065039 2020-01-26T15:27:25.619 INFO:teuthology.misc:trying to connect to ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:27:25.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:25.620 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:25.879 INFO:teuthology.orchestra.run.smithi163:> true 2020-01-26T15:27:27.185 DEBUG:teuthology.misc:waited 115.968279123 2020-01-26T15:27:28.186 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-01-26T15:27:28.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-74-generic"... 2020-01-26T15:27:28.186 INFO:teuthology.orchestra.run.smithi170:> uname -r 2020-01-26T15:27:28.192 INFO:teuthology.orchestra.run.smithi170.stdout:4.15.0-74-generic 2020-01-26T15:27:28.193 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-26T15:27:28.193 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-26T15:27:28.193 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2020-01-26T15:27:28.193 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.15.0-74-generic"... 2020-01-26T15:27:28.193 INFO:teuthology.orchestra.run.smithi163:> uname -r 2020-01-26T15:27:28.200 INFO:teuthology.orchestra.run.smithi163.stdout:4.15.0-74-generic 2020-01-26T15:27:28.200 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-26T15:27:28.200 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-26T15:27:28.200 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2020-01-26T15:27:28.200 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.15.0-74-generic"... 2020-01-26T15:27:28.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:27:28.201 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:27:28.321 INFO:teuthology.orchestra.run.smithi008:> true 2020-01-26T15:27:28.831 INFO:teuthology.orchestra.run.smithi008:> uname -r 2020-01-26T15:27:28.876 INFO:teuthology.orchestra.run.smithi008.stdout:4.15.0-74-generic 2020-01-26T15:27:28.877 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-26T15:27:28.877 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-26T15:27:29.878 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-01-26T15:27:29.878 INFO:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-26T15:27:29.906 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2020-01-26T15:27:29.933 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2020-01-26T15:27:29.933 INFO:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-26T15:27:29.993 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2020-01-26T15:27:30.025 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2020-01-26T15:27:30.026 INFO:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-26T15:27:30.050 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2020-01-26T15:27:30.078 INFO:teuthology.run_tasks:Running task internal.base... 2020-01-26T15:27:30.102 INFO:teuthology.task.internal:Creating test directory... 2020-01-26T15:27:30.102 INFO:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-26T15:27:30.121 INFO:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-26T15:27:30.123 INFO:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-26T15:27:30.130 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-01-26T15:27:30.141 INFO:teuthology.run_tasks:Running task internal.archive... 2020-01-26T15:27:30.149 INFO:teuthology.task.internal:Creating archive directory... 2020-01-26T15:27:30.149 INFO:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-26T15:27:30.169 INFO:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-26T15:27:30.172 INFO:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-26T15:27:30.200 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-01-26T15:27:30.286 INFO:teuthology.task.internal:Enabling coredump saving... 2020-01-26T15:27:30.286 INFO:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-26T15:27:30.288 INFO:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-26T15:27:30.291 INFO:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-26T15:27:30.306 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:27:30.311 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:27:30.315 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:27:30.315 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:27:30.318 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:27:30.320 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:27:30.321 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-01-26T15:27:31.159 INFO:teuthology.task.internal:Configuring sudo... 2020-01-26T15:27:31.159 INFO:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-26T15:27:31.163 INFO:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-26T15:27:31.174 INFO:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-26T15:27:31.197 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-01-26T15:27:32.185 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-01-26T15:27:32.186 INFO:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-26T15:27:32.188 INFO:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-26T15:27:32.190 INFO:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-26T15:27:32.197 INFO:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-26T15:27:32.241 INFO:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-26T15:27:32.289 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-26T15:27:32.377 INFO:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-26T15:27:32.384 INFO:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-26T15:27:32.434 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-26T15:27:32.522 INFO:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-26T15:27:32.528 INFO:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-26T15:27:32.577 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-26T15:27:32.669 INFO:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2020-01-26T15:27:32.672 INFO:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2020-01-26T15:27:32.713 INFO:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2020-01-26T15:27:32.762 INFO:teuthology.run_tasks:Running task internal.timer... 2020-01-26T15:27:32.770 INFO:teuthology.task.internal:Starting timer... 2020-01-26T15:27:32.771 INFO:teuthology.run_tasks:Running task pcp... 2020-01-26T15:27:32.802 INFO:teuthology.run_tasks:Running task selinux... 2020-01-26T15:27:32.814 DEBUG:teuthology.task.selinux:Excluding smithi008: OS 'ubuntu' does not support SELinux 2020-01-26T15:27:32.814 DEBUG:teuthology.task.selinux:Excluding smithi170: OS 'ubuntu' does not support SELinux 2020-01-26T15:27:32.814 DEBUG:teuthology.task.selinux:Excluding smithi163: OS 'ubuntu' does not support SELinux 2020-01-26T15:27:32.814 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-01-26T15:27:32.814 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-01-26T15:27:32.815 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-01-26T15:27:32.815 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-01-26T15:27:33.204 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-01-26T15:27:33.211 INFO:teuthology.repo_utils:Fetching master from origin 2020-01-26T15:27:33.277 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-01-26T15:27:33.292 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-01-26T15:27:33.294 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi170.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-01-26T15:27:33.613 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-01-26T15:27:34.724 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-01-26T15:27:37.283 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-01-26T15:27:37.304 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:37 +0000 (0:00:00.059) 0:00:00.059 ******** 2020-01-26T15:27:37.317 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:37 +0000 (0:00:00.012) 0:00:00.072 ******** 2020-01-26T15:27:37.328 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:37 +0000 (0:00:00.010) 0:00:00.082 ******** 2020-01-26T15:27:39.873 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi170.front.sepia.ceph.com] 2020-01-26T15:27:39.964 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:39 +0000 (0:00:02.636) 0:00:02.719 ******** 2020-01-26T15:27:39.976 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] 2020-01-26T15:27:39.989 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] 2020-01-26T15:27:40.100 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.136) 0:00:02.855 ******** 2020-01-26T15:27:40.134 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.033) 0:00:02.888 ******** 2020-01-26T15:27:40.232 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-01-26T15:27:40.234 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:27:40.276 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.142) 0:00:03.030 ******** 2020-01-26T15:27:40.315 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.038) 0:00:03.069 ******** 2020-01-26T15:27:40.320 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:27:40.361 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.046) 0:00:03.116 ******** 2020-01-26T15:27:40.751 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-01-26T15:27:40.753 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-26T15:27:40.797 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.435) 0:00:03.551 ******** 2020-01-26T15:27:40.804 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-26T15:27:40.806 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-26T15:27:40.846 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.049) 0:00:03.600 ******** 2020-01-26T15:27:40.881 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:40 +0000 (0:00:00.035) 0:00:03.636 ******** 2020-01-26T15:27:41.128 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-01-26T15:27:41.129 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.060361", "end": "2020-01-26 15:27:41.159782", "rc": 0, "start": "2020-01-26 15:27:41.099421", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-26T15:27:41.171 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:41 +0000 (0:00:00.289) 0:00:03.925 ******** 2020-01-26T15:27:41.176 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.078077", "end": "2020-01-26 15:27:41.115268", "rc": 0, "start": "2020-01-26 15:27:41.037191", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-26T15:27:41.177 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.090789", "end": "2020-01-26 15:27:41.129692", "rc": 0, "start": "2020-01-26 15:27:41.038903", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-26T15:27:41.221 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:41 +0000 (0:00:00.050) 0:00:03.976 ******** 2020-01-26T15:27:41.257 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:41 +0000 (0:00:00.036) 0:00:04.012 ******** 2020-01-26T15:27:41.424 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:27:41.467 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:41 +0000 (0:00:00.209) 0:00:04.221 ******** 2020-01-26T15:27:41.502 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:41 +0000 (0:00:00.035) 0:00:04.257 ******** 2020-01-26T15:27:41.509 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:27:41.547 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:41 +0000 (0:00:00.045) 0:00:04.302 ******** 2020-01-26T15:27:42.148 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-01-26T15:27:42.149 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580052461.52-128697842033249/source", "state": "file", "uid": 0} 2020-01-26T15:27:42.187 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:42 +0000 (0:00:00.639) 0:00:04.942 ******** 2020-01-26T15:27:42.195 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580052461.48-133240651161755/source", "state": "file", "uid": 0} 2020-01-26T15:27:42.197 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580052461.56-131059226902750/source", "state": "file", "uid": 0} 2020-01-26T15:27:42.256 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:42 +0000 (0:00:00.069) 0:00:05.011 ******** 2020-01-26T15:27:42.292 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:42 +0000 (0:00:00.035) 0:00:05.046 ******** 2020-01-26T15:27:42.504 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-01-26T15:27:42.504 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-01-26T15:27:42.506 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-01-26T15:27:42.507 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-01-26T15:27:42.509 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-26T15:27:42.639 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-01-26T15:27:42.640 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-26T15:27:42.737 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-01-26T15:27:42.742 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-01-26T15:27:42.923 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:42 +0000 (0:00:00.630) 0:00:05.677 ******** 2020-01-26T15:27:42.956 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:42 +0000 (0:00:00.033) 0:00:05.711 ******** 2020-01-26T15:27:42.990 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:42 +0000 (0:00:00.033) 0:00:05.744 ******** 2020-01-26T15:27:43.664 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-01-26T15:27:43.665 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] 2020-01-26T15:27:43.722 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] 2020-01-26T15:27:43.734 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] 2020-01-26T15:27:43.833 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-01-26T15:27:43.834 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:43 +0000 (0:00:00.843) 0:00:06.588 ******** 2020-01-26T15:27:43.889 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:43 +0000 (0:00:00.055) 0:00:06.644 ******** 2020-01-26T15:27:43.931 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:43 +0000 (0:00:00.042) 0:00:06.686 ******** 2020-01-26T15:27:44.208 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-01-26T15:27:44.210 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.247036", "end": "2020-01-26 15:27:44.188312", "rc": 0, "start": "2020-01-26 15:27:43.941276", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-01-26T15:27:44.250 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.318) 0:00:07.004 ******** 2020-01-26T15:27:44.379 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-26T15:27:44.381 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.001923", "end": "2020-01-26 15:27:44.413000", "failed_when_result": false, "rc": 0, "start": "2020-01-26 15:27:44.411077", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-26T15:27:44.419 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.169) 0:00:07.174 ******** 2020-01-26T15:27:44.445 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-26T15:27:44.447 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.485 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.065) 0:00:07.239 ******** 2020-01-26T15:27:44.510 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-01-26T15:27:44.512 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.550 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.065) 0:00:07.304 ******** 2020-01-26T15:27:44.557 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-01-26T15:27:44.558 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.495317", "end": "2020-01-26 15:27:44.537482", "rc": 0, "start": "2020-01-26 15:27:44.042165", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-01-26T15:27:44.559 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.537799", "end": "2020-01-26 15:27:44.537765", "rc": 0, "start": "2020-01-26 15:27:43.999966", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-01-26T15:27:44.598 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.048) 0:00:07.353 ******** 2020-01-26T15:27:44.630 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.031) 0:00:07.385 ******** 2020-01-26T15:27:44.634 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-01-26T15:27:44.635 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.676 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.045) 0:00:07.430 ******** 2020-01-26T15:27:44.711 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-01-26T15:27:44.713 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.753 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.076) 0:00:07.507 ******** 2020-01-26T15:27:44.758 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-26T15:27:44.759 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.004422", "end": "2020-01-26 15:27:44.708458", "failed_when_result": false, "rc": 0, "start": "2020-01-26 15:27:44.704036", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-26T15:27:44.800 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.046) 0:00:07.554 ******** 2020-01-26T15:27:44.806 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013869", "end": "2020-01-26 15:27:44.748465", "failed_when_result": false, "rc": 0, "start": "2020-01-26 15:27:44.734596", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-26T15:27:44.807 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-01-26T15:27:44.807 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.847 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.047) 0:00:07.602 ******** 2020-01-26T15:27:44.885 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.038) 0:00:07.640 ******** 2020-01-26T15:27:44.890 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-26T15:27:44.891 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.892 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:44.938 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.046) 0:00:07.687 ******** 2020-01-26T15:27:44.970 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:44 +0000 (0:00:00.037) 0:00:07.724 ******** 2020-01-26T15:27:44.975 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-01-26T15:27:44.977 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:45.019 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.049) 0:00:07.773 ******** 2020-01-26T15:27:45.024 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:45.025 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-01-26T15:27:45.026 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:27:45.068 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.049) 0:00:07.823 ******** 2020-01-26T15:27:45.106 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.037) 0:00:07.861 ******** 2020-01-26T15:27:45.111 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-01-26T15:27:45.113 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:45.153 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.046) 0:00:07.907 ******** 2020-01-26T15:27:45.188 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.035) 0:00:07.942 ******** 2020-01-26T15:27:45.193 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-01-26T15:27:45.195 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:45.233 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.045) 0:00:07.988 ******** 2020-01-26T15:27:45.239 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:45.281 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.047) 0:00:08.036 ******** 2020-01-26T15:27:45.287 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-01-26T15:27:45.288 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:27:45.290 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-26T15:27:45.330 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.048) 0:00:08.084 ******** 2020-01-26T15:27:45.335 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-01-26T15:27:45.337 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:27:45.376 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.046) 0:00:08.131 ******** 2020-01-26T15:27:45.424 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:27:45.424 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-26T15:27:45.457 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-01-26T15:27:45.458 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:27:45.497 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.121) 0:00:08.252 ******** 2020-01-26T15:27:45.516 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:27:45.558 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:27:45 +0000 (0:00:00.061) 0:00:08.313 ******** 2020-01-26T15:27:45.564 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:27:45.565 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-26T15:27:45.681 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-26T15:27:45.704 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-26T15:27:45.726 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-26T15:27:45.807 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-26T15:27:45.829 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-26T15:27:45.859 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-26T15:27:45.943 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-26T15:27:45.982 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-26T15:27:45.994 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-26T15:27:46.079 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-26T15:27:46.107 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-26T15:27:46.135 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-26T15:27:46.220 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-26T15:27:46.254 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-26T15:27:46.255 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-26T15:27:46.356 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-26T15:27:46.389 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-26T15:27:46.401 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-26T15:27:46.488 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-26T15:27:46.521 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-26T15:27:46.535 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-26T15:27:46.617 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-26T15:27:46.660 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-26T15:27:46.682 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-26T15:27:46.758 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-26T15:27:46.780 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-26T15:27:46.817 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-26T15:27:46.891 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-26T15:27:46.913 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-26T15:27:46.956 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-26T15:27:47.031 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-26T15:27:47.033 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-26T15:27:47.109 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-26T15:27:47.163 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-26T15:27:47.165 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-26T15:27:47.260 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-26T15:27:47.296 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loo 2020-01-26T15:27:47.298 INFO:teuthology.task.ansible.out:p_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-26T15:27:47.409 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-26T15:27:47.421 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-26T15:27:47.434 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-26T15:27:47.560 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-26T15:27:47.562 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-26T15:27:47.573 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-26T15:27:47.689 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-26T15:27:47.722 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-26T15:27:47.734 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-26T15:27:47.818 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-26T15:27:47.882 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-26T15:27:47.893 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-26T15:27:47.947 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-26T15:27:48.032 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-26T15:27:48.044 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-26T15:27:48.076 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-26T15:27:48.161 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-26T15:27:48.163 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-26T15:27:48.206 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-26T15:27:48.303 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-26T15:27:48.304 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-26T15:27:48.369 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-26T15:27:48.429 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-26T15:27:48.452 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-26T15:27:48.506 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-26T15:27:48.560 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-26T15:27:48.593 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-26T15:27:48.636 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-26T15:27:48.711 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-26T15:27:48.733 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-26T15:27:48.766 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-26T15:27:48.842 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-26T15:27:48.885 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-26T15:27:48.896 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-26T15:27:48.970 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-26T15:27:49.024 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-26T15:27:49.025 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-26T15:27:49.131 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-26T15:27:49.163 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-26T15:27:49.175 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-26T15:27:49.271 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-26T15:27:49.304 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-26T15:27:49.316 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-26T15:27:49.390 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-26T15:27:49.454 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-26T15:27:49.455 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-26T15:27:49.529 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-26T15:27:49.584 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-26T15:27:49.606 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-26T15:27:49.670 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-26T15:27:49.713 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-26T15:27:49.746 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-26T15:27:49.790 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-26T15:27:49.833 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-26T15:27:49.886 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-26T15:27:49.929 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-26T15:27:49.974 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-26T15:27:50.021 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-26T15:27:50.059 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-26T15:27:50.102 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-26T15:27:50.135 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-26T15:27:50.189 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-26T15:27:50.232 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-26T15:27:50.275 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-26T15:27:50.319 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-26T15:27:50.362 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-26T15:27:50.416 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-26T15:27:50.449 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-26T15:27:50.494 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-26T15:27:50.570 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-26T15:27:50.573 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-26T15:27:50.621 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-26T15:27:50.708 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-26T15:27:50.710 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:27:50.756 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:27:50.842 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:27:50.855 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-26T15:27:50.878 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-26T15:27:50.974 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-26T15:27:50.997 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-26T15:27:51.011 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-26T15:27:51.108 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-26T15:27:51.109 INFO:teuthology.task.ansible.out: 2020-01-26T15:27:51.120 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-26T15:27:51.142 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-26T15:27:51.240 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-26T15:27:51.274 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-26T15:27:51.385 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-26T15:27:51.408 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-26T15:27:51.409 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-26T15:27:51.518 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-26T15:27:51.539 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-26T15:27:51.552 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-26T15:27:51.648 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-26T15:27:51.670 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-26T15:27:51.692 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-26T15:27:51.788 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-26T15:27:51.811 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:27:51.833 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:27:51.918 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:27:51.965 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-26T15:27:51.989 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-26T15:27:52.058 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-26T15:27:52.091 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-26T15:27:52.133 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-26T15:27:52.185 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-26T15:27:52.223 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-26T15:27:52.276 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-26T15:27:52.319 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-26T15:27:52.351 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-26T15:27:52.436 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-26T15:27:52.479 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-26T15:27:52.491 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-26T15:27:52.586 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-26T15:27:52.619 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-26T15:27:52.620 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-26T15:27:52.714 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-26T15:27:52.747 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-26T15:27:52.748 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-26T15:27:52.863 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-26T15:27:52.875 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-26T15:27:52.876 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-26T15:27:53.003 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-26T15:27:53.004 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-26T15:27:53.016 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-26T15:27:53.142 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-26T15:27:53.144 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-26T15:27:53.145 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-26T15:27:53.277 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-26T15:27:53.277 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-26T15:27:53.301 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-26T15:27:53.407 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-26T15:27:53.408 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-26T15:27:53.420 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-26T15:27:53.536 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-26T15:27:53.537 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-26T15:27:53.549 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-26T15:27:53.666 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-26T15:27:53.667 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-26T15:27:53.679 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-26T15:27:53.794 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-26T15:27:53.817 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-26T15:27:53.818 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-26T15:27:53.923 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-26T15:27:53.956 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-26T15:27:53.968 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-26T15:27:54.053 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:27:54.087 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-26T15:27:54.130 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-26T15:27:54.184 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-26T15:27:54.218 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:27:54.282 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:27:54.326 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-26T15:27:54.348 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-26T15:27:54.424 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-26T15:27:54.457 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-26T15:27:54.491 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-26T15:27:54.576 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-26T15:27:54.578 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-26T15:27:54.622 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-26T15:27:54.711 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-26T15:27:54.723 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-26T15:27:54.756 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-26T15:27:54.850 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-26T15:27:54.851 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-26T15:27:54.896 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-26T15:27:54.982 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-26T15:27:55.004 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-26T15:27:55.064 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-26T15:27:55.118 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-26T15:27:55.151 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-26T15:27:55.215 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-26T15:27:55.258 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-26T15:27:55.291 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-26T15:27:55.336 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-26T15:27:55.380 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-26T15:27:55.414 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-26T15:27:55.479 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-26T15:27:55.523 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-26T15:27:55.557 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-26T15:27:55.642 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-26T15:27:55.654 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-26T15:27:55.707 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-26T15:27:55.772 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-26T15:27:55.794 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-26T15:27:55.848 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-26T15:27:55.894 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-26T15:27:55.916 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-26T15:27:55.991 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-26T15:27:56.046 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-26T15:27:56.122 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-26T15:27:56.182 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-26T15:27:56.184 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-26T15:27:56.250 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-26T15:27:56.316 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-26T15:27:56.392 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-26T15:27:56.445 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-26T15:27:56.457 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-26T15:27:56.521 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-26T15:27:56.586 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-26T15:27:56.588 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-26T15:27:56.673 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-26T15:27:56.717 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-26T15:27:56.729 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-26T15:27:56.825 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-26T15:27:56.848 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-26T15:27:56.871 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-26T15:27:56.958 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-26T15:27:56.981 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-26T15:27:57.014 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-26T15:27:57.111 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-26T15:27:57.154 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-26T15:27:57.218 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-26T15:27:57.263 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-26T15:27:57.307 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-26T15:27:57.341 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-26T15:27:57.387 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-26T15:27:57.462 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-26T15:27:57.484 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-26T15:27:57.528 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-26T15:27:57.582 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-26T15:27:57.635 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-26T15:27:57.657 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-26T15:27:57.721 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-26T15:27:57.785 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-26T15:27:57.818 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-26T15:27:57.861 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-26T15:27:57.945 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-26T15:27:57.958 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-26T15:27:57.991 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-26T15:27:58.096 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-26T15:27:58.108 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-26T15:27:58.119 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-26T15:27:58.246 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-26T15:27:58.257 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-26T15:27:58.280 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-26T15:27:58.422 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-26T15:27:58.423 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-26T15:27:58.435 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-26T15:27:58.593 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-26T15:27:58.595 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-26T15:27:58.614 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-26T15:27:58.756 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-26T15:27:58.768 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-26T15:27:58.770 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-26T15:27:58.930 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-26T15:27:58.932 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-26T15:27:58.933 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-26T15:27:59.067 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-26T15:27:59.068 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-26T15:27:59.090 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-26T15:27:59.194 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-26T15:27:59.195 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-26T15:27:59.207 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-26T15:27:59.335 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-26T15:27:59.337 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-26T15:27:59.339 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-26T15:27:59.467 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-26T15:27:59.480 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:27:59.492 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-26T15:27:59.594 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-26T15:27:59.605 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-26T15:27:59.674 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-26T15:27:59.738 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:27:59.740 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-26T15:27:59.818 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-26T15:27:59.875 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-26T15:27:59.877 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-26T15:27:59.969 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:28:00.013 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-26T15:28:00.107 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-26T15:28:00.150 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-26T15:28:00.254 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-26T15:28:00.384 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-26T15:28:00.400 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-26T15:28:00.705 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-26T15:28:00.925 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-26T15:28:00.962 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-26T15:28:01.240 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-26T15:28:01.375 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-26T15:28:01.443 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-26T15:28:01.682 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-26T15:28:01.874 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-01-26T15:28:01.927 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-26T15:28:02.242 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-01-26T15:28:02.454 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-01-26T15:28:02.462 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-01-26T15:28:02.586 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:02 +0000 (0:00:17.027) 0:00:25.341 ******** 2020-01-26T15:28:02.612 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-26T15:28:02.648 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:02 +0000 (0:00:00.062) 0:00:25.403 ******** 2020-01-26T15:28:02.695 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:28:02.696 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-01-26T15:28:02.709 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-26T15:28:02.715 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-26T15:28:02.717 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-26T15:28:02.718 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-26T15:28:02.720 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-26T15:28:02.721 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c2 2020-01-26T15:28:02.721 INFO:teuthology.task.ansible.out:4e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-26T15:28:02.723 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-26T15:28:02.724 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-26T15:28:02.726 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-01-26T15:28:02.727 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029cc 2020-01-26T15:28:02.727 INFO:teuthology.task.ansible.out:dc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-01-26T15:28:02.729 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-01-26T15:28:02.730 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-01-26T15:28:02.753 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:28:02.843 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:02 +0000 (0:00:00.193) 0:00:25.596 ******** 2020-01-26T15:28:02.886 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:02 +0000 (0:00:00.044) 0:00:25.641 ******** 2020-01-26T15:28:02.892 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-26T15:28:02.894 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:28:02.895 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-01-26T15:28:02.952 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:02 +0000 (0:00:00.065) 0:00:25.706 ******** 2020-01-26T15:28:03.041 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-26T15:28:03.045 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-26T15:28:03.047 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-26T15:28:03.048 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-26T15:28:03.050 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-26T15:28:03.051 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c2 2020-01-26T15:28:03.051 INFO:teuthology.task.ansible.out:4e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-26T15:28:03.053 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-26T15:28:03.054 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-26T15:28:03.056 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-01-26T15:28:03.057 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029cc 2020-01-26T15:28:03.057 INFO:teuthology.task.ansible.out:dc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-01-26T15:28:03.059 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-01-26T15:28:03.060 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-01-26T15:28:03.102 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:03 +0000 (0:00:00.150) 0:00:25.857 ******** 2020-01-26T15:28:03.141 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:03 +0000 (0:00:00.038) 0:00:25.896 ******** 2020-01-26T15:28:03.161 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-26T15:28:03.200 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:03 +0000 (0:00:00.058) 0:00:25.954 ******** 2020-01-26T15:28:03.249 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-26T15:28:03.258 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-26T15:28:03.260 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-26T15:28:03.261 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-26T15:28:03.263 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-26T15:28:03.264 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-26T15:28:03.266 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-26T15:28:03.267 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d 2020-01-26T15:28:03.267 INFO:teuthology.task.ansible.out:49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-26T15:28:03.269 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-01-26T15:28:03.270 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-01-26T15:28:03.272 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-01-26T15:28:03.273 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-01-26T15:28:03.312 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:03 +0000 (0:00:00.112) 0:00:26.067 ******** 2020-01-26T15:28:03.828 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-01-26T15:28:03.829 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com -> localhost] => {"after": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "attempts": 1, "before": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "changed": false, "remote_url_changed": false} 2020-01-26T15:28:03.874 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:03 +0000 (0:00:00.561) 0:00:26.628 ******** 2020-01-26T15:28:03.881 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com -> localhost] => {"after": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "attempts": 1, "before": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "changed": false, "remote_url_changed": false} 2020-01-26T15:28:03.931 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:03 +0000 (0:00:00.057) 0:00:26.686 ******** 2020-01-26T15:28:04.031 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com -> localhost] => {"after": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "attempts": 1, "before": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "changed": false, "remote_url_changed": false} 2020-01-26T15:28:04.092 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:04 +0000 (0:00:00.160) 0:00:26.847 ******** 2020-01-26T15:28:04.099 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:28:04.100 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-26T15:28:04.124 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-26T15:28:04.198 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-26T15:28:04.272 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-26T15:28:04.295 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-26T15:28:04.349 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-26T15:28:04.406 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-26T15:28:04.556 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-26T15:28:04.597 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-26T15:28:04.598 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-26T15:28:04.655 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-26T15:28:04.657 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-26T15:28:04.708 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-26T15:28:04.721 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-26T15:28:04.784 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-26T15:28:04.834 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-26T15:28:04.836 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-26T15:28:04.856 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-26T15:28:04.858 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-26T15:28:04.910 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-26T15:28:04.911 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-26T15:28:04.973 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-26T15:28:04.985 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-26T15:28:05.048 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-26T15:28:05.101 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-26T15:28:05.103 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-26T15:28:05.123 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-26T15:28:05.124 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.187 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-26T15:28:05.220 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.253 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-26T15:28:05.266 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-26T15:28:05.273 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.278 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.288 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.363 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-26T15:28:05.364 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-26T15:28:05.374 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.385 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.396 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.408 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-26T15:28:05.409 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-26T15:28:05.441 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.538 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-26T15:28:05.539 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-26T15:28:05.540 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-26T15:28:05.561 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-26T15:28:05.563 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-26T15:28:05.572 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.584 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.599 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:05.672 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-26T15:28:05.674 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-26T15:28:05.684 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-26T15:28:05.719 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-26T15:28:05.815 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4 2020-01-26T15:28:05.817 INFO:teuthology.task.ansible.out:\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-26T15:28:05.860 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-26T15:28:05.862 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-26T15:28:05.937 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-26T15:28:05.948 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-26T15:28:05.984 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-26T15:28:06.071 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-26T15:28:06.105 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-26T15:28:06.128 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-26T15:28:06.203 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-26T15:28:06.247 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-26T15:28:06.280 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-26T15:28:06.333 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-26T15:28:06.391 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-26T15:28:06.414 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-26T15:28:06.479 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-26T15:28:06.480 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-26T15:28:06.522 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-26T15:28:06.565 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-26T15:28:06.613 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-26T15:28:06.615 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-01-26T15:28:06.660 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-26T15:28:06.662 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-26T15:28:06.696 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-26T15:28:06.754 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-26T15:28:06.807 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-26T15:28:06.809 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-01-26T15:28:06.829 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-26T15:28:06.831 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-26T15:28:06.875 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-26T15:28:06.928 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-26T15:28:06.992 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-26T15:28:06.993 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-01-26T15:28:07.014 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-26T15:28:07.015 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-26T15:28:07.068 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-26T15:28:07.121 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-26T15:28:07.143 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-26T15:28:07.196 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-26T15:28:07.201 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-26T15:28:07.269 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-26T15:28:07.278 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-26T15:28:07.326 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-26T15:28:07.502 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-26T15:28:07.503 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-26T15:28:07.505 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-26T15:28:07.527 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-26T15:28:07.580 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-26T15:28:07.612 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-26T15:28:07.655 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-26T15:28:07.719 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-26T15:28:07.730 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-26T15:28:07.784 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-26T15:28:07.785 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-26T15:28:07.858 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-26T15:28:07.860 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-26T15:28:07.914 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-26T15:28:07.993 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-26T15:28:07.995 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-26T15:28:08.015 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-26T15:28:08.058 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-26T15:28:08.143 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-26T15:28:08.144 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-26T15:28:08.176 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-26T15:28:08.281 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-26T15:28:08.283 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-26T15:28:08.284 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-26T15:28:08.327 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-26T15:28:08.418 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-26T15:28:08.420 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-26T15:28:08.465 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-26T15:28:08.541 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-26T15:28:08.554 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-26T15:28:08.617 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-26T15:28:08.675 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-26T15:28:08.687 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-26T15:28:08.754 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:28:08.840 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-26T15:28:08.863 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-26T15:28:08.906 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-26T15:28:08.970 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:28:08.992 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-26T15:28:09.046 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-26T15:28:09.099 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-26T15:28:09.142 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-26T15:28:09.174 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-26T15:28:09.176 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-26T15:28:09.241 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-26T15:28:09.284 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:28:09.318 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-26T15:28:09.319 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-26T15:28:09.372 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-26T15:28:09.373 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-26T15:28:09.425 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-26T15:28:09.458 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-26T15:28:09.514 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-26T15:28:09.515 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-26T15:28:09.592 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-26T15:28:09.594 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-26T15:28:09.639 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-26T15:28:09.713 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-26T15:28:09.725 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-26T15:28:09.727 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-26T15:28:09.791 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-26T15:28:09.844 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-26T15:28:09.845 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:28:09.856 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-26T15:28:09.858 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-26T15:28:09.902 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-26T15:28:09.978 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-26T15:28:09.980 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-26T15:28:09.981 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-26T15:28:10.037 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-26T15:28:10.038 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:28:10.095 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-26T15:28:10.120 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-26T15:28:10.184 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-26T15:28:10.185 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-26T15:28:10.187 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-26T15:28:10.227 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-26T15:28:10.280 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-26T15:28:10.281 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:10.319 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-26T15:28:10.367 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-26T15:28:10.420 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-26T15:28:10.422 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:28:10.442 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-26T15:28:10.486 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-26T15:28:10.559 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-26T15:28:10.561 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-26T15:28:10.563 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-26T15:28:10.571 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-26T15:28:10.628 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-26T15:28:10.696 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-26T15:28:10.697 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-26T15:28:10.761 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-26T15:28:10.825 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-26T15:28:10.827 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-26T15:28:10.897 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-26T15:28:10.950 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-26T15:28:10.990 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-26T15:28:11.043 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-26T15:28:11.086 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-26T15:28:11.129 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-26T15:28:11.172 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-26T15:28:11.173 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-26T15:28:11.215 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-26T15:28:11.260 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-26T15:28:11.316 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-26T15:28:11.362 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-26T15:28:11.363 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:11.396 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-26T15:28:11.397 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-26T15:28:11.444 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-26T15:28:11.508 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-26T15:28:11.531 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-26T15:28:11.589 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-26T15:28:11.594 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-26T15:28:11.673 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-26T15:28:11.684 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-26T15:28:11.710 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-26T15:28:11.819 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-26T15:28:11.821 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9H 2020-01-26T15:28:11.823 INFO:teuthology.task.ansible.out:fASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-26T15:28:11.843 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-26T15:28:11.845 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:11.959 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-26T15:28:11.960 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-26T15:28:11.972 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-26T15:28:12.098 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-26T15:28:12.121 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:28:12.122 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-26T15:28:12.239 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-26T15:28:12.283 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-26T15:28:12.284 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-26T15:28:12.295 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-26T15:28:12.370 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-26T15:28:12.413 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-26T15:28:12.467 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:28:12.515 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-26T15:28:12.537 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-26T15:28:12.581 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-26T15:28:12.635 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-26T15:28:12.711 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-26T15:28:12.712 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-26T15:28:12.777 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-26T15:28:12.866 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-26T15:28:12.881 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:28:12.904 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-26T15:28:12.905 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:13.014 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-26T15:28:13.026 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-26T15:28:13.038 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-26T15:28:13.163 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-26T15:28:13.172 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-26T15:28:13.184 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-26T15:28:13.303 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-26T15:28:13.316 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-26T15:28:13.346 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-26T15:28:13.434 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-26T15:28:13.447 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-26T15:28:13.522 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-26T15:28:13.566 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-26T15:28:13.588 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-26T15:28:13.673 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-26T15:28:13.706 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-26T15:28:13.741 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-26T15:28:13.792 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-26T15:28:13.846 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-26T15:28:13.868 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-26T15:28:13.937 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-26T15:28:13.990 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-26T15:28:14.002 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-26T15:28:14.080 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-26T15:28:14.124 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-26T15:28:14.146 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-26T15:28:14.225 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-26T15:28:14.259 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-26T15:28:14.304 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-26T15:28:14.359 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-26T15:28:14.423 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-26T15:28:14.449 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-26T15:28:14.493 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-26T15:28:14.557 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-26T15:28:14.580 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-26T15:28:14.638 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-26T15:28:14.693 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-26T15:28:14.737 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-26T15:28:14.782 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-26T15:28:14.846 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-26T15:28:14.871 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-26T15:28:14.916 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-26T15:28:14.970 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-26T15:28:15.016 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-26T15:28:15.049 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-26T15:28:15.104 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-26T15:28:15.149 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-26T15:28:15.151 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-26T15:28:15.173 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-26T15:28:15.249 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-26T15:28:15.315 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-26T15:28:15.316 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-26T15:28:15.328 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-26T15:28:15.330 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:15.395 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-26T15:28:15.462 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-26T15:28:15.494 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-26T15:28:15.549 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-26T15:28:15.551 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-26T15:28:15.593 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-26T15:28:15.636 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-26T15:28:15.692 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-26T15:28:15.694 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-26T15:28:15.725 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-26T15:28:15.769 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-26T15:28:15.824 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-26T15:28:15.846 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-26T15:28:15.900 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-26T15:28:15.974 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-26T15:28:15.986 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-26T15:28:16.041 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-26T15:28:16.043 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-26T15:28:16.105 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-26T15:28:16.127 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-26T15:28:16.195 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-26T15:28:16.197 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-26T15:28:16.259 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-26T15:28:16.305 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-26T15:28:16.324 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-26T15:28:16.388 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-26T15:28:16.442 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-26T15:28:16.443 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-26T15:28:16.531 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-26T15:28:16.574 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-26T15:28:16.586 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-26T15:28:16.672 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-26T15:28:16.716 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-26T15:28:16.738 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-26T15:28:16.817 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-26T15:28:16.891 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-26T15:28:16.894 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-26T15:28:16.956 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-26T15:28:17.038 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-26T15:28:17.039 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-26T15:28:17.086 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-26T15:28:17.160 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-26T15:28:17.177 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-26T15:28:17.216 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-26T15:28:17.286 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-26T15:28:17.288 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-26T15:28:17.351 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-26T15:28:17.417 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-26T15:28:17.420 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-26T15:28:17.422 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:28:17.482 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-26T15:28:17.535 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-26T15:28:17.557 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-26T15:28:17.628 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-26T15:28:17.681 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-26T15:28:17.682 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-26T15:28:17.748 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-26T15:28:17.750 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:28:17.812 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-26T15:28:17.813 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-26T15:28:17.888 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-26T15:28:17.941 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-26T15:28:17.953 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-26T15:28:18.028 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-26T15:28:18.075 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-26T15:28:18.087 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-26T15:28:18.173 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-26T15:28:18.209 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZ 2020-01-26T15:28:18.210 INFO:teuthology.task.ansible.out:s7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-26T15:28:18.232 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-26T15:28:18.234 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:28:18.299 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-26T15:28:18.342 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-01-26T15:28:18.365 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-26T15:28:18.436 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-26T15:28:18.481 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-01-26T15:28:18.568 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc 2020-01-26T15:28:18.570 INFO:teuthology.task.ansible.out:/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-26T15:28:18.599 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:18 +0000 (0:00:14.507) 0:00:41.354 ******** 2020-01-26T15:28:18.651 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-26T15:28:18.663 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:18.664 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.674 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.675 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.686 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.697 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.698 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:28:18.700 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-01-26T15:28:18.721 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.723 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.809 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:28:18.810 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-26T15:28:18.843 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-01-26T15:28:18.925 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:18.926 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf59 2020-01-26T15:28:18.928 INFO:teuthology.task.ansible.out:2607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:18.965 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:18 +0000 (0:00:00.365) 0:00:41.719 ******** 2020-01-26T15:28:18.971 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:28:18.972 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-26T15:28:19.007 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:19.009 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.019 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.020 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-26T15:28:19.021 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.032 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.044 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.056 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.067 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.078 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.099 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:28:19.101 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-26T15:28:19.148 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:19.149 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-26T15:28:19.223 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-26T15:28:19.234 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.245 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:28:19.247 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-01-26T15:28:19.278 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:19.279 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-01-26T15:28:19.289 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.300 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.301 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.312 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.327 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.328 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.350 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.351 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.352 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.362 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.373 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.384 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-26T15:28:19.385 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.387 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-01-26T15:28:19.443 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.444 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.445 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.495 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:19 +0000 (0:00:00.530) 0:00:42.250 ******** 2020-01-26T15:28:19.501 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.502 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.504 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.506 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.520 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.521 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.531 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.532 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.532 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.544 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.544 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.546 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-26T15:28:19.546 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'k 2020-01-26T15:28:19.547 INFO:teuthology.task.ansible.out:dreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.558 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.565 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.570 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.570 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.582 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.586 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.596 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.598 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.611 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.619 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.634 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.641 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.642 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.654 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.666 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c 2020-01-26T15:28:19.670 INFO:teuthology.task.ansible.out:43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.678 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.680 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.690 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.702 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.703 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.713 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.715 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.722 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.727 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.737 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-26T15:28:19.744 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.745 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.747 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.747 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.749 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.760 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.761 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.763 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.764 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.775 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.775 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.786 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.787 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.789 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.798 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.799 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.811 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.812 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.814 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.825 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.825 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.837 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.838 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.849 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.850 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.850 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.861 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.862 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.864 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.875 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.876 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.890 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.892 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiU 2020-01-26T15:28:19.894 INFO:teuthology.task.ansible.out:hqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.905 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.906 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.908 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.918 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.918 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.920 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.930 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.931 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.933 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.944 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.970 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "o 2020-01-26T15:28:19.973 INFO:teuthology.task.ansible.out:vpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.979 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.980 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.991 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:19.993 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.007 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.007 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.020 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.031 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.032 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-26T15:28:20.033 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.044 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.045 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.046 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.057 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.058 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.059 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.069 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.070 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.071 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.072 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.082 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.083 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.096 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.107 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.108 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.118 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.133 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.143 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.144 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.145 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.156 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.157 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.158 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', 2020-01-26T15:28:20.160 INFO:teuthology.task.ansible.out: u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.171 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.171 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.173 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.195 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.196 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.197 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.199 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.245 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:20 +0000 (0:00:00.749) 0:00:42.999 ******** 2020-01-26T15:28:20.255 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.256 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.258 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.259 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.260 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.262 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.264 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] 2020-01-26T15:28:20.266 INFO:teuthology.task.ansible.out:=> (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.266 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.267 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.269 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.270 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.324 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:20 +0000 (0:00:00.079) 0:00:43.079 ******** 2020-01-26T15:28:20.333 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.335 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.335 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.336 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.338 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.339 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.339 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.341 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.341 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.343 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.344 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.346 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.346 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.347 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.359 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.360 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.363 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.372 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.374 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.375 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.386 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.388 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.399 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.400 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.401 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.411 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.412 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.414 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.425 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.426 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.426 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.437 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.438 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.439 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.450 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.451 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.452 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.462 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.463 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.465 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.475 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.475 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.477 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.487 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.488 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.499 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.500 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.511 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.513 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.530 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi008.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.530 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.541 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.542 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.544 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.554 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.555 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.566 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.567 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.569 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.580 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.581 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.600 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.601 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.603 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.650 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:20 +0000 (0:00:00.325) 0:00:43.404 ******** 2020-01-26T15:28:20.656 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.658 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.659 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.661 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:20.661 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-26T15:28:20.662 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.664 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.676 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.687 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.688 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.699 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-01-26T15:28:20.700 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.746 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:20 +0000 (0:00:00.096) 0:00:43.500 ******** 2020-01-26T15:28:20.755 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.756 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.757 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.759 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.770 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.771 INFO:teuthology.task.ansible.out: skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.782 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.783 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:20.783 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-26T15:28:20.794 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:20.796 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.806 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.881 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.882 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.884 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.884 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.885 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.888 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.899 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.899 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.911 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:20.913 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-26T15:28:20.913 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:20.913 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.925 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.936 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.936 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:20.937 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-26T15:28:20.938 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.950 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.965 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.974 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.985 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.996 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:20.997 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:21.007 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:21.018 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:21.030 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:21.031 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:21.042 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:21.043 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-26T15:28:21.049 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:28:21.128 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:21 +0000 (0:00:00.382) 0:00:43.883 ******** 2020-01-26T15:28:21.136 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:21.137 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-26T15:28:21.150 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-01-26T15:28:21.152 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:21.198 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:21 +0000 (0:00:00.068) 0:00:43.951 ******** 2020-01-26T15:28:21.204 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:21.205 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-26T15:28:21.227 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-26T15:28:21.295 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-26T15:28:21.362 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-26T15:28:21.363 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-26T15:28:21.411 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-26T15:28:21.482 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-26T15:28:21.493 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-26T15:28:21.540 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-26T15:28:21.627 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-26T15:28:21.629 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-26T15:28:21.674 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-26T15:28:21.751 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-26T15:28:21.752 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-26T15:28:21.805 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-26T15:28:21.882 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-26T15:28:21.894 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-26T15:28:21.929 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-26T15:28:22.014 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-26T15:28:22.025 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-26T15:28:22.061 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-26T15:28:22.136 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-26T15:28:22.147 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-26T15:28:22.194 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-26T15:28:22.268 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-26T15:28:22.280 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-26T15:28:22.326 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-26T15:28:22.394 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-26T15:28:22.405 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-26T15:28:22.458 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-26T15:28:22.532 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-26T15:28:22.544 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-26T15:28:22.587 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-26T15:28:22.655 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-26T15:28:22.676 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-26T15:28:22.721 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-26T15:28:22.786 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-26T15:28:22.807 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-26T15:28:22.860 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-26T15:28:22.923 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-26T15:28:22.956 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-26T15:28:22.978 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-26T15:28:23.052 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-26T15:28:23.085 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-26T15:28:23.113 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-26T15:28:23.189 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-26T15:28:23.210 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-26T15:28:23.243 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-26T15:28:23.307 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-26T15:28:23.339 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-26T15:28:23.393 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-26T15:28:23.446 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-26T15:28:23.479 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-26T15:28:23.516 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-26T15:28:23.589 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-26T15:28:23.612 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-26T15:28:23.644 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-26T15:28:23.718 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-26T15:28:23.764 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-26T15:28:23.778 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-26T15:28:23.845 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-26T15:28:23.904 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-26T15:28:23.907 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-26T15:28:23.983 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-26T15:28:24.039 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-26T15:28:24.042 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-26T15:28:24.043 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:24.119 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-26T15:28:24.182 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-26T15:28:24.204 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-26T15:28:24.236 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-26T15:28:24.331 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-26T15:28:24.343 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-26T15:28:24.376 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-26T15:28:24.494 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-26T15:28:24.496 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-26T15:28:24.497 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-26T15:28:24.622 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-26T15:28:24.635 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-26T15:28:24.646 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-26T15:28:24.760 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-26T15:28:24.761 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-26T15:28:24.772 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-26T15:28:24.906 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-26T15:28:24.923 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-26T15:28:25.046 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-26T15:28:25.058 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-26T15:28:25.167 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-26T15:28:25.204 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-26T15:28:25.247 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-26T15:28:25.311 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-26T15:28:25.375 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-26T15:28:25.442 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-26T15:28:25.506 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-26T15:28:25.560 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-26T15:28:25.634 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-26T15:28:25.698 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-26T15:28:25.710 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-26T15:28:25.791 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-26T15:28:25.844 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-26T15:28:25.918 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-26T15:28:25.982 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-26T15:28:26.067 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-26T15:28:26.124 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-26T15:28:26.177 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-26T15:28:26.188 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-26T15:28:26.252 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-26T15:28:26.320 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-26T15:28:26.331 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-26T15:28:26.385 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-26T15:28:26.429 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:26 +0000 (0:00:05.230) 0:00:49.182 ******** 2020-01-26T15:28:26.458 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-26T15:28:26.514 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-26T15:28:26.596 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-26T15:28:26.654 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-26T15:28:26.735 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-26T15:28:26.778 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-26T15:28:26.833 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "checksum": "0568d7d0ebf10dfbba0efd326c0e510710bba26c", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b0e90762d2e927269695598309000a29", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580052506.45-199401021642197/source", "state": "file", "uid": 0} 2020-01-26T15:28:26.891 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:26 +0000 (0:00:00.463) 0:00:49.646 ******** 2020-01-26T15:28:26.931 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:26 +0000 (0:00:00.039) 0:00:49.685 ******** 2020-01-26T15:28:26.937 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:26.937 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-26T15:28:26.939 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi008.front.sepia.ceph.com] => { "msg": "Host smithi008.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-01-26T15:28:27.003 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:26 +0000 (0:00:00.071) 0:00:49.757 ******** 2020-01-26T15:28:27.008 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:27.009 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-26T15:28:27.056 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-26T15:28:27.058 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-26T15:28:27.097 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.094) 0:00:49.851 ******** 2020-01-26T15:28:27.123 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-26T15:28:27.124 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.186 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.089) 0:00:49.941 ******** 2020-01-26T15:28:27.202 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:27.202 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-26T15:28:27.204 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-26T15:28:27.206 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.244 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.057) 0:00:49.999 ******** 2020-01-26T15:28:27.259 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:28:27.260 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-26T15:28:27.286 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-01-26T15:28:27.287 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.325 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.080) 0:00:50.079 ******** 2020-01-26T15:28:27.363 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.037) 0:00:50.117 ******** 2020-01-26T15:28:27.367 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-26T15:28:27.368 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.369 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "checksum": "0568d7d0ebf10dfbba0efd326c0e510710bba26c", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b0e90762d2e927269695598309000a29", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580052506.95-110187300440175/source", "state": "file", "uid": 0} 2020-01-26T15:28:27.410 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.047) 0:00:50.164 ******** 2020-01-26T15:28:27.446 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.036) 0:00:50.201 ******** 2020-01-26T15:28:27.451 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-26T15:28:27.453 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.491 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.045) 0:00:50.246 ******** 2020-01-26T15:28:27.496 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-01-26T15:28:27.498 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => { "msg": "Host smithi163.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-01-26T15:28:27.535 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.044) 0:00:50.290 ******** 2020-01-26T15:28:27.540 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-01-26T15:28:27.542 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.590 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.054) 0:00:50.344 ******** 2020-01-26T15:28:27.594 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-26T15:28:27.595 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-26T15:28:27.635 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.045) 0:00:50.389 ******** 2020-01-26T15:28:27.639 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-26T15:28:27.640 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.681 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.046) 0:00:50.436 ******** 2020-01-26T15:28:27.687 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-26T15:28:27.688 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.729 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.047) 0:00:50.484 ******** 2020-01-26T15:28:27.734 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-26T15:28:27.736 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "checksum": "0568d7d0ebf10dfbba0efd326c0e510710bba26c", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b0e90762d2e927269695598309000a29", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580052507.38-121405233750313/source", "state": "file", "uid": 0} 2020-01-26T15:28:27.776 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.047) 0:00:50.531 ******** 2020-01-26T15:28:27.811 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.035) 0:00:50.566 ******** 2020-01-26T15:28:27.815 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-26T15:28:27.817 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi008.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:27.824 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:27.865 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.050) 0:00:50.617 ******** 2020-01-26T15:28:27.898 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.035) 0:00:50.652 ******** 2020-01-26T15:28:27.903 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-01-26T15:28:27.905 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => { "msg": "Host smithi170.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [common : Set have_entitlements] ****************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:27.944 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.046) 0:00:50.699 ******** 2020-01-26T15:28:27.981 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:27 +0000 (0:00:00.036) 0:00:50.735 ******** 2020-01-26T15:28:27.989 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.035 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.054) 0:00:50.789 ******** 2020-01-26T15:28:28.075 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.039) 0:00:50.829 ******** 2020-01-26T15:28:28.081 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-26T15:28:28.082 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-26T15:28:28.083 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-01-26T15:28:28.083 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:28.127 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.048) 0:00:50.878 ******** 2020-01-26T15:28:28.159 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.036) 0:00:50.914 ******** 2020-01-26T15:28:28.166 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-26T15:28:28.168 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.206 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.047) 0:00:50.961 ******** 2020-01-26T15:28:28.243 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.036) 0:00:50.997 ******** 2020-01-26T15:28:28.248 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-26T15:28:28.250 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:28.293 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.050) 0:00:51.048 ******** 2020-01-26T15:28:28.331 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.037) 0:00:51.085 ******** 2020-01-26T15:28:28.335 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-26T15:28:28.337 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.377 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.046) 0:00:51.131 ******** 2020-01-26T15:28:28.412 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.034) 0:00:51.166 ******** 2020-01-26T15:28:28.417 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-26T15:28:28.418 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.420 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.457 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.045) 0:00:51.212 ******** 2020-01-26T15:28:28.493 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.034) 0:00:51.247 ******** 2020-01-26T15:28:28.499 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.538 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.045) 0:00:51.293 ******** 2020-01-26T15:28:28.575 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.036) 0:00:51.330 ******** 2020-01-26T15:28:28.580 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-01-26T15:28:28.582 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.623 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.047) 0:00:51.378 ******** 2020-01-26T15:28:28.657 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.034) 0:00:51.412 ******** 2020-01-26T15:28:28.661 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-26T15:28:28.663 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:28.703 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.046) 0:00:51.458 ******** 2020-01-26T15:28:28.737 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.033) 0:00:51.492 ******** 2020-01-26T15:28:28.742 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-26T15:28:28.744 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.783 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.045) 0:00:51.538 ******** 2020-01-26T15:28:28.817 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.033) 0:00:51.572 ******** 2020-01-26T15:28:28.821 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-26T15:28:28.822 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.823 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.863 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.045) 0:00:51.618 ******** 2020-01-26T15:28:28.898 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.034) 0:00:51.652 ******** 2020-01-26T15:28:28.902 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-26T15:28:28.904 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:28.946 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.048) 0:00:51.701 ******** 2020-01-26T15:28:28.983 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:28 +0000 (0:00:00.036) 0:00:51.738 ******** 2020-01-26T15:28:28.987 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-26T15:28:28.988 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:28.989 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.028 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.045) 0:00:51.783 ******** 2020-01-26T15:28:29.062 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.034) 0:00:51.817 ******** 2020-01-26T15:28:29.066 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-01-26T15:28:29.068 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.109 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.046) 0:00:51.864 ******** 2020-01-26T15:28:29.143 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.034) 0:00:51.898 ******** 2020-01-26T15:28:29.148 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-01-26T15:28:29.148 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.150 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.190 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.046) 0:00:51.944 ******** 2020-01-26T15:28:29.224 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.034) 0:00:51.979 ******** 2020-01-26T15:28:29.229 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-26T15:28:29.230 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:29.270 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.045) 0:00:52.025 ******** 2020-01-26T15:28:29.306 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.035) 0:00:52.060 ******** 2020-01-26T15:28:29.310 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-26T15:28:29.312 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-26T15:28:29.357 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.050) 0:00:52.112 ******** 2020-01-26T15:28:29.393 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.035) 0:00:52.147 ******** 2020-01-26T15:28:29.398 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-26T15:28:29.400 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.438 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.045) 0:00:52.193 ******** 2020-01-26T15:28:29.474 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.035) 0:00:52.229 ******** 2020-01-26T15:28:29.479 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-01-26T15:28:29.479 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:29.481 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.519 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.045) 0:00:52.274 ******** 2020-01-26T15:28:29.554 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.034) 0:00:52.308 ******** 2020-01-26T15:28:29.562 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-26T15:28:29.563 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:29.564 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.566 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.605 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.051) 0:00:52.360 ******** 2020-01-26T15:28:29.642 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.036) 0:00:52.397 ******** 2020-01-26T15:28:29.648 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-01-26T15:28:29.649 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi008.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.691 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.049) 0:00:52.446 ******** 2020-01-26T15:28:29.697 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.699 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-01-26T15:28:29.699 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.746 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.054) 0:00:52.500 ******** 2020-01-26T15:28:29.785 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.039) 0:00:52.540 ******** 2020-01-26T15:28:29.792 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-26T15:28:29.794 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.795 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.836 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.050) 0:00:52.590 ******** 2020-01-26T15:28:29.876 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.039) 0:00:52.630 ******** 2020-01-26T15:28:29.880 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-26T15:28:29.882 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Update yum cache] *********************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.923 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.047) 0:00:52.678 ******** 2020-01-26T15:28:29.962 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:29 +0000 (0:00:00.038) 0:00:52.717 ******** 2020-01-26T15:28:29.969 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-01-26T15:28:29.971 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.972 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-26T15:28:29.972 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:29.974 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.014 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.051) 0:00:52.769 ******** 2020-01-26T15:28:30.050 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.035) 0:00:52.804 ******** 2020-01-26T15:28:30.058 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:30.100 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.050) 0:00:52.854 ******** 2020-01-26T15:28:30.105 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-26T15:28:30.106 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.151 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.051) 0:00:52.906 ******** 2020-01-26T15:28:30.158 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-01-26T15:28:30.159 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** 2020-01-26T15:28:30.159 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010769", "end": "2020-01-26 15:28:30.133238", "rc": 0, "start": "2020-01-26 15:28:30.122469", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-26T15:28:30.202 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.050) 0:00:52.957 ******** 2020-01-26T15:28:30.238 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.035) 0:00:52.992 ******** 2020-01-26T15:28:30.243 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-01-26T15:28:30.245 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.286 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.048) 0:00:53.041 ******** 2020-01-26T15:28:30.322 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.035) 0:00:53.077 ******** 2020-01-26T15:28:30.327 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-26T15:28:30.329 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.369 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.047) 0:00:53.124 ******** 2020-01-26T15:28:30.406 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.036) 0:00:53.160 ******** 2020-01-26T15:28:30.410 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-01-26T15:28:30.411 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.413 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.452 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.046) 0:00:53.207 ******** 2020-01-26T15:28:30.488 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.035) 0:00:53.243 ******** 2020-01-26T15:28:30.494 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-01-26T15:28:30.495 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.537 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.049) 0:00:53.292 ******** 2020-01-26T15:28:30.579 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.041) 0:00:53.333 ******** 2020-01-26T15:28:30.585 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-01-26T15:28:30.586 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.625 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.046) 0:00:53.379 ******** 2020-01-26T15:28:30.661 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.036) 0:00:53.416 ******** 2020-01-26T15:28:30.668 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-26T15:28:30.669 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.709 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.047) 0:00:53.463 ******** 2020-01-26T15:28:30.745 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.035) 0:00:53.499 ******** 2020-01-26T15:28:30.750 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-01-26T15:28:30.751 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.752 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.793 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.048) 0:00:53.548 ******** 2020-01-26T15:28:30.829 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.035) 0:00:53.583 ******** 2020-01-26T15:28:30.836 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.878 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.049) 0:00:53.633 ******** 2020-01-26T15:28:30.884 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-01-26T15:28:30.885 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.933 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.054) 0:00:53.687 ******** 2020-01-26T15:28:30.938 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-01-26T15:28:30.940 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:30.981 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:30 +0000 (0:00:00.047) 0:00:53.735 ******** 2020-01-26T15:28:30.985 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-01-26T15:28:30.986 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.027 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.046) 0:00:53.782 ******** 2020-01-26T15:28:31.033 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-01-26T15:28:31.034 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:31.075 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.048) 0:00:53.830 ******** 2020-01-26T15:28:31.081 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-01-26T15:28:31.082 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.124 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.048) 0:00:53.878 ******** 2020-01-26T15:28:31.129 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-01-26T15:28:31.131 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.180 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.056) 0:00:53.935 ******** 2020-01-26T15:28:31.185 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-01-26T15:28:31.187 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.227 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.046) 0:00:53.982 ******** 2020-01-26T15:28:31.233 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-01-26T15:28:31.234 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.276 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.048) 0:00:54.031 ******** 2020-01-26T15:28:31.281 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-01-26T15:28:31.283 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.328 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.051) 0:00:54.083 ******** 2020-01-26T15:28:31.334 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-01-26T15:28:31.335 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.381 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.052) 0:00:54.135 ******** 2020-01-26T15:28:31.386 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-01-26T15:28:31.387 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:31.434 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.052) 0:00:54.188 ******** 2020-01-26T15:28:31.440 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-01-26T15:28:31.441 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.481 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.047) 0:00:54.236 ******** 2020-01-26T15:28:31.486 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-26T15:28:31.529 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.047) 0:00:54.283 ******** 2020-01-26T15:28:31.535 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-01-26T15:28:31.537 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the hardware clock] ***************************************** changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.600323", "end": "2020-01-26 15:28:31.500373", "rc": 0, "start": "2020-01-26 15:28:30.900050", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:31.582 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.053) 0:00:54.337 ******** 2020-01-26T15:28:31.619 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.036) 0:00:54.374 ******** 2020-01-26T15:28:31.623 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-01-26T15:28:31.623 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.625 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.666 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.046) 0:00:54.421 ******** 2020-01-26T15:28:31.702 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.036) 0:00:54.457 ******** 2020-01-26T15:28:31.709 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-01-26T15:28:31.710 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.750 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.048) 0:00:54.505 ******** 2020-01-26T15:28:31.755 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-01-26T15:28:31.757 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.800 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.049) 0:00:54.555 ******** 2020-01-26T15:28:31.807 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-01-26T15:28:31.808 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:31.862 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.061) 0:00:54.616 ******** 2020-01-26T15:28:31.868 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-01-26T15:28:31.868 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.870 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-01-26T15:28:31.870 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.046263", "end": "2020-01-26 15:28:31.822232", "rc": 0, "start": "2020-01-26 15:28:31.775969", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:31.872 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:31.910 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.048) 0:00:54.665 ******** 2020-01-26T15:28:31.944 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.033) 0:00:54.698 ******** 2020-01-26T15:28:31.949 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-26T15:28:31.991 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:31 +0000 (0:00:00.047) 0:00:54.745 ******** 2020-01-26T15:28:31.995 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-01-26T15:28:31.998 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.046 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.054) 0:00:54.800 ******** 2020-01-26T15:28:32.050 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-01-26T15:28:32.052 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.092 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.046) 0:00:54.846 ******** 2020-01-26T15:28:32.098 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-26T15:28:32.100 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.101 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.140 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.048) 0:00:54.895 ******** 2020-01-26T15:28:32.146 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-01-26T15:28:32.148 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.195 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.055) 0:00:54.950 ******** 2020-01-26T15:28:32.200 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2020-01-26T15:28:32.202 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.251 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.056) 0:00:55.006 ******** 2020-01-26T15:28:32.256 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-01-26T15:28:32.257 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.258 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.050) 0:00:55.057 ******** TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-26T15:28:32.310 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.312 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.359 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.056) 0:00:55.113 ******** 2020-01-26T15:28:32.364 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-01-26T15:28:32.365 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.367 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.408 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.047) 0:00:55.161 ******** 2020-01-26T15:28:32.455 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-26T15:28:32.457 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.467 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.519 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.112) 0:00:55.274 ******** 2020-01-26T15:28:32.526 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014114", "end": "2020-01-26 15:28:32.492940", "rc": 0, "start": "2020-01-26 15:28:32.478826", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-26T15:28:32.563 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.044) 0:00:55.318 ******** 2020-01-26T15:28:32.568 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2020-01-26T15:28:32.569 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.614 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.050) 0:00:55.369 ******** 2020-01-26T15:28:32.619 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-01-26T15:28:32.621 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.669 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.054) 0:00:55.423 ******** 2020-01-26T15:28:32.674 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-26T15:28:32.676 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.677 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.718 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.048) 0:00:55.472 ******** 2020-01-26T15:28:32.723 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-01-26T15:28:32.725 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.765 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.047) 0:00:55.520 ******** 2020-01-26T15:28:32.792 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:28:32.795 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.832 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.067) 0:00:55.587 ******** 2020-01-26T15:28:32.859 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-01-26T15:28:32.860 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.898 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.065) 0:00:55.653 ******** 2020-01-26T15:28:32.905 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:28:32.905 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013600", "end": "2020-01-26 15:28:32.889303", "rc": 0, "start": "2020-01-26 15:28:32.875703", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-26T15:28:32.944 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.046) 0:00:55.699 ******** 2020-01-26T15:28:32.949 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-01-26T15:28:32.951 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:32.994 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:32 +0000 (0:00:00.045) 0:00:55.745 ******** 2020-01-26T15:28:32.995 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-01-26T15:28:32.996 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.038 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.047) 0:00:55.792 ******** 2020-01-26T15:28:33.043 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.086 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.048) 0:00:55.841 ******** 2020-01-26T15:28:33.092 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-01-26T15:28:33.094 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.135 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.048) 0:00:55.889 ******** 2020-01-26T15:28:33.147 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.186 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.048) 0:00:55.937 ******** 2020-01-26T15:28:33.189 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:28:33.189 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.230 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.046) 0:00:55.984 ******** 2020-01-26T15:28:33.265 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-01-26T15:28:33.267 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.304 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.074) 0:00:56.059 ******** 2020-01-26T15:28:33.331 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-01-26T15:28:33.332 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.372 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.067) 0:00:56.126 ******** 2020-01-26T15:28:33.397 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-01-26T15:28:33.399 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.452 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.080) 0:00:56.207 ******** 2020-01-26T15:28:33.490 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-01-26T15:28:33.491 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.539 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.085) 0:00:56.292 ******** 2020-01-26T15:28:33.546 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.210808", "end": "2020-01-26 15:28:33.500377", "rc": 0, "start": "2020-01-26 15:28:33.289569", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:33.594 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.056) 0:00:56.348 ******** 2020-01-26T15:28:33.620 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:33.661 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.067) 0:00:56.416 ******** 2020-01-26T15:28:33.846 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-01-26T15:28:33.847 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.047820", "end": "2020-01-26 15:28:33.823302", "rc": 0, "start": "2020-01-26 15:28:33.775482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:33.888 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:33 +0000 (0:00:00.226) 0:00:56.643 ******** 2020-01-26T15:28:34.490 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-01-26T15:28:34.492 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.821529", "end": "2020-01-26 15:28:34.500371", "rc": 0, "start": "2020-01-26 15:28:33.678842", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:34.529 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:34 +0000 (0:00:00.640) 0:00:57.284 ******** 2020-01-26T15:28:34.555 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-01-26T15:28:34.557 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:34.595 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:34 +0000 (0:00:00.065) 0:00:57.349 ******** 2020-01-26T15:28:34.790 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.047905", "end": "2020-01-26 15:28:34.793093", "rc": 0, "start": "2020-01-26 15:28:34.745188", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:34.827 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:34 +0000 (0:00:00.232) 0:00:57.581 ******** 2020-01-26T15:28:35.699 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-01-26T15:28:35.701 INFO:teuthology.task.ansible.out: [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi008.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:28:35.741 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:35 +0000 (0:00:00.914) 0:00:58.496 ******** 2020-01-26T15:28:36.597 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-01-26T15:28:36.598 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:28:36.657 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:36 +0000 (0:00:00.916) 0:00:59.412 ******** 2020-01-26T15:28:36.685 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-01-26T15:28:36.687 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:36.725 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:36 +0000 (0:00:00.067) 0:00:59.479 ******** 2020-01-26T15:28:37.243 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-01-26T15:28:37.244 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:28:37.283 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:37 +0000 (0:00:00.558) 0:01:00.038 ******** 2020-01-26T15:28:37.352 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-01-26T15:28:37.353 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-26T15:28:37.392 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:37 +0000 (0:00:00.108) 0:01:00.146 ******** 2020-01-26T15:28:38.125 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-01-26T15:28:38.126 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:28:38.166 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:38 +0000 (0:00:00.773) 0:01:00.920 ******** 2020-01-26T15:28:38.172 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-01-26T15:28:38.173 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:28:38.215 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:38 +0000 (0:00:00.049) 0:01:00.970 ******** 2020-01-26T15:28:38.242 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-01-26T15:28:38.244 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:38.283 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:38 +0000 (0:00:00.067) 0:01:01.037 ******** 2020-01-26T15:28:38.310 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-01-26T15:28:38.310 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:28:38.354 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:38 +0000 (0:00:00.071) 0:01:01.109 ******** 2020-01-26T15:28:38.613 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-26T15:28:38.649 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:38 +0000 (0:00:00.294) 0:01:01.403 ******** 2020-01-26T15:28:38.686 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:28:38.688 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-26T15:28:39.001 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-26T15:28:39.003 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.013 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.015 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:28:39.059 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:39 +0000 (0:00:00.410) 0:01:01.814 ******** 2020-01-26T15:28:39.061 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.086 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.088 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:39.129 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:39 +0000 (0:00:00.069) 0:01:01.883 ******** 2020-01-26T15:28:39.134 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.279 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi008.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-26T15:28:39.321 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:39 +0000 (0:00:00.192) 0:01:02.076 ******** 2020-01-26T15:28:39.447 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.449 INFO:teuthology.task.ansible.out:TASK [common : Add krb5 config file] ******************************************* ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-26T15:28:39.509 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:39 +0000 (0:00:00.187) 0:01:02.264 ******** 2020-01-26T15:28:39.515 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-26T15:28:39.515 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:28:39.517 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:28:39.558 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:39 +0000 (0:00:00.048) 0:01:02.313 ******** 2020-01-26T15:28:39.599 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:39 +0000 (0:00:00.040) 0:01:02.353 ******** 2020-01-26T15:28:39.912 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:39.914 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi008.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-26T15:28:40.003 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:40.010 INFO:teuthology.task.ansible.out:TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi163.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-26T15:28:40.203 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:40.204 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi008.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-26T15:28:40.294 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:28:40.303 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-26T15:28:40.326 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:28:40.396 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.796) 0:01:03.150 ******** 2020-01-26T15:28:40.397 INFO:teuthology.task.ansible.out: 2020-01-26T15:28:40.497 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:40.498 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-26T15:28:40.552 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.155) 0:01:03.306 ******** 2020-01-26T15:28:40.579 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi163.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-26T15:28:40.624 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.071) 0:01:03.378 ******** 2020-01-26T15:28:40.630 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-26T15:28:40.630 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:28:40.675 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.051) 0:01:03.430 ******** 2020-01-26T15:28:40.705 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-26T15:28:40.706 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:40.745 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.069) 0:01:03.500 ******** 2020-01-26T15:28:40.750 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-26T15:28:40.751 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:28:40.801 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.055) 0:01:03.556 ******** 2020-01-26T15:28:40.807 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:28:40.808 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-26T15:28:40.814 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:40.856 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.054) 0:01:03.610 ******** 2020-01-26T15:28:40.894 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-26T15:28:40.896 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:40.928 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:40.929 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:40.977 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:40 +0000 (0:00:00.121) 0:01:03.732 ******** 2020-01-26T15:28:41.015 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-26T15:28:41.017 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:41.085 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:41 +0000 (0:00:00.107) 0:01:03.840 ******** 2020-01-26T15:28:41.091 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:28:41.092 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-26T15:28:41.178 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:41.181 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-26T15:28:41.402 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:28:41.404 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-26T15:28:41.445 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:41 +0000 (0:00:00.359) 0:01:04.200 ******** 2020-01-26T15:28:41.471 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:41.472 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-26T15:28:41.578 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-26T15:28:41.580 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:28:41.624 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:41 +0000 (0:00:00.179) 0:01:04.379 ******** 2020-01-26T15:28:41.753 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:41.754 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-26T15:28:41.794 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:41 +0000 (0:00:00.168) 0:01:04.548 ******** 2020-01-26T15:28:41.830 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-26T15:28:41.832 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:28:41.881 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:41 +0000 (0:00:00.087) 0:01:04.636 ******** 2020-01-26T15:28:41.907 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-26T15:28:41.909 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:41.946 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:41 +0000 (0:00:00.064) 0:01:04.700 ******** 2020-01-26T15:28:41.961 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:41.962 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-26T15:28:41.974 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:42.030 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.084) 0:01:04.785 ******** 2020-01-26T15:28:42.035 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-01-26T15:28:42.035 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:28:42.079 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.049) 0:01:04.834 ******** 2020-01-26T15:28:42.085 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-26T15:28:42.086 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.087 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.106 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.145 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.065) 0:01:04.900 ******** 2020-01-26T15:28:42.171 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-26T15:28:42.172 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.210 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.064) 0:01:04.964 ******** 2020-01-26T15:28:42.268 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:42.270 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-26T15:28:42.398 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-01-26T15:28:42.399 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-26T15:28:42.436 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.226) 0:01:05.191 ******** 2020-01-26T15:28:42.554 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:28:42.554 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-26T15:28:42.594 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.157) 0:01:05.349 ******** 2020-01-26T15:28:42.630 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-26T15:28:42.632 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:28:42.677 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.082) 0:01:05.431 ******** 2020-01-26T15:28:42.702 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-26T15:28:42.703 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.742 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.065) 0:01:05.497 ******** 2020-01-26T15:28:42.757 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-26T15:28:42.758 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-26T15:28:42.803 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.060) 0:01:05.558 ******** 2020-01-26T15:28:42.810 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-01-26T15:28:42.811 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:42.854 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.046) 0:01:05.605 ******** 2020-01-26T15:28:42.886 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-26T15:28:42.887 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.898 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.909 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.925 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:42.978 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:42 +0000 (0:00:00.127) 0:01:05.733 ******** 2020-01-26T15:28:42.984 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-26T15:28:42.985 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:28:43.029 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.050) 0:01:05.783 ******** 2020-01-26T15:28:43.035 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-26T15:28:43.037 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:43.087 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.056) 0:01:05.840 ******** 2020-01-26T15:28:43.091 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-26T15:28:43.093 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:43.094 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:28:43.144 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.059) 0:01:05.899 ******** 2020-01-26T15:28:43.183 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.037) 0:01:05.937 ******** 2020-01-26T15:28:43.188 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-01-26T15:28:43.190 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:43.242 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.059) 0:01:05.997 ******** 2020-01-26T15:28:43.281 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:43.318 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.074) 0:01:06.072 ******** 2020-01-26T15:28:43.515 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-01-26T15:28:43.516 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-26T15:28:43.555 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.237) 0:01:06.310 ******** 2020-01-26T15:28:43.637 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-01-26T15:28:43.638 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-26T15:28:43.684 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:43 +0000 (0:00:00.128) 0:01:06.439 ******** 2020-01-26T15:28:43.962 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-01-26T15:28:43.963 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:28:44.030 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.346) 0:01:06.785 ******** 2020-01-26T15:28:44.079 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-26T15:28:44.080 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-26T15:28:44.122 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.091) 0:01:06.876 ******** 2020-01-26T15:28:44.258 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-26T15:28:44.259 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:28:44.312 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.189) 0:01:07.066 ******** 2020-01-26T15:28:44.328 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-01-26T15:28:44.331 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:01 UTC", "ActiveEnterTimestampMonotonic": "21065107", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target time-sync.target sysinit.target network.target nss-lookup.target systemd-tmpfiles-setup.service var-run.mount system.slice systemd-journald.socket remote-fs.target local-fs.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:27:01 UTC", "AssertTimestampMonotonic": "21063133", "Before": "getty@tty1.service plymouth-quit.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:27:01 UTC", "ConditionTimestampMonotonic": "21063132", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-01-26T15:28:44.333 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1263", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:01 UTC", "ExecMainStartTimestampMonotonic": "21065003", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sun 2020-01-26 15:27:01 UTC] ; stop_time=[n/a] ; pid=1263 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:27:01 UTC", "InactiveExitTimestampMonotonic": "21065107", "InvocationID": "a911c9fd40734ad685522e3f24c048a3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-01-26T15:28:44.334 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1263", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-01-26T15:28:44.336 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:01 UTC", "StateChangeTimestampMonotonic": "21065107", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:01 UTC", "WatchdogTimestampMonotonic": "21065104", "WatchdogUSec": "0"}} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.395 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.083) 0:01:07.149 ******** 2020-01-26T15:28:44.428 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.033) 0:01:07.183 ******** 2020-01-26T15:28:44.434 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-01-26T15:28:44.435 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-26T15:28:44.437 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.488 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.058) 0:01:07.242 ******** 2020-01-26T15:28:44.525 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.038) 0:01:07.280 ******** 2020-01-26T15:28:44.531 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-01-26T15:28:44.533 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.575 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.048) 0:01:07.329 ******** 2020-01-26T15:28:44.618 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.040) 0:01:07.369 ******** 2020-01-26T15:28:44.622 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.665 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.048) 0:01:07.417 ******** 2020-01-26T15:28:44.668 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-01-26T15:28:44.670 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.709 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.046) 0:01:07.464 ******** 2020-01-26T15:28:44.714 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-01-26T15:28:44.716 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.760 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.050) 0:01:07.515 ******** 2020-01-26T15:28:44.789 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-01-26T15:28:44.791 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.836 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.076) 0:01:07.591 ******** 2020-01-26T15:28:44.841 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-26T15:28:44.842 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-26T15:28:44.888 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.048) 0:01:07.640 ******** 2020-01-26T15:28:44.891 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-26T15:28:44.892 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:44.933 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:44 +0000 (0:00:00.047) 0:01:07.688 ******** 2020-01-26T15:28:44.979 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-26T15:28:44.981 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.019 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.085) 0:01:07.773 ******** 2020-01-26T15:28:45.025 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-26T15:28:45.025 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:28:45.077 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.058) 0:01:07.832 ******** 2020-01-26T15:28:45.082 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-01-26T15:28:45.083 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-26T15:28:45.084 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.124 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.047) 0:01:07.879 ******** 2020-01-26T15:28:45.159 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.034) 0:01:07.913 ******** 2020-01-26T15:28:45.164 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-26T15:28:45.165 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.206 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.046) 0:01:07.960 ******** 2020-01-26T15:28:45.241 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.034) 0:01:07.995 ******** 2020-01-26T15:28:45.254 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.291 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.050) 0:01:08.046 ******** 2020-01-26T15:28:45.297 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-01-26T15:28:45.298 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:28:45.339 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.047) 0:01:08.093 ******** 2020-01-26T15:28:45.344 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-01-26T15:28:45.345 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:28:45.389 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.049) 0:01:08.143 ******** 2020-01-26T15:28:45.395 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-01-26T15:28:45.397 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:24 UTC", "ActiveEnterTimestampMonotonic": "17880783", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target nss-lookup.target sysinit.target system.slice remote-fs.target local-fs.target basic.target -.mount var-run.mount network.target systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:27:24 UTC", "AssertTimestampMonotonic": "17880079", "Before": "plymouth-quit.service xdm.service shutdown.target getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:27:24 UTC", "ConditionTimestampMonotonic": "17880079", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-01-26T15:28:45.399 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1119", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:24 UTC", "ExecMainStartTimestampMonotonic": "17880751", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sun 2020-01-26 15:27:24 UTC] ; stop_time=[n/a] ; pid=1119 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:27:24 UTC", "InactiveExitTimestampMonotonic": "17880783", "InvocationID": "12ff75f432604dc3a1c46467e34b8366", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-01-26T15:28:45.400 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1119", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-01-26T15:28:45.402 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:24 UTC", "StateChangeTimestampMonotonic": "17880783", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:24 UTC", "WatchdogTimestampMonotonic": "17880782", "WatchdogUSec": "0"}} TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.444 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.053) 0:01:08.196 ******** 2020-01-26T15:28:45.479 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.037) 0:01:08.234 ******** 2020-01-26T15:28:45.485 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-26T15:28:45.486 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-26T15:28:45.488 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-01-26T15:28:45.490 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.534 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.049) 0:01:08.283 ******** 2020-01-26T15:28:45.569 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.040) 0:01:08.324 ******** 2020-01-26T15:28:45.575 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-01-26T15:28:45.576 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-26T15:28:45.627 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.057) 0:01:08.381 ******** 2020-01-26T15:28:45.641 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-01-26T15:28:45.643 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.687 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.059) 0:01:08.441 ******** 2020-01-26T15:28:45.692 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-01-26T15:28:45.692 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-26T15:28:45.752 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.065) 0:01:08.507 ******** 2020-01-26T15:28:45.761 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-01-26T15:28:45.762 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.819 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.066) 0:01:08.574 ******** 2020-01-26T15:28:45.825 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-01-26T15:28:45.826 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-26T15:28:45.871 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.051) 0:01:08.626 ******** 2020-01-26T15:28:45.881 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:45.921 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.049) 0:01:08.676 ******** 2020-01-26T15:28:45.927 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-01-26T15:28:45.927 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:28:45.970 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:45 +0000 (0:00:00.049) 0:01:08.725 ******** 2020-01-26T15:28:45.979 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-01-26T15:28:45.980 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.021 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.050) 0:01:08.775 ******** 2020-01-26T15:28:46.047 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-26T15:28:46.049 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.088 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.067) 0:01:08.843 ******** 2020-01-26T15:28:46.105 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-01-26T15:28:46.107 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-26T15:28:46.151 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.062) 0:01:08.906 ******** 2020-01-26T15:28:46.158 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-26T15:28:46.159 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.161 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-01-26T15:28:46.163 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:26:54 UTC", "ActiveEnterTimestampMonotonic": "17993598", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target network.target system.slice var-run.mount -.mount time-sync.target basic.target remote-fs.target systemd-tmpfiles-setup.service local-fs.target nss-lookup.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:26:54 UTC", "AssertTimestampMonotonic": "17992908", "Before": "plymouth-quit.service getty@tty1.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:26:54 UTC", "ConditionTimestampMonotonic": "17992908", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-01-26T15:28:46.164 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1228", "ExecMainStartTimestamp": "Sun 2020-01-26 15:26:54 UTC", "ExecMainStartTimestampMonotonic": "17993571", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sun 2020-01-26 15:26:54 UTC] ; stop_time=[n/a] ; pid=1228 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:26:54 UTC", "InactiveExitTimestampMonotonic": "17993598", "InvocationID": "e93b642a20f94d3d8b4e63a6636535d3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-01-26T15:28:46.166 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1228", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-01-26T15:28:46.167 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:26:54 UTC", "StateChangeTimestampMonotonic": "17993598", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:26:54 UTC", "WatchdogTimestampMonotonic": "17993597", "WatchdogUSec": "0"}} 2020-01-26T15:28:46.205 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.054) 0:01:08.960 ******** 2020-01-26T15:28:46.245 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.039) 0:01:08.999 ******** 2020-01-26T15:28:46.252 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.254 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-01-26T15:28:46.263 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.295 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.050) 0:01:09.050 ******** 2020-01-26T15:28:46.331 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.036) 0:01:09.086 ******** 2020-01-26T15:28:46.342 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.379 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.047) 0:01:09.134 ******** 2020-01-26T15:28:46.420 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.039) 0:01:09.173 ******** 2020-01-26T15:28:46.424 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-01-26T15:28:46.424 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.482 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.063) 0:01:09.236 ******** 2020-01-26T15:28:46.487 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-01-26T15:28:46.489 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.540 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.047) 0:01:09.284 ******** TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.578 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.048) 0:01:09.333 ******** 2020-01-26T15:28:46.584 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-01-26T15:28:46.586 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.626 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.048) 0:01:09.381 ******** 2020-01-26T15:28:46.662 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.035) 0:01:09.417 ******** 2020-01-26T15:28:46.667 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-01-26T15:28:46.668 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:28:46.711 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.048) 0:01:09.466 ******** 2020-01-26T15:28:46.717 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-01-26T15:28:46.719 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.759 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.048) 0:01:09.514 ******** 2020-01-26T15:28:46.765 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-26T15:28:46.766 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-26T15:28:46.810 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.050) 0:01:09.564 ******** 2020-01-26T15:28:46.815 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-01-26T15:28:46.817 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.859 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.049) 0:01:09.614 ******** 2020-01-26T15:28:46.865 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-01-26T15:28:46.866 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-26T15:28:46.915 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.053) 0:01:09.667 ******** 2020-01-26T15:28:46.918 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-26T15:28:46.919 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:46.982 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:46 +0000 (0:00:00.068) 0:01:09.736 ******** 2020-01-26T15:28:46.987 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-01-26T15:28:46.987 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-26T15:28:47.029 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.047) 0:01:09.783 ******** 2020-01-26T15:28:47.033 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-26T15:28:47.035 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:47.076 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.047) 0:01:09.830 ******** 2020-01-26T15:28:47.081 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-26T15:28:47.082 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-26T15:28:47.124 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.048) 0:01:09.879 ******** 2020-01-26T15:28:47.130 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-01-26T15:28:47.130 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:47.175 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.051) 0:01:09.930 ******** 2020-01-26T15:28:47.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-01-26T15:28:47.181 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi008"}, "changed": false} 2020-01-26T15:28:47.182 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:28:47.224 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.048) 0:01:09.979 ******** 2020-01-26T15:28:47.261 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.036) 0:01:10.016 ******** 2020-01-26T15:28:47.267 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-01-26T15:28:47.269 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:47.310 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.048) 0:01:10.064 ******** 2020-01-26T15:28:47.336 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-01-26T15:28:47.338 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:47.390 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.079) 0:01:10.144 ******** 2020-01-26T15:28:47.395 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-01-26T15:28:47.395 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-26T15:28:47.441 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.048) 0:01:10.192 ******** 2020-01-26T15:28:47.444 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-01-26T15:28:47.445 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:28:47.499 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.060) 0:01:10.254 ******** 2020-01-26T15:28:47.504 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-01-26T15:28:47.505 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:47.551 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.052) 0:01:10.306 ******** 2020-01-26T15:28:47.558 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-26T15:28:47.560 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-26T15:28:47.601 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.049) 0:01:10.355 ******** 2020-01-26T15:28:47.607 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-01-26T15:28:47.609 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:47.654 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.052) 0:01:10.408 ******** 2020-01-26T15:28:47.659 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-01-26T15:28:47.660 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-26T15:28:47.707 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.053) 0:01:10.462 ******** 2020-01-26T15:28:47.744 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-01-26T15:28:47.746 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-26T15:28:47.790 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.082) 0:01:10.544 ******** 2020-01-26T15:28:47.805 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-01-26T15:28:47.806 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-26T15:28:47.857 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.067) 0:01:10.612 ******** 2020-01-26T15:28:47.930 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-01-26T15:28:47.932 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:28:47.970 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:47 +0000 (0:00:00.113) 0:01:10.725 ******** 2020-01-26T15:28:48.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-01-26T15:28:48.125 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-26T15:28:48.127 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi008.front.sepia.ceph.com", "ansible_hostname": "smithi008", "ansible_nodename": "smithi008"}, "changed": true, "name": "smithi008"} 2020-01-26T15:28:48.182 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.211) 0:01:10.937 ******** 2020-01-26T15:28:48.223 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.040) 0:01:10.977 ******** 2020-01-26T15:28:48.248 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-01-26T15:28:48.250 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:48.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.085) 0:01:11.063 ******** 2020-01-26T15:28:48.313 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-26T15:28:48.315 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-26T15:28:48.396 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.086) 0:01:11.149 ******** 2020-01-26T15:28:48.399 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-01-26T15:28:48.400 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:48.447 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.052) 0:01:11.202 ******** 2020-01-26T15:28:48.453 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-01-26T15:28:48.454 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi163"}, "changed": false} 2020-01-26T15:28:48.499 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.052) 0:01:11.254 ******** 2020-01-26T15:28:48.527 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-26T15:28:48.529 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-26T15:28:48.571 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.071) 0:01:11.326 ******** 2020-01-26T15:28:48.599 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-01-26T15:28:48.600 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-26T15:28:48.644 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.072) 0:01:11.398 ******** 2020-01-26T15:28:48.921 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-01-26T15:28:48.922 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-26T15:28:48.972 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:48 +0000 (0:00:00.328) 0:01:11.727 ******** 2020-01-26T15:28:48.978 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-01-26T15:28:48.979 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi163.front.sepia.ceph.com", "ansible_hostname": "smithi163", "ansible_nodename": "smithi163"}, "changed": true, "name": "smithi163"} 2020-01-26T15:28:49.025 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.053) 0:01:11.780 ******** 2020-01-26T15:28:49.053 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-26T15:28:49.054 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-26T15:28:49.101 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.076) 0:01:11.856 ******** 2020-01-26T15:28:49.137 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-01-26T15:28:49.138 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi170"}, "changed": false} 2020-01-26T15:28:49.182 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.080) 0:01:11.936 ******** 2020-01-26T15:28:49.347 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-26T15:28:49.349 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-26T15:28:49.389 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.207) 0:01:12.144 ******** 2020-01-26T15:28:49.512 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-01-26T15:28:49.513 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-26T15:28:49.554 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.164) 0:01:12.309 ******** 2020-01-26T15:28:49.586 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-01-26T15:28:49.588 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:49.627 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.073) 0:01:12.382 ******** 2020-01-26T15:28:49.644 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-01-26T15:28:49.645 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi170.front.sepia.ceph.com", "ansible_hostname": "smithi170", "ansible_nodename": "smithi170"}, "changed": true, "name": "smithi170"} 2020-01-26T15:28:49.687 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.059) 0:01:12.441 ******** 2020-01-26T15:28:49.692 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:28:49.692 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:49.757 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.070) 0:01:12.512 ******** 2020-01-26T15:28:49.764 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-01-26T15:28:49.765 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-26T15:28:49.810 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.052) 0:01:12.564 ******** 2020-01-26T15:28:49.816 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:28:49.816 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:49.861 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.050) 0:01:12.615 ******** 2020-01-26T15:28:49.908 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:28:49.910 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:49.951 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:49 +0000 (0:00:00.089) 0:01:12.704 ******** 2020-01-26T15:28:49.976 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:28:49.978 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.025 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.075) 0:01:12.780 ******** 2020-01-26T15:28:50.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-26T15:28:50.031 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-26T15:28:50.080 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:12.827 ******** TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.121 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.049) 0:01:12.876 ******** 2020-01-26T15:28:50.149 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.214 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.086) 0:01:12.962 ******** 2020-01-26T15:28:50.235 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-01-26T15:28:50.275 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.067) 0:01:13.030 ******** 2020-01-26T15:28:50.301 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-01-26T15:28:50.349 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.073) 0:01:13.103 ******** 2020-01-26T15:28:50.355 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-01-26T15:28:50.355 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-26T15:28:50.399 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.050) 0:01:13.154 ******** 2020-01-26T15:28:50.404 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-01-26T15:28:50.405 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-01-26T15:28:50.406 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-26T15:28:50.445 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:13.200 ******** 2020-01-26T15:28:50.483 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.036) 0:01:13.237 ******** 2020-01-26T15:28:50.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-01-26T15:28:50.489 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.529 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:13.284 ******** 2020-01-26T15:28:50.567 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.037) 0:01:13.321 ******** 2020-01-26T15:28:50.573 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-01-26T15:28:50.574 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.575 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.626 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.054) 0:01:13.376 ******** 2020-01-26T15:28:50.627 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:28:50.627 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.674 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.053) 0:01:13.429 ******** 2020-01-26T15:28:50.680 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-01-26T15:28:50.682 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.721 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:13.476 ******** 2020-01-26T15:28:50.726 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.768 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:13.522 ******** 2020-01-26T15:28:50.773 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:28:50.775 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.816 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.048) 0:01:13.571 ******** 2020-01-26T15:28:50.822 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:28:50.823 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.863 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.047) 0:01:13.618 ******** 2020-01-26T15:28:50.869 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-01-26T15:28:50.877 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.910 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:13.665 ******** 2020-01-26T15:28:50.915 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:28:50.917 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:50.957 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.046) 0:01:13.711 ******** 2020-01-26T15:28:50.962 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-01-26T15:28:50.964 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.005 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:50 +0000 (0:00:00.048) 0:01:13.759 ******** 2020-01-26T15:28:51.011 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:28:51.013 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi170.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-26T15:28:51.053 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.048) 0:01:13.808 ******** 2020-01-26T15:28:51.091 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.037) 0:01:13.845 ******** 2020-01-26T15:28:51.096 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-01-26T15:28:51.098 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.138 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:13.892 ******** 2020-01-26T15:28:51.175 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.037) 0:01:13.929 ******** 2020-01-26T15:28:51.179 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-01-26T15:28:51.181 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.222 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.047) 0:01:13.977 ******** 2020-01-26T15:28:51.259 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.036) 0:01:14.014 ******** 2020-01-26T15:28:51.264 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-01-26T15:28:51.265 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:28:51.266 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.306 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:14.060 ******** 2020-01-26T15:28:51.344 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.038) 0:01:14.099 ******** 2020-01-26T15:28:51.350 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:28:51.351 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.390 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:14.145 ******** 2020-01-26T15:28:51.427 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.036) 0:01:14.181 ******** 2020-01-26T15:28:51.431 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-01-26T15:28:51.432 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.474 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:14.228 ******** 2020-01-26T15:28:51.510 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.034) 0:01:14.263 ******** 2020-01-26T15:28:51.514 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:28:51.516 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.555 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:14.310 ******** 2020-01-26T15:28:51.592 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.036) 0:01:14.346 ******** 2020-01-26T15:28:51.596 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-01-26T15:28:51.597 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-01-26T15:28:51.597 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.638 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:14.393 ******** 2020-01-26T15:28:51.675 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.036) 0:01:14.429 ******** 2020-01-26T15:28:51.679 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:28:51.681 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.722 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.046) 0:01:14.476 ******** 2020-01-26T15:28:51.759 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.036) 0:01:14.512 ******** 2020-01-26T15:28:51.764 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-01-26T15:28:51.764 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.766 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.805 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.047) 0:01:14.560 ******** 2020-01-26T15:28:51.843 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.037) 0:01:14.597 ******** 2020-01-26T15:28:51.848 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:28:51.850 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.891 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.048) 0:01:14.645 ******** 2020-01-26T15:28:51.927 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.036) 0:01:14.682 ******** 2020-01-26T15:28:51.932 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-01-26T15:28:51.933 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.934 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.936 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-01-26T15:28:51.936 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:51.976 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:51 +0000 (0:00:00.049) 0:01:14.731 ******** 2020-01-26T15:28:52.016 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.037) 0:01:14.768 ******** 2020-01-26T15:28:52.019 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:28:52.020 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.061 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.046) 0:01:14.815 ******** 2020-01-26T15:28:52.101 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.040) 0:01:14.856 ******** 2020-01-26T15:28:52.106 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-01-26T15:28:52.106 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.150 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.046) 0:01:14.902 ******** 2020-01-26T15:28:52.154 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:28:52.155 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.198 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.050) 0:01:14.952 ******** 2020-01-26T15:28:52.202 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:28:52.203 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.204 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005309", "end": "2020-01-26 15:28:52.180905", "rc": 0, "start": "2020-01-26 15:28:52.175596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:52.247 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.049) 0:01:15.002 ******** 2020-01-26T15:28:52.284 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.037) 0:01:15.039 ******** 2020-01-26T15:28:52.290 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-01-26T15:28:52.291 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-01-26T15:28:52.332 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.047) 0:01:15.086 ******** 2020-01-26T15:28:52.370 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.037) 0:01:15.124 ******** 2020-01-26T15:28:52.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-01-26T15:28:52.377 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.419 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.049) 0:01:15.174 ******** 2020-01-26T15:28:52.425 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-01-26T15:28:52.468 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.049) 0:01:15.223 ******** 2020-01-26T15:28:52.473 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-01-26T15:28:52.475 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.516 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.047) 0:01:15.271 ******** 2020-01-26T15:28:52.529 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-01-26T15:28:52.564 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.047) 0:01:15.318 ******** 2020-01-26T15:28:52.569 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-01-26T15:28:52.571 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.611 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.047) 0:01:15.365 ******** 2020-01-26T15:28:52.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-01-26T15:28:52.618 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.667 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.056) 0:01:15.422 ******** 2020-01-26T15:28:52.672 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-01-26T15:28:52.675 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-26T15:28:52.718 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.050) 0:01:15.473 ******** 2020-01-26T15:28:52.759 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.040) 0:01:15.514 ******** 2020-01-26T15:28:52.766 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-01-26T15:28:52.767 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.770 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.813 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.053) 0:01:15.568 ******** 2020-01-26T15:28:52.854 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.040) 0:01:15.608 ******** 2020-01-26T15:28:52.859 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:28:52.860 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.901 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.048) 0:01:15.656 ******** 2020-01-26T15:28:52.907 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-01-26T15:28:52.909 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.950 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.048) 0:01:15.705 ******** 2020-01-26T15:28:52.956 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:28:52.959 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:52.999 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:52 +0000 (0:00:00.048) 0:01:15.754 ******** 2020-01-26T15:28:53.004 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:28:53.006 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.050 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.050) 0:01:15.804 ******** 2020-01-26T15:28:53.055 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-01-26T15:28:53.055 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.096 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.046) 0:01:15.851 ******** 2020-01-26T15:28:53.101 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-01-26T15:28:53.103 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.144 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.047) 0:01:15.899 ******** 2020-01-26T15:28:53.149 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:28:53.150 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.192 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.048) 0:01:15.947 ******** 2020-01-26T15:28:53.199 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-01-26T15:28:53.199 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.244 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.051) 0:01:15.999 ******** 2020-01-26T15:28:53.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-01-26T15:28:53.252 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.291 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.047) 0:01:16.046 ******** 2020-01-26T15:28:53.297 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-01-26T15:28:53.298 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.338 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.047) 0:01:16.093 ******** 2020-01-26T15:28:53.345 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:28:53.346 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.403 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.064) 0:01:16.158 ******** 2020-01-26T15:28:53.409 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-01-26T15:28:53.411 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.457 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.051) 0:01:16.210 ******** 2020-01-26T15:28:53.462 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:28:53.464 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.511 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.056) 0:01:16.266 ******** 2020-01-26T15:28:53.517 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:28:53.517 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.560 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.049) 0:01:16.315 ******** 2020-01-26T15:28:53.565 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-01-26T15:28:53.567 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.606 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.045) 0:01:16.361 ******** 2020-01-26T15:28:53.611 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:28:53.613 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.657 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.050) 0:01:16.412 ******** 2020-01-26T15:28:53.663 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-01-26T15:28:53.664 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.706 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.048) 0:01:16.461 ******** 2020-01-26T15:28:53.712 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-01-26T15:28:53.713 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.754 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.047) 0:01:16.508 ******** 2020-01-26T15:28:53.759 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-01-26T15:28:53.760 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.800 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.045) 0:01:16.554 ******** 2020-01-26T15:28:53.805 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:28:53.807 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.845 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.045) 0:01:16.600 ******** 2020-01-26T15:28:53.884 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-01-26T15:28:53.886 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:53.925 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.079) 0:01:16.680 ******** 2020-01-26T15:28:53.942 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-01-26T15:28:53.944 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003433", "end": "2020-01-26 15:28:53.917439", "rc": 0, "start": "2020-01-26 15:28:53.914006", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:53.994 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:53 +0000 (0:00:00.057) 0:01:16.738 ******** TASK [testnode : Remove packages] ********************************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:54.030 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.047) 0:01:16.785 ******** 2020-01-26T15:28:54.036 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-01-26T15:28:54.080 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.049) 0:01:16.835 ******** 2020-01-26T15:28:54.094 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:54.127 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.047) 0:01:16.882 ******** 2020-01-26T15:28:54.146 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi008.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-26T15:28:54.157 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:54.194 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.066) 0:01:16.948 ******** 2020-01-26T15:28:54.220 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-01-26T15:28:54.222 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:54.260 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.066) 0:01:17.014 ******** 2020-01-26T15:28:54.297 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-01-26T15:28:54.298 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:54.336 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.076) 0:01:17.091 ******** 2020-01-26T15:28:54.404 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-26T15:28:54.405 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-26T15:28:54.445 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.108) 0:01:17.199 ******** 2020-01-26T15:28:54.473 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-01-26T15:28:54.474 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004911", "end": "2020-01-26 15:28:54.471149", "rc": 0, "start": "2020-01-26 15:28:54.466238", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:54.477 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:54.513 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.068) 0:01:17.268 ******** 2020-01-26T15:28:54.549 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.036) 0:01:17.304 ******** 2020-01-26T15:28:54.576 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-01-26T15:28:54.615 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:54 +0000 (0:00:00.066) 0:01:17.370 ******** 2020-01-26T15:28:54.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-26T15:28:54.967 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-26T15:28:55.010 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:55 +0000 (0:00:00.394) 0:01:17.765 ******** 2020-01-26T15:28:55.037 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-01-26T15:28:55.039 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:28:55.076 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:55 +0000 (0:00:00.066) 0:01:17.831 ******** 2020-01-26T15:28:55.105 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-01-26T15:28:55.107 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-26T15:28:55.149 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:55 +0000 (0:00:00.072) 0:01:17.904 ******** 2020-01-26T15:28:55.509 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-26T15:28:56.043 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-26T15:28:56.068 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:28:56.110 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:56 +0000 (0:00:00.958) 0:01:18.862 ******** 2020-01-26T15:28:56.138 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-26T15:28:56.200 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:56 +0000 (0:00:00.092) 0:01:18.955 ******** 2020-01-26T15:28:56.369 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-01-26T15:28:56.370 INFO:teuthology.task.ansible.out: [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo 2020-01-26T15:28:56.371 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.037779", "end": "2020-01-26 15:28:56.350905", "rc": 0, "start": "2020-01-26 15:28:56.313126", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:56.410 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:56 +0000 (0:00:00.210) 0:01:19.165 ******** 2020-01-26T15:28:56.450 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-01-26T15:28:56.451 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-26T15:28:56.492 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:56 +0000 (0:00:00.081) 0:01:19.246 ******** 2020-01-26T15:28:56.950 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-26T15:28:56.991 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:56 +0000 (0:00:00.499) 0:01:19.746 ******** 2020-01-26T15:28:57.366 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-26T15:28:57.366 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:28:57.407 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:57 +0000 (0:00:00.416) 0:01:20.162 ******** 2020-01-26T15:28:57.437 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-26T15:28:57.479 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:57 +0000 (0:00:00.071) 0:01:20.233 ******** 2020-01-26T15:28:57.644 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-01-26T15:28:57.645 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033017", "end": "2020-01-26 15:28:57.620366", "rc": 0, "start": "2020-01-26 15:28:57.587349", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:57.685 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:57 +0000 (0:00:00.206) 0:01:20.439 ******** 2020-01-26T15:28:57.917 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-26T15:28:57.918 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:28:57.959 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:57 +0000 (0:00:00.274) 0:01:20.714 ******** 2020-01-26T15:28:57.986 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-26T15:28:58.036 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:58 +0000 (0:00:00.076) 0:01:20.790 ******** 2020-01-26T15:28:58.190 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-01-26T15:28:58.190 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030607", "end": "2020-01-26 15:28:58.190588", "rc": 0, "start": "2020-01-26 15:28:58.159981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:28:58.230 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:58 +0000 (0:00:00.194) 0:01:20.985 ******** 2020-01-26T15:28:59.343 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-01-26T15:28:59.344 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:28:59.384 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:28:59 +0000 (0:00:01.154) 0:01:22.139 ******** 2020-01-26T15:29:00.523 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:00.567 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:00 +0000 (0:00:01.182) 0:01:23.322 ******** 2020-01-26T15:29:00.955 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:00.996 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:00 +0000 (0:00:00.428) 0:01:23.750 ******** 2020-01-26T15:29:10.461 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database .. 2020-01-26T15:29:10.465 INFO:teuthology.task.ansible.out:. 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directories currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading d 2020-01-26T15:29:10.467 INFO:teuthology.task.ansible.out:atabase ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:29:10.531 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:10 +0000 (0:00:09.535) 0:01:33.286 ******** 2020-01-26T15:29:10.814 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-26T15:29:10.816 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-26T15:29:10.817 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:29:10.863 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:10 +0000 (0:00:00.332) 0:01:33.618 ******** 2020-01-26T15:29:11.148 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-26T15:29:11.149 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-26T15:29:11.151 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:29:11.189 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:11 +0000 (0:00:00.326) 0:01:33.944 ******** 2020-01-26T15:29:11.436 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:29:11.437 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:29:11.485 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:11 +0000 (0:00:00.295) 0:01:34.240 ******** 2020-01-26T15:29:11.512 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-26T15:29:11.514 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:11.568 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:11 +0000 (0:00:00.082) 0:01:34.322 ******** 2020-01-26T15:29:11.734 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:29:11.735 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:11.783 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:11 +0000 (0:00:00.215) 0:01:34.538 ******** 2020-01-26T15:29:11.812 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:11.871 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:11 +0000 (0:00:00.088) 0:01:34.626 ******** 2020-01-26T15:29:12.038 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:29:12.039 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:12.089 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:12 +0000 (0:00:00.217) 0:01:34.844 ******** 2020-01-26T15:29:12.115 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-26T15:29:12.117 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:12.155 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:12 +0000 (0:00:00.065) 0:01:34.909 ******** 2020-01-26T15:29:21.712 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:29:21.713 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9895 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-26T15:29:21.715 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block- 2020-01-26T15:29:21.716 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9895 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-26T15:29:21.718 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Setting 2020-01-26T15:29:21.720 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:29:21.761 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:21 +0000 (0:00:09.606) 0:01:44.516 ******** 2020-01-26T15:29:21.771 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9636 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-26T15:29:21.772 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block- 2020-01-26T15:29:21.774 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9636 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-26T15:29:21.776 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Setting 2020-01-26T15:29:21.777 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:29:21.814 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:21 +0000 (0:00:00.053) 0:01:44.569 ******** 2020-01-26T15:29:21.857 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9586 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-26T15:29:21.858 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block- 2020-01-26T15:29:21.860 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9586 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-26T15:29:21.862 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Setting 2020-01-26T15:29:21.863 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:29:21.923 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:21 +0000 (0:00:00.108) 0:01:44.678 ******** 2020-01-26T15:29:22.661 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-01-26T15:29:22.662 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:29:22.703 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:22 +0000 (0:00:00.779) 0:01:45.457 ******** 2020-01-26T15:29:22.785 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:22.828 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:22 +0000 (0:00:00.125) 0:01:45.582 ******** 2020-01-26T15:29:22.839 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:22.840 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-26T15:29:22.840 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-26T15:29:22.881 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:22 +0000 (0:00:00.052) 0:01:45.635 ******** 2020-01-26T15:29:22.918 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:22 +0000 (0:00:00.037) 0:01:45.672 ******** 2020-01-26T15:29:22.923 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-01-26T15:29:22.923 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:22.965 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:22 +0000 (0:00:00.047) 0:01:45.720 ******** 2020-01-26T15:29:22.971 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-26T15:29:22.973 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-26T15:29:23.013 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.048) 0:01:45.768 ******** 2020-01-26T15:29:23.040 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-01-26T15:29:23.041 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:23.082 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.069) 0:01:45.837 ******** 2020-01-26T15:29:23.087 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-26T15:29:23.088 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-26T15:29:23.129 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.046) 0:01:45.883 ******** 2020-01-26T15:29:23.134 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-01-26T15:29:23.135 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-26T15:29:23.180 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.051) 0:01:45.935 ******** 2020-01-26T15:29:23.182 INFO:teuthology.task.ansible.out: 2020-01-26T15:29:23.186 INFO:teuthology.task.ansible.out: 2020-01-26T15:29:23.188 INFO:teuthology.task.ansible.out:TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:23.232 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.051) 0:01:45.987 ******** 2020-01-26T15:29:23.237 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-01-26T15:29:23.238 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-26T15:29:23.284 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.045) 0:01:46.033 ******** 2020-01-26T15:29:23.367 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-26T15:29:23.409 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.130) 0:01:46.163 ******** 2020-01-26T15:29:23.519 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-01-26T15:29:23.520 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-26T15:29:23.563 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.154) 0:01:46.318 ******** 2020-01-26T15:29:23.598 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-26T15:29:23.639 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.075) 0:01:46.394 ******** 2020-01-26T15:29:23.726 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-26T15:29:23.781 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.141) 0:01:46.535 ******** 2020-01-26T15:29:23.790 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi008.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-26T15:29:23.832 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.051) 0:01:46.587 ******** 2020-01-26T15:29:23.839 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-26T15:29:23.881 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.048) 0:01:46.635 ******** 2020-01-26T15:29:23.940 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-26T15:29:23.996 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:23 +0000 (0:00:00.114) 0:01:46.750 ******** 2020-01-26T15:29:24.007 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-01-26T15:29:24.009 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:24.010 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:24.055 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.058) 0:01:46.809 ******** 2020-01-26T15:29:24.090 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.034) 0:01:46.844 ******** 2020-01-26T15:29:24.137 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:24.177 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.087) 0:01:46.932 ******** 2020-01-26T15:29:24.372 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-26T15:29:24.374 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:02 UTC", "ActiveEnterTimestampMonotonic": "21698011", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sysinit.target systemd-journald.socket basic.target network.target remote-fs.target systemd-tmpfiles-setup.service system.slice nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:27:01 UTC", "AssertTimestampMonotonic": "21061360", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:27:01 UTC", "ConditionTimestampMonotonic": "21061360", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-26T15:29:24.376 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1397", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:02 UTC", "ExecMainStartTimestampMonotonic": "21697963", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:27:01 UTC", "InactiveExitTimestampMonotonic": "21063053", "InvocationID": "14fcda8ccaf6446481b733bbe226efd0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-26T15:29:24.377 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1397", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-26T15:29:24.379 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:02 UTC", "StateChangeTimestampMonotonic": "21698011", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:02 UTC", "WatchdogTimestampMonotonic": "21698009", "WatchdogUSec": "0"}} 2020-01-26T15:29:24.419 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.241) 0:01:47.174 ******** 2020-01-26T15:29:24.429 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:25 UTC", "ActiveEnterTimestampMonotonic": "18623965", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target systemd-journald.socket remote-fs.target -.mount network.target sysinit.target nss-lookup.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:27:24 UTC", "AssertTimestampMonotonic": "17882098", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:27:24 UTC", "ConditionTimestampMonotonic": "17882098", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-26T15:29:24.430 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1239", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:25 UTC", "ExecMainStartTimestampMonotonic": "18623954", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:27:24 UTC", "InactiveExitTimestampMonotonic": "17882980", "InvocationID": "f3e1d36b2e5940158e9790223925ac34", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-26T15:29:24.432 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1239", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-26T15:29:24.434 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:25 UTC", "StateChangeTimestampMonotonic": "18623965", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:25 UTC", "WatchdogTimestampMonotonic": "18623964", "WatchdogUSec": "0"}} 2020-01-26T15:29:24.475 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.056) 0:01:47.230 ******** 2020-01-26T15:29:24.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:29:24.482 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.536 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.060) 0:01:47.290 ******** 2020-01-26T15:29:24.544 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-26T15:29:24.548 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:26:55 UTC", "ActiveEnterTimestampMonotonic": "18548700", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target network.target sysinit.target system.slice remote-fs.target systemd-tmpfiles-setup.service basic.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:26:54 UTC", "AssertTimestampMonotonic": "17995062", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:26:54 UTC", "ConditionTimestampMonotonic": "17995062", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-26T15:29:24.550 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1314", "ExecMainStartTimestamp": "Sun 2020-01-26 15:26:55 UTC", "ExecMainStartTimestampMonotonic": "18548690", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:26:54 UTC", "InactiveExitTimestampMonotonic": "17996147", "InvocationID": "28d4f80c02414321b1d442e75e6f0b61", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-26T15:29:24.551 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1314", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-26T15:29:24.553 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:26:55 UTC", "StateChangeTimestampMonotonic": "18548700", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:26:55 UTC", "WatchdogTimestampMonotonic": "18548699", "WatchdogUSec": "0"}} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.602 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.066) 0:01:47.356 ******** 2020-01-26T15:29:24.638 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.036) 0:01:47.393 ******** 2020-01-26T15:29:24.644 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:29:24.644 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.646 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.686 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.047) 0:01:47.440 ******** 2020-01-26T15:29:24.725 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.039) 0:01:47.479 ******** 2020-01-26T15:29:24.731 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:29:24.732 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.775 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.049) 0:01:47.529 ******** 2020-01-26T15:29:24.815 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.040) 0:01:47.569 ******** 2020-01-26T15:29:24.819 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.820 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.861 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.046) 0:01:47.616 ******** 2020-01-26T15:29:24.910 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.035) 0:01:47.652 ******** TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:24.946 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.048) 0:01:47.700 ******** 2020-01-26T15:29:24.985 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:24 +0000 (0:00:00.039) 0:01:47.740 ******** 2020-01-26T15:29:24.992 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:29:24.994 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.037 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.051) 0:01:47.792 ******** 2020-01-26T15:29:25.072 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.034) 0:01:47.827 ******** 2020-01-26T15:29:25.078 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:29:25.079 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.120 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.047) 0:01:47.874 ******** 2020-01-26T15:29:25.157 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.037) 0:01:47.912 ******** 2020-01-26T15:29:25.162 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:29:25.162 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.164 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.205 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.048) 0:01:47.960 ******** 2020-01-26T15:29:25.242 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.036) 0:01:47.997 ******** 2020-01-26T15:29:25.247 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:29:25.249 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.287 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.045) 0:01:48.042 ******** 2020-01-26T15:29:25.334 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.046) 0:01:48.089 ******** 2020-01-26T15:29:25.339 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:29:25.340 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.341 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.400 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.066) 0:01:48.155 ******** 2020-01-26T15:29:25.436 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.035) 0:01:48.190 ******** 2020-01-26T15:29:25.442 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:29:25.444 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.484 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.048) 0:01:48.239 ******** 2020-01-26T15:29:25.530 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.045) 0:01:48.284 ******** 2020-01-26T15:29:25.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:29:25.535 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.537 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.577 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.046) 0:01:48.331 ******** 2020-01-26T15:29:25.613 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.036) 0:01:48.368 ******** 2020-01-26T15:29:25.618 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:29:25.620 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.756 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.143) 0:01:48.511 ******** 2020-01-26T15:29:25.792 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.035) 0:01:48.546 ******** 2020-01-26T15:29:25.796 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:29:25.809 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.838 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.045) 0:01:48.592 ******** 2020-01-26T15:29:25.875 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.038) 0:01:48.630 ******** 2020-01-26T15:29:25.880 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.882 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:25.921 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.045) 0:01:48.676 ******** 2020-01-26T15:29:25.963 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:25 +0000 (0:00:00.041) 0:01:48.718 ******** 2020-01-26T15:29:25.968 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:29:25.970 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.013 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.049) 0:01:48.768 ******** 2020-01-26T15:29:26.051 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.037) 0:01:48.805 ******** 2020-01-26T15:29:26.056 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:29:26.057 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.058 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.098 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.047) 0:01:48.853 ******** 2020-01-26T15:29:26.138 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.039) 0:01:48.893 ******** 2020-01-26T15:29:26.144 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:29:26.145 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.185 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.047) 0:01:48.940 ******** 2020-01-26T15:29:26.221 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.035) 0:01:48.976 ******** 2020-01-26T15:29:26.225 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:29:26.226 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.227 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.268 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.046) 0:01:49.022 ******** 2020-01-26T15:29:26.304 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.035) 0:01:49.058 ******** 2020-01-26T15:29:26.309 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:29:26.311 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.351 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.047) 0:01:49.106 ******** 2020-01-26T15:29:26.389 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.037) 0:01:49.144 ******** 2020-01-26T15:29:26.395 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:29:26.396 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.438 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.049) 0:01:49.193 ******** 2020-01-26T15:29:26.477 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.038) 0:01:49.231 ******** 2020-01-26T15:29:26.481 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-26T15:29:26.483 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.524 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.047) 0:01:49.279 ******** 2020-01-26T15:29:26.561 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.036) 0:01:49.316 ******** 2020-01-26T15:29:26.566 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:29:26.567 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.567 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:29:26.567 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.608 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.046) 0:01:49.363 ******** 2020-01-26T15:29:26.648 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.037) 0:01:49.400 ******** 2020-01-26T15:29:26.653 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.694 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.047) 0:01:49.448 ******** 2020-01-26T15:29:26.730 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.036) 0:01:49.485 ******** 2020-01-26T15:29:26.735 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-26T15:29:26.735 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.737 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.777 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.046) 0:01:49.532 ******** 2020-01-26T15:29:26.813 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.035) 0:01:49.568 ******** 2020-01-26T15:29:26.819 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:29:26.819 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.864 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.050) 0:01:49.618 ******** 2020-01-26T15:29:26.869 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:29:26.871 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.914 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.049) 0:01:49.668 ******** 2020-01-26T15:29:26.919 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:29:26.920 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:26.921 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-26T15:29:26.962 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.048) 0:01:49.717 ******** 2020-01-26T15:29:26.998 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:26 +0000 (0:00:00.035) 0:01:49.752 ******** 2020-01-26T15:29:27.006 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.053 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.055) 0:01:49.808 ******** 2020-01-26T15:29:27.058 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:29:27.059 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.104 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.050) 0:01:49.859 ******** 2020-01-26T15:29:27.109 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:29:27.111 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.151 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.046) 0:01:49.905 ******** 2020-01-26T15:29:27.156 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:29:27.158 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.199 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.048) 0:01:49.954 ******** 2020-01-26T15:29:27.204 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:29:27.206 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.255 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.056) 0:01:50.010 ******** 2020-01-26T15:29:27.260 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-26T15:29:27.261 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.310 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.054) 0:01:50.065 ******** 2020-01-26T15:29:27.318 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:29:27.320 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:29:27.321 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-26T15:29:27.371 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.061) 0:01:50.126 ******** 2020-01-26T15:29:27.409 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.037) 0:01:50.164 ******** 2020-01-26T15:29:27.414 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:29:27.415 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.415 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:29:27.415 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.459 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.049) 0:01:50.213 ******** 2020-01-26T15:29:27.501 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.042) 0:01:50.256 ******** 2020-01-26T15:29:27.507 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-26T15:29:27.508 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.560 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.058) 0:01:50.314 ******** 2020-01-26T15:29:27.565 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:29:27.567 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.620 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.060) 0:01:50.375 ******** 2020-01-26T15:29:27.626 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:29:27.627 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.669 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.048) 0:01:50.424 ******** 2020-01-26T15:29:27.674 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:29:27.675 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.721 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.051) 0:01:50.475 ******** 2020-01-26T15:29:27.729 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:29:27.729 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.794 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.072) 0:01:50.548 ******** 2020-01-26T15:29:27.799 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:29:27.801 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-26T15:29:27.841 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.047) 0:01:50.596 ******** 2020-01-26T15:29:27.886 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.044) 0:01:50.641 ******** 2020-01-26T15:29:27.891 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:29:27.893 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.940 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.054) 0:01:50.695 ******** 2020-01-26T15:29:27.947 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:29:27.948 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:27.989 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:27 +0000 (0:00:00.048) 0:01:50.744 ******** 2020-01-26T15:29:27.996 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:29:27.998 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.042 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.053) 0:01:50.797 ******** 2020-01-26T15:29:28.048 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:29:28.049 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.089 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.046) 0:01:50.844 ******** 2020-01-26T15:29:28.096 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:29:28.097 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.155 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.066) 0:01:50.910 ******** 2020-01-26T15:29:28.162 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.202 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.046) 0:01:50.957 ******** 2020-01-26T15:29:28.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:29:28.209 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-01-26T15:29:28.209 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-26T15:29:28.250 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.047) 0:01:51.005 ******** 2020-01-26T15:29:28.286 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.035) 0:01:51.041 ******** 2020-01-26T15:29:28.312 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-01-26T15:29:28.314 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.352 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.065) 0:01:51.106 ******** 2020-01-26T15:29:28.472 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-01-26T15:29:28.473 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-26T15:29:28.513 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.161) 0:01:51.268 ******** 2020-01-26T15:29:28.519 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-26T15:29:28.560 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.046) 0:01:51.314 ******** 2020-01-26T15:29:28.574 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-01-26T15:29:28.575 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-26T15:29:28.616 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.056) 0:01:51.371 ******** 2020-01-26T15:29:28.758 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-26T15:29:28.760 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:28.799 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.182) 0:01:51.553 ******** 2020-01-26T15:29:28.825 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-01-26T15:29:28.827 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.866 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.067) 0:01:51.621 ******** 2020-01-26T15:29:28.872 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:29:28.872 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-26T15:29:28.922 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.056) 0:01:51.677 ******** 2020-01-26T15:29:28.929 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-26T15:29:28.930 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:28.971 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:28 +0000 (0:00:00.048) 0:01:51.726 ******** 2020-01-26T15:29:29.008 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.036) 0:01:51.762 ******** 2020-01-26T15:29:29.013 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.014 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.055 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.047) 0:01:51.809 ******** 2020-01-26T15:29:29.091 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.036) 0:01:51.845 ******** 2020-01-26T15:29:29.096 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:29:29.098 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.138 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.046) 0:01:51.892 ******** 2020-01-26T15:29:29.175 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.037) 0:01:51.930 ******** 2020-01-26T15:29:29.182 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.222 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.047) 0:01:51.977 ******** 2020-01-26T15:29:29.259 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:29.260 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-26T15:29:29.299 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.076) 0:01:52.053 ******** 2020-01-26T15:29:29.356 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:29:29.357 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.368 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.379 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.390 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.401 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.412 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.413 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.424 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-01-26T15:29:29.425 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-26T15:29:29.473 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.173) 0:01:52.227 ******** 2020-01-26T15:29:29.483 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:29:29.484 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-01-26T15:29:29.489 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.491 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.493 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.543 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.070) 0:01:52.298 ******** 2020-01-26T15:29:29.554 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-26T15:29:29.598 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.054) 0:01:52.352 ******** 2020-01-26T15:29:29.680 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-01-26T15:29:29.701 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003314", "end": "2020-01-26 15:29:29.665309", "rc": 0, "start": "2020-01-26 15:29:29.661995", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-26T15:29:29.757 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.159) 0:01:52.512 ******** 2020-01-26T15:29:29.795 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-26T15:29:29.797 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.838 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.080) 0:01:52.592 ******** 2020-01-26T15:29:29.843 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-01-26T15:29:29.844 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-26T15:29:29.885 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.046) 0:01:52.639 ******** 2020-01-26T15:29:29.889 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-01-26T15:29:29.891 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:29.934 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.049) 0:01:52.689 ******** 2020-01-26T15:29:29.951 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-01-26T15:29:29.953 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-26T15:29:30.001 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:29 +0000 (0:00:00.066) 0:01:52.755 ******** 2020-01-26T15:29:30.006 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-01-26T15:29:30.007 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.054 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.053) 0:01:52.808 ******** 2020-01-26T15:29:30.209 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-26T15:29:30.252 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.198) 0:01:53.007 ******** 2020-01-26T15:29:30.345 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-26T15:29:30.392 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.139) 0:01:53.146 ******** 2020-01-26T15:29:30.397 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-26T15:29:30.398 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:30.440 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.047) 0:01:53.194 ******** 2020-01-26T15:29:30.466 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-01-26T15:29:30.474 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.509 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.067) 0:01:53.262 ******** 2020-01-26T15:29:30.525 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-26T15:29:30.527 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:30.567 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.060) 0:01:53.322 ******** 2020-01-26T15:29:30.573 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-01-26T15:29:30.574 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.618 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.046) 0:01:53.368 ******** 2020-01-26T15:29:30.625 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.671 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.058) 0:01:53.426 ******** 2020-01-26T15:29:30.677 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-26T15:29:30.678 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.722 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.047) 0:01:53.474 ******** 2020-01-26T15:29:30.724 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.772 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.051) 0:01:53.526 ******** 2020-01-26T15:29:30.778 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-01-26T15:29:30.778 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.822 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.048) 0:01:53.574 ******** 2020-01-26T15:29:30.825 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-26T15:29:30.826 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.868 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.048) 0:01:53.622 ******** 2020-01-26T15:29:30.872 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-01-26T15:29:30.873 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.922 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.044) 0:01:53.667 ******** TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:30.969 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:30 +0000 (0:00:00.056) 0:01:53.724 ******** 2020-01-26T15:29:30.975 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:30.976 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-26T15:29:30.977 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:29:31.018 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.049) 0:01:53.773 ******** 2020-01-26T15:29:31.056 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.037) 0:01:53.810 ******** 2020-01-26T15:29:31.062 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-01-26T15:29:31.063 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.064 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.106 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.050) 0:01:53.861 ******** 2020-01-26T15:29:31.162 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.056) 0:01:53.917 ******** 2020-01-26T15:29:31.168 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:29:31.169 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.170 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi008.front.sepia.ceph.com] => (item={u'block_used': 13723595, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371513, u'size_available': 927217717248, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905893, u'device': u'/dev/sda1', u'inode_used': 149083, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371513, "block_size": 4096, "block_total": 240095108, "block_used": 13723595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905893, "inode_total": 61054976, "inode_used": 149083, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217717248, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-26T15:29:31.185 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi163.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.187 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.233 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.070) 0:01:53.988 ******** 2020-01-26T15:29:31.240 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.242 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:31.242 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-26T15:29:31.244 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi163.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.244 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-01-26T15:29:31.245 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.245 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.302 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.068) 0:01:54.056 ******** 2020-01-26T15:29:31.307 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.310 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.366 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.064) 0:01:54.120 ******** 2020-01-26T15:29:31.373 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.374 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.376 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-26T15:29:31.377 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010295", "end": "2020-01-26 15:29:31.356648", "rc": 0, "start": "2020-01-26 15:29:31.346353", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:31.378 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi170.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.421 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.054) 0:01:54.175 ******** 2020-01-26T15:29:31.428 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.430 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.431 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.433 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.434 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.445 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-01-26T15:29:31.457 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.458 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-01-26T15:29:31.460 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'block_used': 13723595, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371513, u'size_available': 927217717248, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905893, u'device': u'/dev/sda1', u'inode_used': 149083, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371513, "block_size": 4096, "block_total": 240095108, "block_used": 13723595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905893, "inode_total": 61054976, "inode_used": 149083, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217717248, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.461 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:29:31.463 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.515 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.094) 0:01:54.270 ******** 2020-01-26T15:29:31.521 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.522 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.523 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.527 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-01-26T15:29:31.528 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003537", "end": "2020-01-26 15:29:31.481003", "rc": 0, "start": "2020-01-26 15:29:31.477466", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-26T15:29:31.588 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.073) 0:01:54.343 ******** 2020-01-26T15:29:31.633 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.044) 0:01:54.388 ******** 2020-01-26T15:29:31.638 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-26T15:29:31.639 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-26T15:29:31.641 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.687 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.053) 0:01:54.441 ******** 2020-01-26T15:29:31.745 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.058) 0:01:54.500 ******** 2020-01-26T15:29:31.754 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:31.755 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3ZL', u'wwn-0x5000c500871b3d00'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4H3ZL', u'wwn': u'0x5000c500871b3d00', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3ZL-part1', u'wwn-0x5000c500871b3d00-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3ZL", "wwn-0x5000c500871b3d00"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3ZL-part1", "wwn-0x5000c500871b3d00-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H3ZL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:29:31.757 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c500871b3d00"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.769 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.773 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-01-26T15:29:31.773 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003206", "end": "2020-01-26 15:29:31.747980", "rc": 0, "start": "2020-01-26 15:29:31.744774", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-26T15:29:31.775 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:31.777 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.778 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.780 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:31.781 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.828 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.082) 0:01:54.583 ******** 2020-01-26T15:29:31.888 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.059) 0:01:54.642 ******** 2020-01-26T15:29:31.894 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.897 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.899 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.900 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.902 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.904 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:31.944 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.056) 0:01:54.699 ******** 2020-01-26T15:29:31.951 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-26T15:29:31.952 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:32.004 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:31 +0000 (0:00:00.059) 0:01:54.758 ******** 2020-01-26T15:29:32.040 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-01-26T15:29:32.042 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:32.083 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:32 +0000 (0:00:00.079) 0:01:54.838 ******** 2020-01-26T15:29:32.119 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-01-26T15:29:32.126 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:32.160 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:32 +0000 (0:00:00.077) 0:01:54.915 ******** 2020-01-26T15:29:32.781 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-01-26T15:29:32.782 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:32.824 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:32 +0000 (0:00:00.663) 0:01:55.578 ******** 2020-01-26T15:29:32.850 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-01-26T15:29:32.852 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:32.895 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:32 +0000 (0:00:00.071) 0:01:55.650 ******** 2020-01-26T15:29:32.934 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi163.front.sepia.ceph.com] => (item={u'block_used': 13723586, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371522, u'size_available': 927217754112, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371522, "block_size": 4096, "block_total": 240095108, "block_used": 13723586, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217754112, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-26T15:29:32.978 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:32 +0000 (0:00:00.082) 0:01:55.733 ******** 2020-01-26T15:29:33.093 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-01-26T15:29:33.094 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:33.132 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.154) 0:01:55.887 ******** 2020-01-26T15:29:33.139 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-26T15:29:33.140 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009856", "end": "2020-01-26 15:29:33.098169", "rc": 0, "start": "2020-01-26 15:29:33.088313", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:33.192 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.059) 0:01:55.947 ******** 2020-01-26T15:29:33.198 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-01-26T15:29:33.199 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.242 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.049) 0:01:55.996 ******** 2020-01-26T15:29:33.247 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-01-26T15:29:33.248 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'block_used': 13723586, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371522, u'size_available': 927217754112, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371522, "block_size": 4096, "block_total": 240095108, "block_used": 13723586, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217754112, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.289 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.047) 0:01:56.044 ******** 2020-01-26T15:29:33.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:29:33.296 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item={u'block_used': 13723597, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371511, u'size_available': 927217709056, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371511, "block_size": 4096, "block_total": 240095108, "block_used": 13723597, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217709056, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-26T15:29:33.338 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.049) 0:01:56.093 ******** 2020-01-26T15:29:33.344 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-26T15:29:33.388 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.049) 0:01:56.142 ******** 2020-01-26T15:29:33.447 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:33.449 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFMX', u'wwn-0x5000c50092924fd4'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFMX', u'wwn': u'0x5000c50092924fd4', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFMX-part1', u'wwn-0x5000c50092924fd4-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFMX", "wwn-0x5000c50092924fd4"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFMX-part1", "wwn-0x5000c50092924fd4-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFMX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:29:33.450 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092924fd4"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.451 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.463 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-26T15:29:33.465 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004872", "end": "2020-01-26 15:29:33.448751", "rc": 0, "start": "2020-01-26 15:29:33.443879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:33.517 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.128) 0:01:56.271 ******** 2020-01-26T15:29:33.523 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:33.524 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.529 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.537 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.538 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.540 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.552 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-01-26T15:29:33.553 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'block_used': 13723597, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371511, u'size_available': 927217709056, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371511, "block_size": 4096, "block_total": 240095108, "block_used": 13723597, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217709056, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.604 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.087) 0:01:56.359 ******** 2020-01-26T15:29:33.633 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:33.634 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-pPL4gK-ELMe-K61M-J6gq-XZLV-mscK-vrsYa6', u'nvme-INTEL_SSDPEDMD400G4_CVFT5331002K400BGN', u'nvme-nvme.8086-43564654353333313030324b34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.648684", "end": "2020-01-26 15:29:33.580316", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pPL4gK-ELMe-K61M-J6gq-XZLV-mscK-vrsYa6", "nvme-INTEL_SSDPEDMD400G4_CVFT5331002K400BGN", "nvme-nvme.8086-43564654353333313030324b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:31.931632", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-26T15:29:33.635 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-26T15:29:33.672 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:33 +0000 (0:00:00.067) 0:01:56.427 ******** 2020-01-26T15:29:33.720 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:33.721 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK1Y', u'wwn-0x5000c50092940bdb'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XK1Y', u'wwn': u'0x5000c50092940bdb', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK1Y-part1', u'wwn-0x5000c50092940bdb-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK1Y", "wwn-0x5000c50092940bdb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK1Y-part1", "wwn-0x5000c50092940bdb-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK1Y", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:29:33.722 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092940bdb"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.733 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.745 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.757 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.758 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.771 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.783 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.795 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:33.796 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:34.881 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S33A5wDxIn1yUN9K1Q8GxhVqUKx0R6FC2'], u'uuids': [u'aac6390f-4e56-4de7-adca-e00f2545cd0c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.129945", "end": "2020-01-26 15:29:34.856675", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S33A5wDxIn1yUN9K1Q8GxhVqUKx0R6FC2"], "labels": [], "masters": [], "uuids": ["aac6390f-4e56-4de7-adca-e00f2545cd0c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:33.726730", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:35.572 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-J6AWZ2-dqz2-uJdk-MvXr-T7jv-4vNz-2sKytS', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300MD400BGN', u'nvme-nvme.8086-435646543632333330304d4434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.899542", "end": "2020-01-26 15:29:35.539859", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-J6AWZ2-dqz2-uJdk-MvXr-T7jv-4vNz-2sKytS", "nvme-INTEL_SSDPEDMD400G4_CVFT623300MD400BGN", "nvme-nvme.8086-435646543632333330304d4434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:33.640317", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-26T15:29:35.573 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:35.751 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-BlEzNJ-xaTk-7XGj-AgyC-caWy-jcUl-dN81IX', u'nvme-INTEL_SSDPEDMD400G4_CVFT6232000C400BGN', u'nvme-nvme.8086-43564654363233323030304334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.816175", "end": "2020-01-26 15:29:35.724204", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-BlEzNJ-xaTk-7XGj-AgyC-caWy-jcUl-dN81IX", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000C400BGN", "nvme-nvme.8086-43564654363233323030304334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:33.908029", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-26T15:29:35.753 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:36.150 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SDQkN5nekvjUZFLF6tDIxwdi3nUkBNAOg'], u'uuids': [u'e79d1a87-f92c-4377-a7f9-a8199f698736']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.130864", "end": "2020-01-26 15:29:36.123372", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SDQkN5nekvjUZFLF6tDIxwdi3nUkBNAOg"], "labels": [], "masters": [], "uuids": ["e79d1a87-f92c-4377-a7f9-a8199f698736"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:34.992508", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:36.791 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XORnvZGMNk8XPlXBnCnncb3gcOKwvjqJm'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.098263", "end": "2020-01-26 15:29:36.762487", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XORnvZGMNk8XPlXBnCnncb3gcOKwvjqJm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:35.664224", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:37.051 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33R2retleH4TqktWImF6R5iI09kEinQS15'], u'uuids': [u'35ed88e4-c0f2-478d-a351-c2670ebfd875']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.133483", "end": "2020-01-26 15:29:37.018928", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33R2retleH4TqktWImF6R5iI09kEinQS15"], "labels": [], "masters": [], "uuids": ["35ed88e4-c0f2-478d-a351-c2670ebfd875"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:35.885445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:37.398 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S6fAKSJKR0g47gsPHif8gBheNzMygZJuG'], u'uuids': [u'6cbf8843-8e14-493f-838d-8c2e6a45e672']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.104542", "end": "2020-01-26 15:29:37.365883", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S6fAKSJKR0g47gsPHif8gBheNzMygZJuG"], "labels": [], "masters": [], "uuids": ["6cbf8843-8e14-493f-838d-8c2e6a45e672"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:36.261341", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:38.035 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XIlnxcV90W0MQ2dM8oOZ2RzqVy1H3OsuN'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.117534", "end": "2020-01-26 15:29:38.011376", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XIlnxcV90W0MQ2dM8oOZ2RzqVy1H3OsuN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:36.893842", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:38.269 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33fImvsCKxUZDhXrY9sNCcXAYlvyqOKXxA'], u'uuids': [u'08e00d3c-5e69-48a5-9305-173e773bd3d0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.104720", "end": "2020-01-26 15:29:38.243321", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33fImvsCKxUZDhXrY9sNCcXAYlvyqOKXxA"], "labels": [], "masters": [], "uuids": ["08e00d3c-5e69-48a5-9305-173e773bd3d0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:37.138601", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:38.636 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SeHY807BPluFMUfdQxtP1IpoHTtkJFeaY'], u'uuids': [u'5c60fd32-e3b2-4b0b-bcf1-0d721c3f6d1b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.117838", "end": "2020-01-26 15:29:38.609086", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SeHY807BPluFMUfdQxtP1IpoHTtkJFeaY"], "labels": [], "masters": [], "uuids": ["5c60fd32-e3b2-4b0b-bcf1-0d721c3f6d1b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:37.491248", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:39.261 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XdniwTNjHGs1ZM1bdlqwLCopLup2ztuN0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.092390", "end": "2020-01-26 15:29:39.236874", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XdniwTNjHGs1ZM1bdlqwLCopLup2ztuN0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:38.144484", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:39.508 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33rjA22pRSNg9tEzm4CvLJuBbD4BDplfVH'], u'uuids': [u'3746fab2-bd9b-4e8d-9a2e-14af71a8d771']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.106765", "end": "2020-01-26 15:29:39.484271", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33rjA22pRSNg9tEzm4CvLJuBbD4BDplfVH"], "labels": [], "masters": [], "uuids": ["3746fab2-bd9b-4e8d-9a2e-14af71a8d771"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:38.377506", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:39.873 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SgN9V1adNdyHNsRPJ2D5T7FypbUDzWHed'], u'uuids': [u'3914f3c7-6cae-4fb2-bab8-73b137fb94bf']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.105598", "end": "2020-01-26 15:29:39.841028", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SgN9V1adNdyHNsRPJ2D5T7FypbUDzWHed"], "labels": [], "masters": [], "uuids": ["3914f3c7-6cae-4fb2-bab8-73b137fb94bf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:38.735430", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:39.952 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:39 +0000 (0:00:06.279) 0:02:02.707 ******** 2020-01-26T15:29:40.013 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3ZL', u'wwn-0x5000c500871b3d00'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4H3ZL', u'wwn': u'0x5000c500871b3d00', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3ZL-part1', u'wwn-0x5000c500871b3d00-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3ZL", "wwn-0x5000c500871b3d00"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3ZL-part1", "wwn-0x5000c500871b3d00-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "ser 2020-01-26T15:29:40.015 INFO:teuthology.task.ansible.out:ial": "Z1W4H3ZL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b3d00"}}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.025 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.037 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.049 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.052 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.063 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.077 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.086 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:40.266 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-pPL4gK-ELMe-K61M-J6gq-XZLV-mscK-vrsYa6', u'nvme-INTEL_SSDPEDMD400G4_CVFT5331002K400BGN', u'nvme-nvme.8086-43564654353333313030324b34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.051160", "end": "2020-01-26 15:29:40.232119", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pPL4gK-ELMe-K61M-J6gq-XZLV-mscK-vrsYa6", "nvme-INTEL_SSDPEDMD400G4_CVFT5331002K400BGN", "nvme-nvme.8086-43564654353333313030324b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:40.180959", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-26T15:29:40.267 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0405604 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0405604 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:40.549 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S33A5wDxIn1yUN9K1Q8GxhVqUKx0R6FC2'], u'uuids': [u'aac6390f-4e56-4de7-adca-e00f2545cd0c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161083", "end": "2020-01-26 15:29:40.510528", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S33A5wDxIn1yUN9K1Q8GxhVqUKx0R6FC2"], "labels": [], "masters": [], "uuids": ["aac6390f-4e56-4de7-adca-e00f2545cd0c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:40.349445", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158157 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158157 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:40.563 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:40.564 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XQOyHL0xxHmpbMmgLS8jPmsNfDRJJt8mf'], u'uuids': [u'd57fd20a-54f4-4be5-ac33-d9bcd1775c0b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.155344", "end": "2020-01-26 15:29:40.529980", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XQOyHL0xxHmpbMmgLS8jPmsNfDRJJt8mf"], "labels": [], "masters": [], "uuids": ["d57fd20a-54f4-4be5-ac33-d9bcd1775c0b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:39.374636", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:40.743 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33Lp7mjDNwjJ4DV15oHnGQg45NGdvh95Tj'], u'uuids': [u'fa41170b-b3b3-42b7-8fba-1caa36f8214f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.107225", "end": "2020-01-26 15:29:40.709771", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33Lp7mjDNwjJ4DV15oHnGQg45NGdvh95Tj"], "labels": [], "masters": [], "uuids": ["fa41170b-b3b3-42b7 2020-01-26T15:29:40.745 INFO:teuthology.task.ansible.out:-8fba-1caa36f8214f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:39.602546", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:40.824 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SDQkN5nekvjUZFLF6tDIxwdi3nUkBNAOg'], u'uuids': [u'e79d1a87-f92c-4377-a7f9-a8199f698736']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.157125", "end": "2020-01-26 15:29:40.789921", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SDQkN5nekvjUZFLF6tDIxwdi3nUkBNAOg"], "labels": [], "masters": [], "uuids": ["e79d1a87-f92c-4377-a7f9-a8199f698736"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:40.632796", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152334 s, 757 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152334 s, 757 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:41.110 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S6fAKSJKR0g47gsPHif8gBheNzMygZJuG'], u'uuids': [u'6cbf8843-8e14-493f-838d-8c2e6a45e672']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.160213", "end": "2020-01-26 15:29:41.073123", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2S6fAKSJKR0g47gsPHif8gBheNzMygZJuG"], "labels": [], "masters": [], "uuids": ["6cbf8843-8e14-493f-838d-8c2e6a45e672"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:40.912910", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155357 s, 742 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155357 s, 742 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:41.394 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SeHY807BPluFMUfdQxtP1IpoHTtkJFeaY'], u'uuids': [u'5c60fd32-e3b2-4b0b-bcf1-0d721c3f6d1b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.158681", "end": "2020-01-26 15:29:41.358297", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SeHY807BPluFMUfdQxtP1IpoHTtkJFeaY"], "labels": [], "masters": [], "uuids": ["5c60fd32-e3b2-4b0b-bcf1-0d721c3f6d1b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:41.199616", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154043 s, 749 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154043 s, 749 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:41.668 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SgN9V1adNdyHNsRPJ2D5T7FypbUDzWHed'], u'uuids': [u'3914f3c7-6cae-4fb2-bab8-73b137fb94bf']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.154738", "end": "2020-01-26 15:29:41.638376", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ju2iwj7ACcWeSbvhWXzzymsTCsx9pD2SgN9V1adNdyHNsRPJ2D5T7FypbUDzWHed"], "labels": [], "masters": [], "uuids": ["3914f3c7-6cae-4fb2-bab8-73b137fb94bf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:41.483638", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149795 s, 770 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149795 s, 770 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:41.730 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:41 +0000 (0:00:01.777) 0:02:04.484 ******** 2020-01-26T15:29:41.796 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:41.799 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XydTQzFgoPjPcTnSZxsTnnQNQwpVeP9vo'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.113940", "end": "2020-01-26 15:29:41.771232", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XydTQzFgoPjPcTnSZxsTnnQNQwpVeP9vo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:40.657292", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:41.860 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:41 +0000 (0:00:00.129) 0:02:04.614 ******** 2020-01-26T15:29:41.909 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:41.910 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFMX', u'wwn-0x5000c50092924fd4'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFMX', u'wwn': u'0x5000c50092924fd4', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFMX-part1', u'wwn-0x5000c50092924fd4-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFMX", "wwn-0x5000c50092924fd4"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFMX-part1", "wwn-0x5000c50092924fd4-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFMX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:29:41.912 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092924fd4"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.914 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.925 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.926 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.938 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.957 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.968 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.986 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.987 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:41.988 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33kGjjjmc3CvOpUwfOhHoTGRv6JZUhaPzE'], u'uuids': [u'6178df64-d96f-49f8-96aa-98fdbf263a30']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.112558", "end": "2020-01-26 15:29:41.950791", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33kGjjjmc3CvOpUwfOhHoTGRv6JZUhaPzE"], "labels": [], "masters": [], "uuids": ["6178df64-d96f-49f8-96aa-98fdbf263a30"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:40.838233", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:29:41.989 INFO:teuthology.task.ansible.out: TASK [testno 2020-01-26T15:29:41.990 INFO:teuthology.task.ansible.out:de : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:41.994 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:29:42.043 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.183) 0:02:04.798 ******** 2020-01-26T15:29:42.049 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-01-26T15:29:42.050 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.152556", "end": "2020-01-26 15:29:41.996281", "rc": 0, "start": "2020-01-26 15:29:41.843725", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.100 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.056) 0:02:04.854 ******** 2020-01-26T15:29:42.107 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:42.114 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK1Y', u'wwn-0x5000c50092940bdb'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XK1Y', u'wwn': u'0x5000c50092940bdb', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK1Y-part1', u'wwn-0x5000c50092940bdb-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK1Y", "wwn-0x5000c50092940bdb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK1Y-part1", "wwn-0x5000c50092940bdb-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK1Y", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:29:42.116 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092940bdb"}}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.126 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.138 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.161 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.184 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-J6AWZ2-dqz2-uJdk-MvXr-T7jv-4vNz-2sKytS', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300MD400BGN', u'nvme-nvme.8086-435646543632333330304d4434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059528", "end": "2020-01-26 15:29:42.145836", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-J6AWZ2-dqz2-uJdk-MvXr-T7jv-4vNz-2sKytS", "nvme-INTEL_SSDPEDMD400G4_CVFT623300MD400BGN", "nvme-nvme.8086-435646543632333330304d4434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.086308", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-26T15:29:42.186 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0410983 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0410983 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.197 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.198 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.202 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.293 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.057786", "end": "2020-01-26 15:29:42.270902", "rc": 0, "start": "2020-01-26 15:29:42.213116", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.354 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.254) 0:02:05.108 ******** 2020-01-26T15:29:42.375 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:42.377 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-BlEzNJ-xaTk-7XGj-AgyC-caWy-jcUl-dN81IX', u'nvme-INTEL_SSDPEDMD400G4_CVFT6232000C400BGN', u'nvme-nvme.8086-43564654363233323030304334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.051881", "end": "2020-01-26 15:29:42.338712", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-BlEzNJ-xaTk-7XGj-AgyC-caWy-jcUl-dN81IX", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000C400BGN", "nvme-nvme.8086-43564654363233323030304334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.286831", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-26T15:29:42.378 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0376062 s, 3.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0376062 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.380 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-26T15:29:42.428 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.074) 0:02:05.183 ******** 2020-01-26T15:29:42.446 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:42.450 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XORnvZGMNk8XPlXBnCnncb3gcOKwvjqJm'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.143194", "end": "2020-01-26 15:29:42.425174", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XORnvZGMNk8XPlXBnCnncb3gcOKwvjqJm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.281980", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138988 s, 830 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138988 s, 830 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.469 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-01-26T15:29:42.471 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.510 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.082) 0:02:05.265 ******** 2020-01-26T15:29:42.547 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-01-26T15:29:42.549 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.590 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.077) 0:02:05.342 ******** 2020-01-26T15:29:42.614 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:29:42.616 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.658 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.070) 0:02:05.413 ******** 2020-01-26T15:29:42.665 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:42.666 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33R2retleH4TqktWImF6R5iI09kEinQS15'], u'uuids': [u'35ed88e4-c0f2-478d-a351-c2670ebfd875']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.167113", "end": "2020-01-26 15:29:42.627308", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33R2retleH4TqktWImF6R5iI09kEinQS15"], "labels": [], "masters": [], "uuids": ["35ed88e4-c0f2-478d-a351-c2670ebfd875"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.460195", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162867 s, 708 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162867 s, 708 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.689 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-26T15:29:42.691 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.734 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.075) 0:02:05.488 ******** 2020-01-26T15:29:42.771 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:42.773 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XIlnxcV90W0MQ2dM8oOZ2RzqVy1H3OsuN'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.157166", "end": "2020-01-26 15:29:42.747748", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XIlnxcV90W0MQ2dM8oOZ2RzqVy1H3OsuN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.590582", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152425 s, 757 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152425 s, 757 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.864 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:42.900 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.166) 0:02:05.655 ******** 2020-01-26T15:29:42.938 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:42.939 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33fImvsCKxUZDhXrY9sNCcXAYlvyqOKXxA'], u'uuids': [u'08e00d3c-5e69-48a5-9305-173e773bd3d0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.150820", "end": "2020-01-26 15:29:42.906076", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33fImvsCKxUZDhXrY9sNCcXAYlvyqOKXxA"], "labels": [], "masters": [], "uuids": ["08e00d3c-5e69-48a5-9305-173e773bd3d0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.755256", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146213 s, 789 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146213 s, 789 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:42.951 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:29:42.953 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={u'block_used': 13723595, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371513, u'size_available': 927217717248, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905893, u'device': u'/dev/sda1', u'inode_used': 149083, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371513, "block_size": 4096, "block_total": 240095108, "block_used": 13723595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905893, "inode_total": 61054976, "inode_used": 149083, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217717248, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:42.996 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:42 +0000 (0:00:00.096) 0:02:05.751 ******** 2020-01-26T15:29:43.034 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-26T15:29:43.036 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:43.096 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.099) 0:02:05.851 ******** 2020-01-26T15:29:43.102 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:43.103 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XdniwTNjHGs1ZM1bdlqwLCopLup2ztuN0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.155100", "end": "2020-01-26 15:29:43.028014", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XdniwTNjHGs1ZM1bdlqwLCopLup2ztuN0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:42.872914", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15044 s, 767 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15044 s, 767 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:43.125 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:43.127 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:43.164 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.067) 0:02:05.919 ******** 2020-01-26T15:29:43.201 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:43.202 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:43.251 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.086) 0:02:06.005 ******** 2020-01-26T15:29:43.257 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:43.259 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33rjA22pRSNg9tEzm4CvLJuBbD4BDplfVH'], u'uuids': [u'3746fab2-bd9b-4e8d-9a2e-14af71a8d771']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146070", "end": "2020-01-26 15:29:43.178771", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33rjA22pRSNg9tEzm4CvLJuBbD4BDplfVH"], "labels": [], "masters": [], "uuids": ["3746fab2-bd9b-4e8d-9a2e-14af71a8d771"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:43.032701", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141861 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141861 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:43.281 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-26T15:29:43.282 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:43.343 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.092) 0:02:06.098 ******** 2020-01-26T15:29:43.351 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:43.354 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XQOyHL0xxHmpbMmgLS8jPmsNfDRJJt8mf'], u'uuids': [u'd57fd20a-54f4-4be5-ac33-d9bcd1775c0b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.153288", "end": "2020-01-26 15:29:43.315685", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XQOyHL0xxHmpbMmgLS8jPmsNfDRJJt8mf"], "labels": [], "masters": [], "uuids": ["d57fd20a-54f4-4be5-ac33-d9bcd1775c0b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:43.162397", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148599 s, 776 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148599 s, 776 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:43.376 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:43.416 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.072) 0:02:06.171 ******** 2020-01-26T15:29:43.444 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-26T15:29:43.446 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:43.507 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.091) 0:02:06.262 ******** 2020-01-26T15:29:43.513 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:29:43.514 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33Lp7mjDNwjJ4DV15oHnGQg45NGdvh95Tj'], u'uuids': [u'fa41170b-b3b3-42b7-8fba-1caa36f8214f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.154353", "end": "2020-01-26 15:29:43.462523", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33Lp7mjDNwjJ4DV15oHnGQg45NGdvh95Tj"], "labels": [], "masters": [], "uuids": ["fa41170b-b3b3-42b7-8fba-1caa36f8214f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:43.308170", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149551 s, 771 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149551 s, 771 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:43.647 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XydTQzFgoPjPcTnSZxsTnnQNQwpVeP9vo'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.157213", "end": "2020-01-26 15:29:43.611834", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ENrtiFGS4G49Xiz4FSqWwzRLJVeZ5F8XydTQzFgoPjPcTnSZxsTnnQNQwpVeP9vo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:43.454621", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152349 s, 757 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152349 s, 757 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:43.708 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.200) 0:02:06.463 ******** 2020-01-26T15:29:43.782 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33kGjjjmc3CvOpUwfOhHoTGRv6JZUhaPzE'], u'uuids': [u'6178df64-d96f-49f8-96aa-98fdbf263a30']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.149983", "end": "2020-01-26 15:29:43.746185", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-bHH36q3bgzbeZFxD4wLKnncKELeeKb33kGjjjmc3CvOpUwfOhHoTGRv6JZUhaPzE"], "labels": [], "masters": [], "uuids": ["6178df64-d96f-49f8-96aa-98fdbf263a30"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:29:43.596202", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145534 s, 793 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145534 s, 793 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:43.867 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:43 +0000 (0:00:00.157) 0:02:06.621 ******** 2020-01-26T15:29:43.990 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-01-26T15:29:43.992 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.126137", "end": "2020-01-26 15:29:43.959753", "rc": 0, "start": "2020-01-26 15:29:43.833616", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:44.056 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.189) 0:02:06.810 ******** 2020-01-26T15:29:44.126 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-26T15:29:44.180 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.124) 0:02:06.935 ******** 2020-01-26T15:29:44.186 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-01-26T15:29:44.188 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.156394", "end": "2020-01-26 15:29:44.128117", "rc": 0, "start": "2020-01-26 15:29:43.971723", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:44.231 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.050) 0:02:06.986 ******** 2020-01-26T15:29:44.247 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-26T15:29:44.254 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054306", "end": "2020-01-26 15:29:44.229668", "rc": 0, "start": "2020-01-26 15:29:44.175362", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:44.299 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.057) 0:02:07.043 ******** 2020-01-26T15:29:44.316 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-26T15:29:44.367 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.078) 0:02:07.121 ******** 2020-01-26T15:29:44.404 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-26T15:29:44.406 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.037336", "end": "2020-01-26 15:29:44.378840", "rc": 0, "start": "2020-01-26 15:29:44.341504", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.455 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.088) 0:02:07.210 ******** 2020-01-26T15:29:44.496 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.040) 0:02:07.250 ******** 2020-01-26T15:29:44.502 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-01-26T15:29:44.503 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.543 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.047) 0:02:07.298 ******** 2020-01-26T15:29:44.549 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-26T15:29:44.596 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.052) 0:02:07.351 ******** 2020-01-26T15:29:44.601 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:29:44.602 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.646 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.050) 0:02:07.401 ******** 2020-01-26T15:29:44.654 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-01-26T15:29:44.657 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.699 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.053) 0:02:07.454 ******** 2020-01-26T15:29:44.704 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-26T15:29:44.705 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.746 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.047) 0:02:07.501 ******** 2020-01-26T15:29:44.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:44.752 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:44.754 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.802 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.050) 0:02:07.552 ******** 2020-01-26T15:29:44.823 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.873 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.072) 0:02:07.624 ******** 2020-01-26T15:29:44.886 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-01-26T15:29:44.887 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:44.928 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.058) 0:02:07.682 ******** 2020-01-26T15:29:44.933 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-26T15:29:44.934 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.977 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:44 +0000 (0:00:00.049) 0:02:07.732 ******** 2020-01-26T15:29:44.981 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:29:44.982 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={u'block_used': 13723586, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371522, u'size_available': 927217754112, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371522, "block_size": 4096, "block_total": 240095108, "block_used": 13723586, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217754112, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:44.984 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:44.986 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:45.024 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.046) 0:02:07.778 ******** 2020-01-26T15:29:45.050 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-26T15:29:45.052 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.091 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.065) 0:02:07.844 ******** 2020-01-26T15:29:45.106 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:29:45.146 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.056) 0:02:07.900 ******** 2020-01-26T15:29:45.151 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:45.151 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.194 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.047) 0:02:07.948 ******** 2020-01-26T15:29:45.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:29:45.199 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={u'block_used': 13723597, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371511, u'size_available': 927217709056, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371511, "block_size": 4096, "block_total": 240095108, "block_used": 13723597, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217709056, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.244 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.046) 0:02:07.994 ******** 2020-01-26T15:29:45.245 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.289 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.049) 0:02:08.044 ******** 2020-01-26T15:29:45.294 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:45.295 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:45.297 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.348 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.058) 0:02:08.103 ******** 2020-01-26T15:29:45.353 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-26T15:29:45.354 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.394 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.045) 0:02:08.148 ******** 2020-01-26T15:29:45.399 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:45.404 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.452 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.058) 0:02:08.207 ******** 2020-01-26T15:29:45.459 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-01-26T15:29:45.459 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.525 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.073) 0:02:08.280 ******** 2020-01-26T15:29:45.534 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:45.535 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.536 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:45.578 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.052) 0:02:08.333 ******** 2020-01-26T15:29:45.583 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-26T15:29:45.585 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.623 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.044) 0:02:08.377 ******** 2020-01-26T15:29:45.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-26T15:29:45.628 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.669 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.046) 0:02:08.424 ******** 2020-01-26T15:29:45.706 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-01-26T15:29:45.708 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.746 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.076) 0:02:08.501 ******** 2020-01-26T15:29:45.772 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-26T15:29:45.774 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:45.813 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.066) 0:02:08.567 ******** 2020-01-26T15:29:45.818 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:45.819 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:45.862 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.049) 0:02:08.617 ******** 2020-01-26T15:29:45.940 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-01-26T15:29:45.941 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-26T15:29:45.984 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:45 +0000 (0:00:00.121) 0:02:08.739 ******** 2020-01-26T15:29:46.000 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:29:46.003 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-26T15:29:46.044 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:46 +0000 (0:00:00.059) 0:02:08.798 ******** 2020-01-26T15:29:46.085 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** skipping: [smithi008.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:46.129 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-01-26T15:29:46.130 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-26T15:29:46.182 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:46 +0000 (0:00:00.137) 0:02:08.936 ******** 2020-01-26T15:29:46.211 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:29:46.214 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:46.277 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:46.278 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:46.360 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:29:46.362 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:46.467 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:46.478 INFO:teuthology.task.ansible.out: 2020-01-26T15:29:46.480 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:46.506 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:46.508 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:46.615 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi008.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:46.661 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:46 +0000 (0:00:00.479) 0:02:09.416 ******** 2020-01-26T15:29:46.724 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:46.726 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:46.757 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:46.804 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-01-26T15:29:46.805 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:29:46.847 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:46 +0000 (0:00:00.184) 0:02:09.600 ******** 2020-01-26T15:29:46.897 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-01-26T15:29:46.899 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-26T15:29:46.950 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:46 +0000 (0:00:00.103) 0:02:09.704 ******** 2020-01-26T15:29:46.966 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:29:46.967 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:47.022 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:47.176 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:47.276 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:47.341 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:47 +0000 (0:00:00.391) 0:02:10.096 ******** 2020-01-26T15:29:47.402 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:29:47.446 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:47 +0000 (0:00:00.105) 0:02:10.201 ******** 2020-01-26T15:29:47.462 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-01-26T15:29:47.464 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true} 2020-01-26T15:29:47.508 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:47 +0000 (0:00:00.060) 0:02:10.262 ******** 2020-01-26T15:29:47.518 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-26T15:29:47.575 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:47 +0000 (0:00:00.067) 0:02:10.330 ******** 2020-01-26T15:29:47.582 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-26T15:29:47.627 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:47 +0000 (0:00:00.052) 0:02:10.382 ******** 2020-01-26T15:29:47.634 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:29:47.634 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:47.678 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:47.754 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:47.799 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:47.864 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:47.955 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:47.990 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:48.019 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-01-26T15:29:48.021 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-26T15:29:48.097 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.468) 0:02:10.851 ******** 2020-01-26T15:29:48.104 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:29:48.107 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:48.108 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:48.152 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.055) 0:02:10.906 ******** 2020-01-26T15:29:48.200 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:29:48.242 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.089) 0:02:10.996 ******** 2020-01-26T15:29:48.248 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-01-26T15:29:48.249 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:29:48.291 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.049) 0:02:11.045 ******** 2020-01-26T15:29:48.298 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-01-26T15:29:48.299 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:29:48.342 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.048) 0:02:11.094 ******** 2020-01-26T15:29:48.379 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:29:48.380 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-26T15:29:48.419 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.079) 0:02:11.174 ******** 2020-01-26T15:29:48.457 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.037) 0:02:11.211 ******** 2020-01-26T15:29:48.463 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:29:48.506 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.048) 0:02:11.260 ******** 2020-01-26T15:29:48.511 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-01-26T15:29:48.511 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-26T15:29:48.553 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.047) 0:02:11.308 ******** 2020-01-26T15:29:48.664 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-01-26T15:29:48.665 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true} 2020-01-26T15:29:48.706 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.153) 0:02:11.461 ******** 2020-01-26T15:29:48.798 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true} 2020-01-26T15:29:48.835 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.129) 0:02:11.590 ******** 2020-01-26T15:29:48.883 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-01-26T15:29:48.884 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-26T15:29:48.925 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.089) 0:02:11.680 ******** 2020-01-26T15:29:48.932 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-01-26T15:29:48.933 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-26T15:29:48.986 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:48 +0000 (0:00:00.060) 0:02:11.741 ******** 2020-01-26T15:29:49.061 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-26T15:29:49.103 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.116) 0:02:11.857 ******** 2020-01-26T15:29:49.130 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-01-26T15:29:49.131 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:29:49.180 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.077) 0:02:11.935 ******** 2020-01-26T15:29:49.262 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-01-26T15:29:49.264 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-26T15:29:49.302 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.121) 0:02:12.057 ******** 2020-01-26T15:29:49.308 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-01-26T15:29:49.309 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:29:49.350 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.047) 0:02:12.105 ******** 2020-01-26T15:29:49.358 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:29:49.398 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.047) 0:02:12.152 ******** 2020-01-26T15:29:49.499 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:29:49.550 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.152) 0:02:12.305 ******** 2020-01-26T15:29:49.753 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-01-26T15:29:49.754 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-26T15:29:49.798 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.247) 0:02:12.553 ******** 2020-01-26T15:29:49.889 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-26T15:29:49.948 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:49 +0000 (0:00:00.149) 0:02:12.702 ******** 2020-01-26T15:29:50.144 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-01-26T15:29:50.145 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-26T15:29:50.201 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:50 +0000 (0:00:00.253) 0:02:12.956 ******** 2020-01-26T15:29:50.218 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-01-26T15:29:50.219 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:29:50.268 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:50 +0000 (0:00:00.066) 0:02:13.023 ******** 2020-01-26T15:29:50.294 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-01-26T15:29:50.295 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-26T15:29:50.339 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:50 +0000 (0:00:00.068) 0:02:13.091 ******** 2020-01-26T15:29:50.454 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-01-26T15:29:50.455 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047953", "end": "2020-01-26 15:29:50.433467", "rc": 0, "start": "2020-01-26 15:29:50.385514", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-26T15:29:50.498 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:50 +0000 (0:00:00.161) 0:02:13.252 ******** 2020-01-26T15:29:50.525 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-01-26T15:29:50.526 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:50.581 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:50 +0000 (0:00:00.082) 0:02:13.335 ******** 2020-01-26T15:29:50.618 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-01-26T15:29:50.619 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:50.684 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:50 +0000 (0:00:00.103) 0:02:13.439 ******** 2020-01-26T15:29:51.072 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-01-26T15:29:51.074 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:51.114 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.429) 0:02:13.868 ******** 2020-01-26T15:29:51.230 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:51.270 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.156) 0:02:14.025 ******** 2020-01-26T15:29:51.298 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-01-26T15:29:51.299 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.045743", "end": "2020-01-26 15:29:51.276171", "rc": 0, "start": "2020-01-26 15:29:51.230428", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-26T15:29:51.344 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.073) 0:02:14.099 ******** 2020-01-26T15:29:51.384 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-01-26T15:29:51.386 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:51.426 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.081) 0:02:14.181 ******** 2020-01-26T15:29:51.452 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-01-26T15:29:51.454 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:51.503 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.077) 0:02:14.258 ******** 2020-01-26T15:29:51.511 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-01-26T15:29:51.512 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046664", "end": "2020-01-26 15:29:51.435945", "rc": 0, "start": "2020-01-26 15:29:51.389281", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-26T15:29:51.557 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.050) 0:02:14.308 ******** 2020-01-26T15:29:51.570 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-26T15:29:51.574 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:29:51.612 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.058) 0:02:14.367 ******** 2020-01-26T15:29:51.618 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-01-26T15:29:51.620 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:51.670 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.057) 0:02:14.425 ******** 2020-01-26T15:29:51.675 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-26T15:29:51.677 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:51.722 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.052) 0:02:14.477 ******** 2020-01-26T15:29:51.728 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-01-26T15:29:51.737 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:51.773 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:51 +0000 (0:00:00.050) 0:02:14.527 ******** 2020-01-26T15:29:52.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-26T15:29:52.090 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-26T15:29:52.131 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.356) 0:02:14.884 ******** 2020-01-26T15:29:52.166 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-01-26T15:29:52.167 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:52.224 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.094) 0:02:14.979 ******** 2020-01-26T15:29:52.379 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-26T15:29:52.380 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:52.425 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.200) 0:02:15.180 ******** 2020-01-26T15:29:52.434 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-26T15:29:52.436 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:10 UTC", "ActiveEnterTimestampMonotonic": "28871885", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target system.slice systemd-journald.socket -.mount basic.target systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:27:01 UTC", "AssertTimestampMonotonic": "20572331", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:27:01 UTC", "ConditionTimestampMonotonic": "20572330", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-26T15:29:52.438 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1734", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:10 UTC", "ExecMainStartTimestampMonotonic": "28871823", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:27:01 UTC", "InactiveExitTimestampMonotonic": "20574048", "InvocationID": "687e019deb5c416499e757e68f937930", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-26T15:29:52.440 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1734", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:10 UTC", "StateChangeTimestampMonoton 2020-01-26T15:29:52.445 INFO:teuthology.task.ansible.out:ic": "28871885", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:10 UTC", "WatchdogTimestampMonotonic": "28871882", "WatchdogUSec": "0"}} 2020-01-26T15:29:52.477 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.052) 0:02:15.232 ******** 2020-01-26T15:29:52.483 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-26T15:29:52.484 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:52.528 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.044) 0:02:15.277 ******** TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-01-26T15:29:52.530 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:52.569 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.046) 0:02:15.324 ******** 2020-01-26T15:29:52.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-26T15:29:52.694 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:52.737 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.168) 0:02:15.492 ******** 2020-01-26T15:29:52.764 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-26T15:29:52.766 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:52.821 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.084) 0:02:15.576 ******** 2020-01-26T15:29:52.870 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-26T15:29:52.871 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-26T15:29:52.923 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.101) 0:02:15.678 ******** 2020-01-26T15:29:52.960 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-01-26T15:29:52.963 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:53.003 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:52 +0000 (0:00:00.078) 0:02:15.757 ******** 2020-01-26T15:29:53.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-26T15:29:53.170 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-26T15:29:53.210 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.207) 0:02:15.965 ******** 2020-01-26T15:29:53.217 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-26T15:29:53.224 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:33 UTC", "ActiveEnterTimestampMonotonic": "25867721", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target system.slice network.target -.mount systemd-journald.socket systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:27:24 UTC", "AssertTimestampMonotonic": "17568074", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:27:24 UTC", "ConditionTimestampMonotonic": "17568074", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-26T15:29:53.228 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1834", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:33 UTC", "ExecMainStartTimestampMonotonic": "25867660", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:27:24 UTC", "InactiveExitTimestampMonotonic": "17568826", "InvocationID": "6121c68578054476aee79f4f5a97bfed", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-26T15:29:53.230 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1834", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:33 UTC", "StateChangeTimestampMonoton 2020-01-26T15:29:53.231 INFO:teuthology.task.ansible.out:ic": "25867721", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:33 UTC", "WatchdogTimestampMonotonic": "25867718", "WatchdogUSec": "0"}} 2020-01-26T15:29:53.279 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.068) 0:02:16.033 ******** 2020-01-26T15:29:53.290 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:53.342 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.062) 0:02:16.096 ******** 2020-01-26T15:29:53.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-01-26T15:29:53.348 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:53.390 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.048) 0:02:16.145 ******** 2020-01-26T15:29:53.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi008.front.sepia.ceph.com] => {"cache_update_time": 1580052228, "cache_updated": false, "changed": false} 2020-01-26T15:29:53.512 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.121) 0:02:16.266 ******** 2020-01-26T15:29:53.539 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-26T15:29:53.540 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:53.592 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.080) 0:02:16.347 ******** 2020-01-26T15:29:53.599 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-26T15:29:53.601 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:27:02 UTC", "ActiveEnterTimestampMonotonic": "25796033", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target network.target -.mount sysinit.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:26:54 UTC", "AssertTimestampMonotonic": "17544063", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:26:54 UTC", "ConditionTimestampMonotonic": "17544063", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-26T15:29:53.603 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1829", "ExecMainStartTimestamp": "Sun 2020-01-26 15:27:02 UTC", "ExecMainStartTimestampMonotonic": "25795976", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:26:54 UTC", "InactiveExitTimestampMonotonic": "17544749", "InvocationID": "e83e40f2d1bd49f39aaf497ccf89741c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-26T15:29:53.604 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1829", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:27:02 UTC", "StateChangeTimestampMonoton 2020-01-26T15:29:53.606 INFO:teuthology.task.ansible.out:ic": "25796033", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:27:02 UTC", "WatchdogTimestampMonotonic": "25796031", "WatchdogUSec": "0"}} 2020-01-26T15:29:53.644 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.052) 0:02:16.399 ******** 2020-01-26T15:29:53.673 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:53.714 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.069) 0:02:16.469 ******** 2020-01-26T15:29:53.730 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-01-26T15:29:53.730 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:29:53.773 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:53 +0000 (0:00:00.058) 0:02:16.527 ******** 2020-01-26T15:29:54.110 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-01-26T15:29:54.115 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-26T15:29:54.153 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.380) 0:02:16.907 ******** 2020-01-26T15:29:54.241 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-01-26T15:29:54.243 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"cache_update_time": 1580052271, "cache_updated": false, "changed": false} 2020-01-26T15:29:54.288 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.134) 0:02:17.042 ******** 2020-01-26T15:29:54.321 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-26T15:29:54.323 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:54.361 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.073) 0:02:17.116 ******** 2020-01-26T15:29:54.496 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-01-26T15:29:54.497 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:29:54.537 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.175) 0:02:17.292 ******** 2020-01-26T15:29:54.606 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-01-26T15:29:54.607 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"cache_update_time": 1580052185, "cache_updated": false, "changed": false} 2020-01-26T15:29:54.668 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.130) 0:02:17.423 ******** 2020-01-26T15:29:54.695 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-26T15:29:54.696 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:54.736 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.067) 0:02:17.490 ******** 2020-01-26T15:29:54.869 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-01-26T15:29:54.871 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-26T15:29:54.932 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.193) 0:02:17.684 ******** 2020-01-26T15:29:54.953 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:29:54.994 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:54 +0000 (0:00:00.064) 0:02:17.748 ******** 2020-01-26T15:29:55.226 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-01-26T15:29:55.227 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-26T15:29:55.273 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:55 +0000 (0:00:00.279) 0:02:18.028 ******** 2020-01-26T15:29:55.323 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-01-26T15:29:55.325 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-26T15:29:55.376 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:55 +0000 (0:00:00.097) 0:02:18.125 ******** 2020-01-26T15:29:55.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-01-26T15:29:55.711 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-26T15:29:55.755 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:55 +0000 (0:00:00.384) 0:02:18.510 ******** 2020-01-26T15:29:55.783 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-01-26T15:29:55.784 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false} 2020-01-26T15:29:55.859 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:55 +0000 (0:00:00.103) 0:02:18.614 ******** 2020-01-26T15:29:55.886 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-26T15:29:55.887 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-01-26T15:29:55.929 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:55 +0000 (0:00:00.070) 0:02:18.684 ******** 2020-01-26T15:29:56.095 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-01-26T15:29:56.113 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1580052107.4087298, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1580052107.4047296, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1580052107.4047296, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-26T15:29:56.148 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.219) 0:02:18.903 ******** 2020-01-26T15:29:56.154 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-01-26T15:29:56.155 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-26T15:29:56.197 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.048) 0:02:18.952 ******** 2020-01-26T15:29:56.286 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi163.front.sepia.ceph.com] => {"changed": false} 2020-01-26T15:29:56.326 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.128) 0:02:19.081 ******** 2020-01-26T15:29:56.363 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-26T15:29:56.365 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-01-26T15:29:56.403 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.076) 0:02:19.157 ******** 2020-01-26T15:29:56.542 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-01-26T15:29:56.543 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1580052169.9868758, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1580052168.4701178, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1580052168.4701178, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-26T15:29:56.592 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.189) 0:02:19.346 ******** 2020-01-26T15:29:56.600 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-01-26T15:29:56.600 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-26T15:29:56.650 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.050) 0:02:19.397 ******** 2020-01-26T15:29:56.670 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-01-26T15:29:56.671 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-26T15:29:56.710 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.067) 0:02:19.464 ******** 2020-01-26T15:29:56.722 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi170.front.sepia.ceph.com] => {"changed": false} 2020-01-26T15:29:56.773 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.063) 0:02:19.528 ******** 2020-01-26T15:29:56.779 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-01-26T15:29:56.780 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-26T15:29:56.781 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:56.821 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.047) 0:02:19.576 ******** 2020-01-26T15:29:56.858 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.036) 0:02:19.613 ******** 2020-01-26T15:29:56.863 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-26T15:29:56.863 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-01-26T15:29:56.910 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.052) 0:02:19.665 ******** 2020-01-26T15:29:56.915 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-01-26T15:29:56.917 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-26T15:29:56.959 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:56 +0000 (0:00:00.048) 0:02:19.713 ******** 2020-01-26T15:29:56.967 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-01-26T15:29:56.969 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-26T15:29:57.008 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.048) 0:02:19.762 ******** 2020-01-26T15:29:57.014 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-01-26T15:29:57.015 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.061 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.052) 0:02:19.815 ******** 2020-01-26T15:29:57.067 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-01-26T15:29:57.069 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1580052134.994717, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1580052133.489965, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1580052133.489965, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-26T15:29:57.112 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.051) 0:02:19.867 ******** 2020-01-26T15:29:57.139 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-01-26T15:29:57.140 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-26T15:29:57.189 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.074) 0:02:19.944 ******** 2020-01-26T15:29:57.205 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-01-26T15:29:57.206 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-26T15:29:57.248 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.058) 0:02:20.002 ******** 2020-01-26T15:29:57.255 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-01-26T15:29:57.256 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.258 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi170.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-26T15:29:57.302 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.049) 0:02:20.052 ******** 2020-01-26T15:29:57.333 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.034) 0:02:20.087 ******** 2020-01-26T15:29:57.339 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-01-26T15:29:57.339 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.341 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.351 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.352 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.363 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.364 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-01-26T15:29:57.365 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-26T15:29:57.408 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.075) 0:02:20.163 ******** 2020-01-26T15:29:57.448 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.039) 0:02:20.203 ******** 2020-01-26T15:29:57.455 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-01-26T15:29:57.456 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-26T15:29:57.457 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi008.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.459 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi008.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.508 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.060) 0:02:20.263 ******** 2020-01-26T15:29:57.514 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.515 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.517 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi008.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.558 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.049) 0:02:20.313 ******** 2020-01-26T15:29:57.595 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.036) 0:02:20.350 ******** 2020-01-26T15:29:57.599 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-01-26T15:29:57.601 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.643 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.048) 0:02:20.398 ******** 2020-01-26T15:29:57.679 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.035) 0:02:20.434 ******** 2020-01-26T15:29:57.685 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-01-26T15:29:57.686 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.740 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.060) 0:02:20.495 ******** 2020-01-26T15:29:57.745 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-01-26T15:29:57.747 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.748 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.749 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi163.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.751 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi163.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.803 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.062) 0:02:20.557 ******** 2020-01-26T15:29:57.850 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.040) 0:02:20.598 ******** 2020-01-26T15:29:57.851 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.852 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi163.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.854 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.855 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.857 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.902 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.058) 0:02:20.657 ******** 2020-01-26T15:29:57.908 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:57.951 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.049) 0:02:20.706 ******** 2020-01-26T15:29:57.957 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-01-26T15:29:57.958 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.000 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:57 +0000 (0:00:00.048) 0:02:20.755 ******** 2020-01-26T15:29:58.006 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-01-26T15:29:58.006 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-26T15:29:58.008 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.052 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.052) 0:02:20.807 ******** 2020-01-26T15:29:58.090 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.037) 0:02:20.844 ******** 2020-01-26T15:29:58.095 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-01-26T15:29:58.096 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.140 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.050) 0:02:20.894 ******** 2020-01-26T15:29:58.188 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.047) 0:02:20.942 ******** 2020-01-26T15:29:58.193 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-01-26T15:29:58.194 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.236 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.048) 0:02:20.991 ******** 2020-01-26T15:29:58.278 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.041) 0:02:21.033 ******** 2020-01-26T15:29:58.285 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-01-26T15:29:58.287 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.332 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.053) 0:02:21.087 ******** 2020-01-26T15:29:58.379 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.047) 0:02:21.134 ******** 2020-01-26T15:29:58.385 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-01-26T15:29:58.387 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.389 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.390 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:29:58.392 INFO:teuthology.task.ansible.out:skipping: [smithi008.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.435 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.055) 0:02:21.189 ******** 2020-01-26T15:29:58.478 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.043) 0:02:21.233 ******** 2020-01-26T15:29:58.484 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-01-26T15:29:58.486 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.533 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.054) 0:02:21.288 ******** 2020-01-26T15:29:58.542 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-01-26T15:29:58.544 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.546 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi170.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.547 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.598 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.064) 0:02:21.353 ******** 2020-01-26T15:29:58.605 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-01-26T15:29:58.607 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi008.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011057", "end": "2020-01-26 15:29:58.562078", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-26 15:29:58.551021", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:58.654 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.055) 0:02:21.408 ******** 2020-01-26T15:29:58.659 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:29:58.661 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.709 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.054) 0:02:21.463 ******** 2020-01-26T15:29:58.715 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:29:58.716 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.767 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.057) 0:02:21.521 ******** 2020-01-26T15:29:58.773 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:58.775 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006164", "end": "2020-01-26 15:29:58.694877", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-26 15:29:58.688713", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:58.777 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.821 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.054) 0:02:21.576 ******** 2020-01-26T15:29:58.827 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-01-26T15:29:58.828 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.880 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.059) 0:02:21.635 ******** 2020-01-26T15:29:58.888 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:58.889 INFO:teuthology.task.ansible.out:ok: [smithi008.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005442", "end": "2020-01-26 15:29:58.817258", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-26 15:29:58.811816", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:58.891 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.938 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.057) 0:02:21.692 ******** 2020-01-26T15:29:58.944 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:29:58.945 INFO:teuthology.task.ansible.out:skipping: [smithi163.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:58.991 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:58 +0000 (0:00:00.053) 0:02:21.746 ******** 2020-01-26T15:29:58.997 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-01-26T15:29:58.999 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:59.000 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi008.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019233", "end": "2020-01-26 15:29:58.951273", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-26 15:29:58.932040", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.043 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.051) 0:02:21.797 ******** 2020-01-26T15:29:59.083 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.040) 0:02:21.838 ******** 2020-01-26T15:29:59.089 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-26T15:29:59.144 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.060) 0:02:21.898 ******** 2020-01-26T15:29:59.150 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:59.199 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.054) 0:02:21.953 ******** 2020-01-26T15:29:59.205 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:59.207 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011747", "end": "2020-01-26 15:29:59.134857", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-26 15:29:59.123110", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.228 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:59.274 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.075) 0:02:22.029 ******** 2020-01-26T15:29:59.280 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-01-26T15:29:59.281 INFO:teuthology.task.ansible.out:changed: [smithi008.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-26T15:29:59.282 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi163.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005049", "end": "2020-01-26 15:29:59.253558", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-26 15:29:59.248509", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.325 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-01-26T15:29:59.327 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:59.400 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.126) 0:02:22.155 ******** 2020-01-26T15:29:59.406 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:59.407 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005488", "end": "2020-01-26 15:29:59.372782", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-26 15:29:59.367294", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.429 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:29:59.431 INFO:teuthology.task.ansible.out:skipping: [smithi170.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:29:59.470 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.069) 0:02:22.225 ******** 2020-01-26T15:29:59.559 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:59.560 INFO:teuthology.task.ansible.out:ok: [smithi163.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.043131", "end": "2020-01-26 15:29:59.528973", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-26 15:29:59.485842", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.603 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.132) 0:02:22.358 ******** 2020-01-26T15:29:59.630 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-26T15:29:59.675 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:29:59 +0000 (0:00:00.067) 0:02:22.425 ******** 2020-01-26T15:29:59.677 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:59.678 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.008736", "end": "2020-01-26 15:29:59.592751", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-26 15:29:59.584015", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.762 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.004110", "end": "2020-01-26 15:29:59.726162", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-26 15:29:59.722052", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:29:59.805 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-01-26T15:29:59.807 INFO:teuthology.task.ansible.out:changed: [smithi163.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-26T15:29:59.896 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:29:59.898 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005451", "end": "2020-01-26 15:29:59.857241", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-26 15:29:59.851790", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-26T15:30:00.031 INFO:teuthology.task.ansible.out:ok: [smithi170.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.017316", "end": "2020-01-26 15:29:59.985993", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-26 15:29:59.968677", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:30:00.072 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:30:00 +0000 (0:00:00.401) 0:02:22.827 ******** 2020-01-26T15:30:00.098 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-26T15:30:00.142 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:30:00 +0000 (0:00:00.069) 0:02:22.897 ******** 2020-01-26T15:30:00.274 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-01-26T15:30:00.275 INFO:teuthology.task.ansible.out:changed: [smithi170.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-26T15:30:00.387 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-01-26T15:30:00.389 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-01-26T15:30:00.390 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-01-26T15:30:00.392 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi008.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 2020-01-26T15:30:00.392 INFO:teuthology.task.ansible.out:smithi163.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 smithi170.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 2020-01-26T15:30:00.392 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:30:00 +0000 (0:00:00.250) 0:02:23.147 ******** =============================================================================== 2020-01-26T15:30:00.394 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 17.03s users : Update authorized_keys using the keys repo --------------------- 14.51s testnode : Install packages --------------------------------------------- 9.61s testnode : Ensure packages are not present. ----------------------------- 9.54s testnode : Zap all non-root disks --------------------------------------- 6.28s users : Remove revoked users -------------------------------------------- 5.23s Gathering Facts --------------------------------------------------------- 2.64s testnode : Update apt cache. -------------------------------------------- 1.15s common : Update apt cache ----------------------------------------------- 0.91s Gathering Facts --------------------------------------------------------- 0.84s testnode : Install non aarch64 packages --------------------------------- 0.78s 2020-01-26T15:30:00.394 INFO:teuthology.task.ansible.out:users : Update authorized_keys for each user with literal keys ---------- 0.75s testnode : Make sure apt dependencies are installed --------------------- 0.66s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.64s ansible-managed : Add authorized keys for the ansible user. ------------- 0.63s users : Clone the keys repo --------------------------------------------- 0.56s testnode : Create logical volume(s) ------------------------------------- 0.48s testnode : Write /scratch_devs ------------------------------------------ 0.47s ansible-managed : Create the ansible user. ------------------------------ 0.44s 2020-01-26T15:30:00.394 INFO:teuthology.task.ansible.out:testnode : Install python-apt ------------------------------------------- 0.42s 2020-01-26T15:30:00.671 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2020-01-26T15:30:00.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:30:00.675 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi008.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:30:00.752 INFO:teuthology.orchestra.run.smithi008:> true 2020-01-26T15:30:00.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:30:00.941 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi170.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:30:01.004 INFO:teuthology.orchestra.run.smithi170:> true 2020-01-26T15:30:01.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:30:01.188 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi163.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:30:01.263 INFO:teuthology.orchestra.run.smithi163:> true 2020-01-26T15:30:01.462 INFO:teuthology.run_tasks:Running task clock... 2020-01-26T15:30:01.474 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-01-26T15:30:01.475 INFO:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-26T15:30:01.524 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-26T15:30:01.524 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Command line: ntpd -gq 2020-01-26T15:30:01.525 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: proto: precision = 0.126 usec (-23) 2020-01-26T15:30:01.526 INFO:teuthology.orchestra.run.smithi008.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:30:01.526 INFO:teuthology.orchestra.run.smithi008.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:30:01.526 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:30:01.527 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:30:01.527 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listen and drop on 0 v6wildcard [::]:123 2020-01-26T15:30:01.527 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-26T15:30:01.527 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listen normally on 2 lo 127.0.0.1:123 2020-01-26T15:30:01.527 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listen normally on 3 ens1f0 172.21.15.8:123 2020-01-26T15:30:01.527 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listen normally on 4 lo [::1]:123 2020-01-26T15:30:01.528 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1968%3]:123 2020-01-26T15:30:01.528 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:01 ntpd[7640]: Listening on routing socket on fd #22 for interface updates 2020-01-26T15:30:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:02 ntpd[7640]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:02 ntpd[7640]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:02 ntpd[7640]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:02 ntpd[7640]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:04.524 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:04 ntpd[7640]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:04.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:04 ntpd[7640]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:04.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:04 ntpd[7640]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:04.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:04 ntpd[7640]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:06.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:06 ntpd[7640]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:06.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:06 ntpd[7640]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:06.526 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:06 ntpd[7640]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:06.526 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:06 ntpd[7640]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:08 ntpd[7640]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:08 ntpd[7640]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:08 ntpd[7640]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:08 ntpd[7640]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:08 ntpd[7640]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-26T15:30:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:26 Jan 15:30:08 ntpd[7640]: can't open /var/log/ntpstats/loopstats.20200126: Permission denied 2020-01-26T15:30:08.526 INFO:teuthology.orchestra.run.smithi008.stdout:26 Jan 15:30:08 ntpd[7640]: ntpd: time slew -0.002025 s 2020-01-26T15:30:08.526 INFO:teuthology.orchestra.run.smithi008.stdout:ntpd: time slew -0.002025s 2020-01-26T15:30:08.571 INFO:teuthology.orchestra.run.smithi008.stdout: remote refid st t when poll reach delay offset jitter 2020-01-26T15:30:08.572 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================== 2020-01-26T15:30:08.572 INFO:teuthology.orchestra.run.smithi008.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:08.572 INFO:teuthology.orchestra.run.smithi008.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:08.572 INFO:teuthology.orchestra.run.smithi008.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:08.572 INFO:teuthology.orchestra.run.smithi008.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:08.573 INFO:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-26T15:30:08.621 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-26T15:30:08.621 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Command line: ntpd -gq 2020-01-26T15:30:08.623 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: proto: precision = 0.123 usec (-23) 2020-01-26T15:30:08.623 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:30:08.623 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:30:08.623 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listen and drop on 0 v6wildcard [::]:123 2020-01-26T15:30:08.624 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-26T15:30:08.624 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listen normally on 2 lo 127.0.0.1:123 2020-01-26T15:30:08.624 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listen normally on 3 enp3s0f1 172.21.15.170:123 2020-01-26T15:30:08.624 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listen normally on 4 lo [::1]:123 2020-01-26T15:30:08.624 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7255%5]:123 2020-01-26T15:30:08.625 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:08 ntpd[7729]: Listening on routing socket on fd #22 for interface updates 2020-01-26T15:30:08.625 INFO:teuthology.orchestra.run.smithi170.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:30:08.625 INFO:teuthology.orchestra.run.smithi170.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:30:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:13 ntpd[7729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:13 ntpd[7729]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:13 ntpd[7729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:13 ntpd[7729]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:15.624 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:15 ntpd[7729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:15.625 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:15 ntpd[7729]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:15.625 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:15 ntpd[7729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:15.625 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:15 ntpd[7729]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:17 ntpd[7729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:17 ntpd[7729]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:17 ntpd[7729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:17 ntpd[7729]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:19.626 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:19 ntpd[7729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:19.626 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:19 ntpd[7729]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:19.626 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:19 ntpd[7729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:19.627 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:19 ntpd[7729]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:19.627 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:19 ntpd[7729]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-26T15:30:19.627 INFO:teuthology.orchestra.run.smithi170.stderr:26 Jan 15:30:19 ntpd[7729]: can't open /var/log/ntpstats/loopstats.20200126: Permission denied 2020-01-26T15:30:19.627 INFO:teuthology.orchestra.run.smithi170.stdout:26 Jan 15:30:19 ntpd[7729]: ntpd: time slew +0.019835 s 2020-01-26T15:30:19.627 INFO:teuthology.orchestra.run.smithi170.stdout:ntpd: time slew +0.019835s 2020-01-26T15:30:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: remote refid st t when poll reach delay offset jitter 2020-01-26T15:30:19.677 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================== 2020-01-26T15:30:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:19.678 INFO:teuthology.orchestra.run.smithi170.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:19.678 INFO:teuthology.orchestra.run.smithi170.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:19.679 INFO:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-26T15:30:19.733 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-26T15:30:19.733 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Command line: ntpd -gq 2020-01-26T15:30:19.734 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: proto: precision = 0.123 usec (-23) 2020-01-26T15:30:19.735 INFO:teuthology.orchestra.run.smithi163.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:30:19.735 INFO:teuthology.orchestra.run.smithi163.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:30:19.736 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:30:19.736 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:30:19.736 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listen and drop on 0 v6wildcard [::]:123 2020-01-26T15:30:19.736 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-26T15:30:19.736 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listen normally on 2 lo 127.0.0.1:123 2020-01-26T15:30:19.736 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listen normally on 3 enp3s0f1 172.21.15.163:123 2020-01-26T15:30:19.737 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listen normally on 4 lo [::1]:123 2020-01-26T15:30:19.737 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d5b%5]:123 2020-01-26T15:30:19.737 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:19 ntpd[7608]: Listening on routing socket on fd #22 for interface updates 2020-01-26T15:30:20.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:20 ntpd[7608]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:20.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:20 ntpd[7608]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:20.735 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:20 ntpd[7608]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:20.735 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:20 ntpd[7608]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:22.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:22 ntpd[7608]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:22.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:22 ntpd[7608]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:22.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:22 ntpd[7608]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:22.735 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:22 ntpd[7608]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:24.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:24 ntpd[7608]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:24.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:24 ntpd[7608]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:24.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:24 ntpd[7608]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:24.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:24 ntpd[7608]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:26.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:26 ntpd[7608]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:30:26.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:26 ntpd[7608]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:30:26.734 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:26 ntpd[7608]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:30:26.735 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:26 ntpd[7608]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:30:26.735 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:26 ntpd[7608]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-26T15:30:26.735 INFO:teuthology.orchestra.run.smithi163.stderr:26 Jan 15:30:26 ntpd[7608]: can't open /var/log/ntpstats/loopstats.20200126: Permission denied 2020-01-26T15:30:26.735 INFO:teuthology.orchestra.run.smithi163.stdout:26 Jan 15:30:26 ntpd[7608]: ntpd: time slew -0.004297 s 2020-01-26T15:30:26.735 INFO:teuthology.orchestra.run.smithi163.stdout:ntpd: time slew -0.004297s 2020-01-26T15:30:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2020-01-26T15:30:26.843 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2020-01-26T15:30:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:30:26.845 INFO:teuthology.run_tasks:Running task install... 2020-01-26T15:30:26.859 DEBUG:teuthology.task.install:project ceph 2020-01-26T15:30:26.859 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'}} 2020-01-26T15:30:26.859 DEBUG:teuthology.task.install:config {'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'extra_packages': ['librados2'], 'branch': 'mimic', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm']} 2020-01-26T15:30:26.859 INFO:teuthology.task.install:Using flavor: basic 2020-01-26T15:30:26.867 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-01-26T15:30:26.868 INFO:teuthology.task.install:extra packages: ['librados2'] 2020-01-26T15:30:26.868 INFO:teuthology.orchestra.run.smithi008:> sudo lsb_release -is 2020-01-26T15:30:26.922 INFO:teuthology.orchestra.run.smithi008.stdout:Ubuntu 2020-01-26T15:30:26.928 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:30:26.929 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:30:26.929 INFO:teuthology.orchestra.run.smithi008:> sudo apt-key list | grep Ceph 2020-01-26T15:30:26.982 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:30:26.987 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:30:26.988 INFO:teuthology.orchestra.run.smithi163:> sudo lsb_release -is 2020-01-26T15:30:26.988 INFO:teuthology.orchestra.run.smithi170:> sudo apt-key list | grep Ceph 2020-01-26T15:30:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:30:27.041 INFO:teuthology.orchestra.run.smithi163.stdout:Ubuntu 2020-01-26T15:30:27.046 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:30:27.047 INFO:teuthology.orchestra.run.smithi163:> sudo apt-key list | grep Ceph 2020-01-26T15:30:27.075 INFO:teuthology.orchestra.run.smithi170.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:30:27.091 INFO:teuthology.orchestra.run.smithi008.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:30:27.091 INFO:teuthology.orchestra.run.smithi008.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:30:27.092 INFO:teuthology.orchestra.run.smithi008:> sudo lsb_release -is 2020-01-26T15:30:27.131 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:30:27.131 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:30:27.132 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:30:27.152 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:30:27.153 INFO:teuthology.orchestra.run.smithi008.stdout:Ubuntu 2020-01-26T15:30:27.153 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:30:27.153 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-01-26T15:30:27.153 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:30:27.154 INFO:teuthology.packaging:ref: None 2020-01-26T15:30:27.154 INFO:teuthology.packaging:tag: None 2020-01-26T15:30:27.154 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:30:27.154 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:30:27.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:30:27.180 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:30:27.186 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:30:27.186 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-01-26T15:30:27.186 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:30:27.186 INFO:teuthology.packaging:ref: None 2020-01-26T15:30:27.186 INFO:teuthology.packaging:tag: None 2020-01-26T15:30:27.186 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:30:27.187 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:30:27.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:30:27.198 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:30:27.198 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:30:27.199 INFO:teuthology.orchestra.run.smithi163:> sudo lsb_release -is 2020-01-26T15:30:27.262 INFO:teuthology.orchestra.run.smithi163.stdout:Ubuntu 2020-01-26T15:30:27.270 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:30:27.270 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-01-26T15:30:27.270 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:30:27.271 INFO:teuthology.packaging:ref: None 2020-01-26T15:30:27.271 INFO:teuthology.packaging:tag: None 2020-01-26T15:30:27.271 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:30:27.271 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:30:27.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:30:27.438 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default/ 2020-01-26T15:30:27.439 INFO:teuthology.task.install.deb:Package version is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:30:27.505 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default/ 2020-01-26T15:30:27.506 INFO:teuthology.task.install.deb:Package version is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:30:27.558 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default/ 2020-01-26T15:30:27.558 INFO:teuthology.task.install.deb:Package version is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:30:27.563 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:30:27.610 INFO:teuthology.orchestra.run.smithi008:> sudo apt-get update 2020-01-26T15:30:27.631 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:30:27.677 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:30:27.679 INFO:teuthology.orchestra.run.smithi170:> sudo apt-get update 2020-01-26T15:30:27.725 INFO:teuthology.orchestra.run.smithi163:> sudo apt-get update 2020-01-26T15:30:27.890 INFO:teuthology.orchestra.run.smithi008.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:30:27.911 INFO:teuthology.orchestra.run.smithi008.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release [7,591 B] 2020-01-26T15:30:27.933 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:30:27.937 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:30:27.937 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:30:27.938 INFO:teuthology.orchestra.run.smithi008.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:30:27.954 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release [7,591 B] 2020-01-26T15:30:27.959 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main i386 Packages [433 B] 2020-01-26T15:30:27.976 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:30:27.989 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:30:27.992 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:30:27.993 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:5 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:30:27.995 INFO:teuthology.orchestra.run.smithi008.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 Packages [13.8 kB] 2020-01-26T15:30:27.997 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 Packages [13.8 kB] 2020-01-26T15:30:28.004 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:30:28.010 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release [7,591 B] 2020-01-26T15:30:28.032 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:30:28.032 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:30:28.034 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:30:28.035 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main i386 Packages [433 B] 2020-01-26T15:30:28.062 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:30:28.063 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 Packages [13.8 kB] 2020-01-26T15:30:28.085 INFO:teuthology.orchestra.run.smithi008.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:30:28.091 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main i386 Packages [433 B] 2020-01-26T15:30:28.101 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:30:28.142 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:30:28.181 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:30:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 21.8 kB in 1s (30.1 kB/s) 2020-01-26T15:30:28.594 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 21.8 kB in 1s (30.6 kB/s) 2020-01-26T15:30:28.637 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 21.8 kB in 1s (31.4 kB/s) 2020-01-26T15:30:29.745 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:30:29.757 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:30:29.784 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:30:29.793 INFO:teuthology.orchestra.run.smithi008:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.8-63-ge1c5fd9-1bionic ceph-mds=13.2.8-63-ge1c5fd9-1bionic ceph-mgr=13.2.8-63-ge1c5fd9-1bionic ceph-common=13.2.8-63-ge1c5fd9-1bionic ceph-fuse=13.2.8-63-ge1c5fd9-1bionic ceph-test=13.2.8-63-ge1c5fd9-1bionic radosgw=13.2.8-63-ge1c5fd9-1bionic python3-rados=13.2.8-63-ge1c5fd9-1bionic python3-rgw=13.2.8-63-ge1c5fd9-1bionic python3-cephfs=13.2.8-63-ge1c5fd9-1bionic python3-rbd=13.2.8-63-ge1c5fd9-1bionic libcephfs2=13.2.8-63-ge1c5fd9-1bionic libcephfs-dev=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic librbd1=13.2.8-63-ge1c5fd9-1bionic rbd-fuse=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:30:29.805 INFO:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.8-63-ge1c5fd9-1bionic ceph-mds=13.2.8-63-ge1c5fd9-1bionic ceph-mgr=13.2.8-63-ge1c5fd9-1bionic ceph-common=13.2.8-63-ge1c5fd9-1bionic ceph-fuse=13.2.8-63-ge1c5fd9-1bionic ceph-test=13.2.8-63-ge1c5fd9-1bionic radosgw=13.2.8-63-ge1c5fd9-1bionic python3-rados=13.2.8-63-ge1c5fd9-1bionic python3-rgw=13.2.8-63-ge1c5fd9-1bionic python3-cephfs=13.2.8-63-ge1c5fd9-1bionic python3-rbd=13.2.8-63-ge1c5fd9-1bionic libcephfs2=13.2.8-63-ge1c5fd9-1bionic libcephfs-dev=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic librbd1=13.2.8-63-ge1c5fd9-1bionic rbd-fuse=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:30:29.822 INFO:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.8-63-ge1c5fd9-1bionic ceph-mds=13.2.8-63-ge1c5fd9-1bionic ceph-mgr=13.2.8-63-ge1c5fd9-1bionic ceph-common=13.2.8-63-ge1c5fd9-1bionic ceph-fuse=13.2.8-63-ge1c5fd9-1bionic ceph-test=13.2.8-63-ge1c5fd9-1bionic radosgw=13.2.8-63-ge1c5fd9-1bionic python3-rados=13.2.8-63-ge1c5fd9-1bionic python3-rgw=13.2.8-63-ge1c5fd9-1bionic python3-cephfs=13.2.8-63-ge1c5fd9-1bionic python3-rbd=13.2.8-63-ge1c5fd9-1bionic libcephfs2=13.2.8-63-ge1c5fd9-1bionic libcephfs-dev=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic librbd1=13.2.8-63-ge1c5fd9-1bionic rbd-fuse=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:30:29.877 INFO:teuthology.orchestra.run.smithi008.stdout:Reading package lists... 2020-01-26T15:30:29.882 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:30:29.897 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2020-01-26T15:30:30.106 INFO:teuthology.orchestra.run.smithi008.stdout:Building dependency tree... 2020-01-26T15:30:30.106 INFO:teuthology.orchestra.run.smithi008.stdout:Reading state information... 2020-01-26T15:30:30.110 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2020-01-26T15:30:30.110 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2020-01-26T15:30:30.125 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2020-01-26T15:30:30.125 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2020-01-26T15:30:30.272 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2020-01-26T15:30:30.273 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-01-26T15:30:30.273 INFO:teuthology.orchestra.run.smithi170.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:30:30.274 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:30:30.274 INFO:teuthology.orchestra.run.smithi170.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:30:30.274 INFO:teuthology.orchestra.run.smithi170.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:30:30.275 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse socat xmlstarlet 2020-01-26T15:30:30.277 INFO:teuthology.orchestra.run.smithi008.stdout:The following additional packages will be installed: 2020-01-26T15:30:30.277 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-01-26T15:30:30.277 INFO:teuthology.orchestra.run.smithi008.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:30:30.277 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:30:30.278 INFO:teuthology.orchestra.run.smithi008.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi008.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse socat xmlstarlet 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi170.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi170.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi170.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-01-26T15:30:30.279 INFO:teuthology.orchestra.run.smithi170.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-01-26T15:30:30.280 INFO:teuthology.orchestra.run.smithi170.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-01-26T15:30:30.280 INFO:teuthology.orchestra.run.smithi170.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-01-26T15:30:30.280 INFO:teuthology.orchestra.run.smithi170.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-01-26T15:30:30.280 INFO:teuthology.orchestra.run.smithi170.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-01-26T15:30:30.281 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2020-01-26T15:30:30.281 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-01-26T15:30:30.281 INFO:teuthology.orchestra.run.smithi163.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:30:30.282 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:30:30.282 INFO:teuthology.orchestra.run.smithi163.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:30:30.282 INFO:teuthology.orchestra.run.smithi163.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:30:30.282 INFO:teuthology.orchestra.run.smithi163.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:30:30.282 INFO:teuthology.orchestra.run.smithi163.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:30:30.282 INFO:teuthology.orchestra.run.smithi163.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:30:30.283 INFO:teuthology.orchestra.run.smithi163.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:30:30.283 INFO:teuthology.orchestra.run.smithi163.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:30:30.283 INFO:teuthology.orchestra.run.smithi163.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:30:30.284 INFO:teuthology.orchestra.run.smithi163.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:30:30.284 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse socat xmlstarlet 2020-01-26T15:30:30.284 INFO:teuthology.orchestra.run.smithi008.stdout:Suggested packages: 2020-01-26T15:30:30.284 INFO:teuthology.orchestra.run.smithi008.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-01-26T15:30:30.284 INFO:teuthology.orchestra.run.smithi008.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-01-26T15:30:30.285 INFO:teuthology.orchestra.run.smithi008.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-01-26T15:30:30.285 INFO:teuthology.orchestra.run.smithi008.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-01-26T15:30:30.285 INFO:teuthology.orchestra.run.smithi008.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-01-26T15:30:30.285 INFO:teuthology.orchestra.run.smithi008.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-01-26T15:30:30.285 INFO:teuthology.orchestra.run.smithi008.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-01-26T15:30:30.285 INFO:teuthology.orchestra.run.smithi008.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-01-26T15:30:30.286 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2020-01-26T15:30:30.286 INFO:teuthology.orchestra.run.smithi163.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-01-26T15:30:30.287 INFO:teuthology.orchestra.run.smithi163.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-01-26T15:30:30.287 INFO:teuthology.orchestra.run.smithi163.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-01-26T15:30:30.287 INFO:teuthology.orchestra.run.smithi163.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-01-26T15:30:30.287 INFO:teuthology.orchestra.run.smithi163.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-01-26T15:30:30.288 INFO:teuthology.orchestra.run.smithi163.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-01-26T15:30:30.288 INFO:teuthology.orchestra.run.smithi163.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-01-26T15:30:30.288 INFO:teuthology.orchestra.run.smithi163.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-01-26T15:30:30.364 INFO:teuthology.orchestra.run.smithi008.stdout:The following NEW packages will be installed: 2020-01-26T15:30:30.364 INFO:teuthology.orchestra.run.smithi008.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:30:30.364 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-01-26T15:30:30.364 INFO:teuthology.orchestra.run.smithi008.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:30:30.365 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2020-01-26T15:30:30.365 INFO:teuthology.orchestra.run.smithi170.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:30:30.365 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-01-26T15:30:30.365 INFO:teuthology.orchestra.run.smithi170.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:30:30.365 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:30:30.365 INFO:teuthology.orchestra.run.smithi170.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:30:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:30:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:30:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:30:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:30:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:30:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:30:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:30:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:30:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-01-26T15:30:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: radosgw rbd-fuse socat xmlstarlet 2020-01-26T15:30:30.367 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages will be upgraded: 2020-01-26T15:30:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 librbd1 2020-01-26T15:30:30.369 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2020-01-26T15:30:30.369 INFO:teuthology.orchestra.run.smithi163.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:30:30.370 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-01-26T15:30:30.370 INFO:teuthology.orchestra.run.smithi163.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:30:30.370 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:30:30.370 INFO:teuthology.orchestra.run.smithi163.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:30:30.370 INFO:teuthology.orchestra.run.smithi163.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:30:30.370 INFO:teuthology.orchestra.run.smithi163.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:30:30.371 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi163.stdout: radosgw rbd-fuse socat xmlstarlet 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 librbd1 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi008.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi008.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:30:30.372 INFO:teuthology.orchestra.run.smithi008.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:30:30.373 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-01-26T15:30:30.374 INFO:teuthology.orchestra.run.smithi008.stdout: radosgw rbd-fuse socat xmlstarlet 2020-01-26T15:30:30.374 INFO:teuthology.orchestra.run.smithi008.stdout:The following packages will be upgraded: 2020-01-26T15:30:30.374 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 librbd1 2020-01-26T15:30:30.511 INFO:teuthology.orchestra.run.smithi008.stdout:2 upgraded, 74 newly installed, 0 to remove and 53 not upgraded. 2020-01-26T15:30:30.511 INFO:teuthology.orchestra.run.smithi008.stdout:Need to get 76.1 MB of archives. 2020-01-26T15:30:30.511 INFO:teuthology.orchestra.run.smithi008.stdout:After this operation, 304 MB of additional disk space will be used. 2020-01-26T15:30:30.512 INFO:teuthology.orchestra.run.smithi008.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.8-63-ge1c5fd9-1bionic [1,101 kB] 2020-01-26T15:30:30.519 INFO:teuthology.orchestra.run.smithi163.stdout:2 upgraded, 74 newly installed, 0 to remove and 53 not upgraded. 2020-01-26T15:30:30.519 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 76.1 MB of archives. 2020-01-26T15:30:30.520 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 304 MB of additional disk space will be used. 2020-01-26T15:30:30.520 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.8-63-ge1c5fd9-1bionic [1,101 kB] 2020-01-26T15:30:30.520 INFO:teuthology.orchestra.run.smithi170.stdout:2 upgraded, 74 newly installed, 0 to remove and 53 not upgraded. 2020-01-26T15:30:30.520 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 76.1 MB of archives. 2020-01-26T15:30:30.520 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 304 MB of additional disk space will be used. 2020-01-26T15:30:30.520 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.8-63-ge1c5fd9-1bionic [1,101 kB] 2020-01-26T15:30:30.550 INFO:teuthology.orchestra.run.smithi008.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-26T15:30:30.553 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-26T15:30:30.559 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-26T15:30:30.680 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.8-63-ge1c5fd9-1bionic [2,642 kB] 2020-01-26T15:30:30.683 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.8-63-ge1c5fd9-1bionic [2,642 kB] 2020-01-26T15:30:30.694 INFO:teuthology.orchestra.run.smithi008.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.8-63-ge1c5fd9-1bionic [2,642 kB] 2020-01-26T15:30:30.912 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-01-26T15:30:30.913 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-01-26T15:30:30.913 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.8-63-ge1c5fd9-1bionic [393 kB] 2020-01-26T15:30:30.935 INFO:teuthology.orchestra.run.smithi008.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.8-63-ge1c5fd9-1bionic [393 kB] 2020-01-26T15:30:30.947 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.8-63-ge1c5fd9-1bionic [293 kB] 2020-01-26T15:30:30.949 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.8-63-ge1c5fd9-1bionic [393 kB] 2020-01-26T15:30:30.949 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-01-26T15:30:30.953 INFO:teuthology.orchestra.run.smithi008.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-01-26T15:30:30.956 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-01-26T15:30:30.959 INFO:teuthology.orchestra.run.smithi008.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-01-26T15:30:30.969 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-01-26T15:30:30.970 INFO:teuthology.orchestra.run.smithi008.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.8-63-ge1c5fd9-1bionic [293 kB] 2020-01-26T15:30:30.979 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.0 kB] 2020-01-26T15:30:30.979 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [95.9 kB] 2020-01-26T15:30:30.983 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [182 kB] 2020-01-26T15:30:30.986 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.8-63-ge1c5fd9-1bionic [293 kB] 2020-01-26T15:30:31.004 INFO:teuthology.orchestra.run.smithi008.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.0 kB] 2020-01-26T15:30:31.005 INFO:teuthology.orchestra.run.smithi008.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [95.9 kB] 2020-01-26T15:30:31.019 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.8-63-ge1c5fd9-1bionic [1,896 kB] 2020-01-26T15:30:31.019 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-01-26T15:30:31.019 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-01-26T15:30:31.019 INFO:teuthology.orchestra.run.smithi008.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [182 kB] 2020-01-26T15:30:31.019 INFO:teuthology.orchestra.run.smithi008.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-01-26T15:30:31.020 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.0 kB] 2020-01-26T15:30:31.021 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [95.9 kB] 2020-01-26T15:30:31.025 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [182 kB] 2020-01-26T15:30:31.030 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.8-63-ge1c5fd9-1bionic [1,896 kB] 2020-01-26T15:30:31.039 INFO:teuthology.orchestra.run.smithi008.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.8-63-ge1c5fd9-1bionic [1,896 kB] 2020-01-26T15:30:31.044 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-01-26T15:30:31.057 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-26T15:30:31.058 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-01-26T15:30:31.061 INFO:teuthology.orchestra.run.smithi008.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-01-26T15:30:31.084 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-26T15:30:31.087 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-01-26T15:30:31.087 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-26T15:30:31.089 INFO:teuthology.orchestra.run.smithi008.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-01-26T15:30:31.104 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-26T15:30:31.105 INFO:teuthology.orchestra.run.smithi008.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-26T15:30:31.109 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:30:31.114 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-26T15:30:31.117 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-26T15:30:31.118 INFO:teuthology.orchestra.run.smithi008.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-26T15:30:31.124 INFO:teuthology.orchestra.run.smithi008.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-26T15:30:31.132 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-01-26T15:30:31.142 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:30:31.142 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-01-26T15:30:31.147 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-01-26T15:30:31.148 INFO:teuthology.orchestra.run.smithi008.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:30:31.150 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:30:31.154 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-01-26T15:30:31.164 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:30:31.165 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-01-26T15:30:31.167 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-01-26T15:30:31.173 INFO:teuthology.orchestra.run.smithi008.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-01-26T15:30:31.175 INFO:teuthology.orchestra.run.smithi008.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-01-26T15:30:31.181 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-01-26T15:30:31.184 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:30:31.188 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.8-63-ge1c5fd9-1bionic [316 kB] 2020-01-26T15:30:31.189 INFO:teuthology.orchestra.run.smithi008.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-01-26T15:30:31.192 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:30:31.193 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-01-26T15:30:31.196 INFO:teuthology.orchestra.run.smithi008.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:30:31.197 INFO:teuthology.orchestra.run.smithi008.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-01-26T15:30:31.200 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:30:31.204 INFO:teuthology.orchestra.run.smithi008.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:30:31.215 INFO:teuthology.orchestra.run.smithi008.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:30:31.219 INFO:teuthology.orchestra.run.smithi008.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.8-63-ge1c5fd9-1bionic [316 kB] 2020-01-26T15:30:31.228 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.8-63-ge1c5fd9-1bionic [12.1 MB] 2020-01-26T15:30:31.230 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-01-26T15:30:31.231 INFO:teuthology.orchestra.run.smithi170.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-01-26T15:30:31.235 INFO:teuthology.orchestra.run.smithi170.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:30:31.237 INFO:teuthology.orchestra.run.smithi170.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-01-26T15:30:31.239 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:30:31.247 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.8-63-ge1c5fd9-1bionic [316 kB] 2020-01-26T15:30:31.248 INFO:teuthology.orchestra.run.smithi170.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-01-26T15:30:31.262 INFO:teuthology.orchestra.run.smithi008.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.8-63-ge1c5fd9-1bionic [12.1 MB] 2020-01-26T15:30:31.274 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-01-26T15:30:31.274 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-01-26T15:30:31.277 INFO:teuthology.orchestra.run.smithi008.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-01-26T15:30:31.279 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:30:31.279 INFO:teuthology.orchestra.run.smithi008.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-01-26T15:30:31.281 INFO:teuthology.orchestra.run.smithi008.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:30:31.281 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-01-26T15:30:31.284 INFO:teuthology.orchestra.run.smithi008.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-01-26T15:30:31.285 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-01-26T15:30:31.287 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.8-63-ge1c5fd9-1bionic [12.1 MB] 2020-01-26T15:30:31.288 INFO:teuthology.orchestra.run.smithi008.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-01-26T15:30:31.405 INFO:teuthology.orchestra.run.smithi170.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-01-26T15:30:31.450 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-01-26T15:30:31.453 INFO:teuthology.orchestra.run.smithi008.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-01-26T15:30:31.713 INFO:teuthology.orchestra.run.smithi170.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-01-26T15:30:31.714 INFO:teuthology.orchestra.run.smithi170.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-01-26T15:30:31.738 INFO:teuthology.orchestra.run.smithi170.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:30:31.749 INFO:teuthology.orchestra.run.smithi170.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:30:31.776 INFO:teuthology.orchestra.run.smithi008.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-01-26T15:30:31.777 INFO:teuthology.orchestra.run.smithi008.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-01-26T15:30:31.787 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-01-26T15:30:31.789 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-01-26T15:30:31.832 INFO:teuthology.orchestra.run.smithi008.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:30:31.833 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:30:31.841 INFO:teuthology.orchestra.run.smithi008.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:30:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:30:31.947 INFO:teuthology.orchestra.run.smithi170.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-26T15:30:31.947 INFO:teuthology.orchestra.run.smithi170.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-01-26T15:30:31.953 INFO:teuthology.orchestra.run.smithi170.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-01-26T15:30:31.958 INFO:teuthology.orchestra.run.smithi170.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:30:31.972 INFO:teuthology.orchestra.run.smithi170.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-01-26T15:30:31.976 INFO:teuthology.orchestra.run.smithi170.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:30:32.002 INFO:teuthology.orchestra.run.smithi170.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-26T15:30:32.018 INFO:teuthology.orchestra.run.smithi170.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-26T15:30:32.030 INFO:teuthology.orchestra.run.smithi008.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-26T15:30:32.030 INFO:teuthology.orchestra.run.smithi008.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-01-26T15:30:32.031 INFO:teuthology.orchestra.run.smithi170.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-26T15:30:32.034 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-26T15:30:32.035 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-01-26T15:30:32.035 INFO:teuthology.orchestra.run.smithi008.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-01-26T15:30:32.036 INFO:teuthology.orchestra.run.smithi170.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-26T15:30:32.040 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-01-26T15:30:32.041 INFO:teuthology.orchestra.run.smithi008.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:30:32.044 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:30:32.053 INFO:teuthology.orchestra.run.smithi008.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-01-26T15:30:32.057 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-01-26T15:30:32.058 INFO:teuthology.orchestra.run.smithi008.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:30:32.062 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:30:32.082 INFO:teuthology.orchestra.run.smithi008.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-26T15:30:32.089 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-26T15:30:32.094 INFO:teuthology.orchestra.run.smithi008.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-26T15:30:32.097 INFO:teuthology.orchestra.run.smithi163.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-26T15:30:32.110 INFO:teuthology.orchestra.run.smithi170.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-26T15:30:32.126 INFO:teuthology.orchestra.run.smithi008.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-26T15:30:32.126 INFO:teuthology.orchestra.run.smithi008.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-26T15:30:32.127 INFO:teuthology.orchestra.run.smithi163.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-26T15:30:32.127 INFO:teuthology.orchestra.run.smithi163.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-26T15:30:32.127 INFO:teuthology.orchestra.run.smithi170.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-26T15:30:32.133 INFO:teuthology.orchestra.run.smithi170.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-01-26T15:30:32.135 INFO:teuthology.orchestra.run.smithi170.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-01-26T15:30:32.138 INFO:teuthology.orchestra.run.smithi170.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-01-26T15:30:32.139 INFO:teuthology.orchestra.run.smithi170.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-01-26T15:30:32.193 INFO:teuthology.orchestra.run.smithi008.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-26T15:30:32.197 INFO:teuthology.orchestra.run.smithi163.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-26T15:30:32.200 INFO:teuthology.orchestra.run.smithi008.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-26T15:30:32.204 INFO:teuthology.orchestra.run.smithi163.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-26T15:30:32.219 INFO:teuthology.orchestra.run.smithi008.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-01-26T15:30:32.221 INFO:teuthology.orchestra.run.smithi008.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-01-26T15:30:32.223 INFO:teuthology.orchestra.run.smithi163.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-01-26T15:30:32.224 INFO:teuthology.orchestra.run.smithi008.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-01-26T15:30:32.225 INFO:teuthology.orchestra.run.smithi008.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-01-26T15:30:32.225 INFO:teuthology.orchestra.run.smithi163.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-01-26T15:30:32.229 INFO:teuthology.orchestra.run.smithi163.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-01-26T15:30:32.229 INFO:teuthology.orchestra.run.smithi163.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-01-26T15:30:32.303 INFO:teuthology.orchestra.run.smithi170.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-01-26T15:30:32.390 INFO:teuthology.orchestra.run.smithi008.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-01-26T15:30:32.395 INFO:teuthology.orchestra.run.smithi163.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-01-26T15:30:32.409 INFO:teuthology.orchestra.run.smithi170.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.8-63-ge1c5fd9-1bionic [3,687 kB] 2020-01-26T15:30:32.464 INFO:teuthology.orchestra.run.smithi008.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.8-63-ge1c5fd9-1bionic [3,687 kB] 2020-01-26T15:30:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.8-63-ge1c5fd9-1bionic [3,687 kB] 2020-01-26T15:30:32.737 INFO:teuthology.orchestra.run.smithi170.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.8-63-ge1c5fd9-1bionic [2,757 kB] 2020-01-26T15:30:32.833 INFO:teuthology.orchestra.run.smithi008.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.8-63-ge1c5fd9-1bionic [2,757 kB] 2020-01-26T15:30:32.886 INFO:teuthology.orchestra.run.smithi163.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.8-63-ge1c5fd9-1bionic [2,757 kB] 2020-01-26T15:30:32.897 INFO:teuthology.orchestra.run.smithi170.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-01-26T15:30:32.902 INFO:teuthology.orchestra.run.smithi170.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-01-26T15:30:32.904 INFO:teuthology.orchestra.run.smithi170.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-01-26T15:30:32.905 INFO:teuthology.orchestra.run.smithi170.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-01-26T15:30:32.906 INFO:teuthology.orchestra.run.smithi170.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-01-26T15:30:32.908 INFO:teuthology.orchestra.run.smithi170.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-01-26T15:30:32.998 INFO:teuthology.orchestra.run.smithi170.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.8-63-ge1c5fd9-1bionic [2,965 kB] 2020-01-26T15:30:33.001 INFO:teuthology.orchestra.run.smithi008.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-01-26T15:30:33.005 INFO:teuthology.orchestra.run.smithi008.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-01-26T15:30:33.009 INFO:teuthology.orchestra.run.smithi163.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-01-26T15:30:33.009 INFO:teuthology.orchestra.run.smithi008.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-01-26T15:30:33.010 INFO:teuthology.orchestra.run.smithi008.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-01-26T15:30:33.010 INFO:teuthology.orchestra.run.smithi008.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-01-26T15:30:33.013 INFO:teuthology.orchestra.run.smithi163.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-01-26T15:30:33.015 INFO:teuthology.orchestra.run.smithi008.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-01-26T15:30:33.016 INFO:teuthology.orchestra.run.smithi163.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-01-26T15:30:33.017 INFO:teuthology.orchestra.run.smithi163.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-01-26T15:30:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-01-26T15:30:33.023 INFO:teuthology.orchestra.run.smithi163.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-01-26T15:30:33.098 INFO:teuthology.orchestra.run.smithi008.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.8-63-ge1c5fd9-1bionic [2,965 kB] 2020-01-26T15:30:33.156 INFO:teuthology.orchestra.run.smithi163.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.8-63-ge1c5fd9-1bionic [2,965 kB] 2020-01-26T15:30:33.274 INFO:teuthology.orchestra.run.smithi170.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.8-63-ge1c5fd9-1bionic [13.4 MB] 2020-01-26T15:30:33.375 INFO:teuthology.orchestra.run.smithi008.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.8-63-ge1c5fd9-1bionic [13.4 MB] 2020-01-26T15:30:33.488 INFO:teuthology.orchestra.run.smithi163.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.8-63-ge1c5fd9-1bionic [13.4 MB] 2020-01-26T15:30:34.568 INFO:teuthology.orchestra.run.smithi170.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.8-63-ge1c5fd9-1bionic [3,892 B] 2020-01-26T15:30:34.568 INFO:teuthology.orchestra.run.smithi170.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [465 kB] 2020-01-26T15:30:34.630 INFO:teuthology.orchestra.run.smithi170.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.8-63-ge1c5fd9-1bionic [1,660 kB] 2020-01-26T15:30:34.685 INFO:teuthology.orchestra.run.smithi008.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.8-63-ge1c5fd9-1bionic [3,892 B] 2020-01-26T15:30:34.686 INFO:teuthology.orchestra.run.smithi008.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [465 kB] 2020-01-26T15:30:34.698 INFO:teuthology.orchestra.run.smithi008.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.8-63-ge1c5fd9-1bionic [1,660 kB] 2020-01-26T15:30:34.785 INFO:teuthology.orchestra.run.smithi170.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.8-63-ge1c5fd9-1bionic [22.8 MB] 2020-01-26T15:30:34.858 INFO:teuthology.orchestra.run.smithi163.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.8-63-ge1c5fd9-1bionic [3,892 B] 2020-01-26T15:30:34.869 INFO:teuthology.orchestra.run.smithi163.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [465 kB] 2020-01-26T15:30:34.896 INFO:teuthology.orchestra.run.smithi163.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.8-63-ge1c5fd9-1bionic [1,660 kB] 2020-01-26T15:30:34.905 INFO:teuthology.orchestra.run.smithi008.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.8-63-ge1c5fd9-1bionic [22.8 MB] 2020-01-26T15:30:35.056 INFO:teuthology.orchestra.run.smithi163.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.8-63-ge1c5fd9-1bionic [22.8 MB] 2020-01-26T15:30:36.858 INFO:teuthology.orchestra.run.smithi008.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.8-63-ge1c5fd9-1bionic [16.4 kB] 2020-01-26T15:30:36.859 INFO:teuthology.orchestra.run.smithi008.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.3 kB] 2020-01-26T15:30:36.859 INFO:teuthology.orchestra.run.smithi008.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.8-63-ge1c5fd9-1bionic [313 kB] 2020-01-26T15:30:36.908 INFO:teuthology.orchestra.run.smithi008.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:30:36.911 INFO:teuthology.orchestra.run.smithi008.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [185 kB] 2020-01-26T15:30:36.917 INFO:teuthology.orchestra.run.smithi008.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [106 kB] 2020-01-26T15:30:36.920 INFO:teuthology.orchestra.run.smithi008.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.8-63-ge1c5fd9-1bionic [3,287 kB] 2020-01-26T15:30:37.100 INFO:teuthology.orchestra.run.smithi170.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.8-63-ge1c5fd9-1bionic [16.4 kB] 2020-01-26T15:30:37.100 INFO:teuthology.orchestra.run.smithi170.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.3 kB] 2020-01-26T15:30:37.101 INFO:teuthology.orchestra.run.smithi170.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.8-63-ge1c5fd9-1bionic [313 kB] 2020-01-26T15:30:37.150 INFO:teuthology.orchestra.run.smithi170.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:30:37.153 INFO:teuthology.orchestra.run.smithi170.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [185 kB] 2020-01-26T15:30:37.165 INFO:teuthology.orchestra.run.smithi170.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [106 kB] 2020-01-26T15:30:37.175 INFO:teuthology.orchestra.run.smithi170.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.8-63-ge1c5fd9-1bionic [3,287 kB] 2020-01-26T15:30:37.193 INFO:teuthology.orchestra.run.smithi008.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [13.8 kB] 2020-01-26T15:30:37.399 INFO:teuthology.orchestra.run.smithi170.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [13.8 kB] 2020-01-26T15:30:37.420 INFO:teuthology.orchestra.run.smithi163.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.8-63-ge1c5fd9-1bionic [16.4 kB] 2020-01-26T15:30:37.420 INFO:teuthology.orchestra.run.smithi163.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.3 kB] 2020-01-26T15:30:37.420 INFO:teuthology.orchestra.run.smithi163.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.8-63-ge1c5fd9-1bionic [313 kB] 2020-01-26T15:30:37.429 INFO:teuthology.orchestra.run.smithi163.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:30:37.432 INFO:teuthology.orchestra.run.smithi163.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [185 kB] 2020-01-26T15:30:37.440 INFO:teuthology.orchestra.run.smithi163.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [106 kB] 2020-01-26T15:30:37.441 INFO:teuthology.orchestra.run.smithi163.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.8-63-ge1c5fd9-1bionic [3,287 kB] 2020-01-26T15:30:37.550 INFO:teuthology.orchestra.run.smithi163.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [13.8 kB] 2020-01-26T15:30:37.800 INFO:teuthology.orchestra.run.smithi008.stdout:Fetched 76.1 MB in 7s (11.2 MB/s) 2020-01-26T15:30:37.946 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-26T15:30:37.977 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 76.1 MB in 7s (10.9 MB/s) 2020-01-26T15:30:37.999 INFO:teuthology.orchestra.run.smithi008.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-26T15:30:38.003 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-26T15:30:38.086 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:30:38.134 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 76.1 MB in 7s (10.6 MB/s) 2020-01-26T15:30:38.148 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-26T15:30:38.199 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-26T15:30:38.203 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-26T15:30:38.289 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:30:38.298 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-26T15:30:38.349 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-26T15:30:38.352 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-26T15:30:38.429 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../01-librbd1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:38.439 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:30:38.557 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librbd1 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:30:38.631 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../01-librbd1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:38.766 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../01-librbd1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:38.768 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librbd1 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:30:38.893 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librbd1 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:30:38.993 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../02-librados2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:39.136 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librados2 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:30:39.268 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../02-librados2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:39.338 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../02-librados2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:39.397 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librados2 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:30:39.481 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librados2 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:30:39.756 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libcephfs2. 2020-01-26T15:30:39.771 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../03-libcephfs2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:39.816 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.000 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libcephfs2. 2020-01-26T15:30:40.014 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../03-libcephfs2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.059 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.067 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-rados. 2020-01-26T15:30:40.069 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs2. 2020-01-26T15:30:40.080 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../04-python-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.085 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../03-libcephfs2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.117 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.127 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.345 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-rados. 2020-01-26T15:30:40.358 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../04-python-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.386 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-ceph-argparse. 2020-01-26T15:30:40.402 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.403 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.422 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-rados. 2020-01-26T15:30:40.436 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../04-python-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.445 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.480 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.689 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-ceph-argparse. 2020-01-26T15:30:40.702 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.747 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-cephfs. 2020-01-26T15:30:40.747 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.761 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../06-python-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.782 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-ceph-argparse. 2020-01-26T15:30:40.796 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:40.797 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:40.841 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:41.051 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-cephfs. 2020-01-26T15:30:41.066 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../06-python-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:41.108 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-prettytable. 2020-01-26T15:30:41.109 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:41.124 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:30:41.168 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-01-26T15:30:41.177 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-cephfs. 2020-01-26T15:30:41.192 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../06-python-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:41.235 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:41.411 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-prettytable. 2020-01-26T15:30:41.427 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:30:41.428 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-rbd. 2020-01-26T15:30:41.444 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../08-python-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:41.472 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-01-26T15:30:41.478 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:41.564 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-prettytable. 2020-01-26T15:30:41.579 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:30:41.626 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-01-26T15:30:41.739 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-rbd. 2020-01-26T15:30:41.753 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../08-python-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:41.797 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:41.798 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-certifi. 2020-01-26T15:30:41.813 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-01-26T15:30:41.856 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-01-26T15:30:41.883 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-rbd. 2020-01-26T15:30:41.897 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../08-python-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:41.933 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:42.125 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-certifi. 2020-01-26T15:30:42.140 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-01-26T15:30:42.180 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-chardet. 2020-01-26T15:30:42.183 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-01-26T15:30:42.189 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-01-26T15:30:42.225 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-01-26T15:30:42.279 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-certifi. 2020-01-26T15:30:42.294 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-01-26T15:30:42.337 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-01-26T15:30:42.528 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-chardet. 2020-01-26T15:30:42.541 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-01-26T15:30:42.578 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-01-26T15:30:42.604 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-urllib3. 2020-01-26T15:30:42.617 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:30:42.654 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:30:42.657 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-chardet. 2020-01-26T15:30:42.672 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-01-26T15:30:42.715 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-01-26T15:30:42.957 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-urllib3. 2020-01-26T15:30:42.970 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:30:42.990 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-requests. 2020-01-26T15:30:43.005 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-01-26T15:30:43.007 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:30:43.028 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-urllib3. 2020-01-26T15:30:43.044 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:30:43.049 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:30:43.077 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:30:43.310 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-requests. 2020-01-26T15:30:43.326 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-01-26T15:30:43.368 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package librgw2. 2020-01-26T15:30:43.369 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:30:43.382 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../13-librgw2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:43.418 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:43.465 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-requests. 2020-01-26T15:30:43.479 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-01-26T15:30:43.523 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:30:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librgw2. 2020-01-26T15:30:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../13-librgw2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:43.729 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:43.837 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-rgw. 2020-01-26T15:30:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../14-python-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:43.869 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librgw2. 2020-01-26T15:30:43.883 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../13-librgw2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:43.896 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:43.927 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:44.166 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-rgw. 2020-01-26T15:30:44.181 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../14-python-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:44.223 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:44.283 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package liboath0. 2020-01-26T15:30:44.297 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-01-26T15:30:44.338 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-rgw. 2020-01-26T15:30:44.340 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-26T15:30:44.353 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../14-python-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:44.388 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:44.593 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liboath0. 2020-01-26T15:30:44.610 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-01-26T15:30:44.651 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-26T15:30:44.660 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libradosstriper1. 2020-01-26T15:30:44.673 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../16-libradosstriper1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:44.710 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:44.766 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liboath0. 2020-01-26T15:30:44.780 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-01-26T15:30:44.824 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-26T15:30:44.912 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libradosstriper1. 2020-01-26T15:30:44.928 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../16-libradosstriper1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:44.971 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:45.113 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-common. 2020-01-26T15:30:45.129 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../17-ceph-common_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:45.140 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libradosstriper1. 2020-01-26T15:30:45.151 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../16-libradosstriper1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:45.171 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:45.185 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:45.407 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-common. 2020-01-26T15:30:45.420 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../17-ceph-common_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:45.463 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:45.556 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-common. 2020-01-26T15:30:45.572 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../17-ceph-common_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:45.631 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:46.393 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-26T15:30:46.408 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-26T15:30:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:30:46.654 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-26T15:30:46.669 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-26T15:30:46.704 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:30:46.713 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-26T15:30:46.726 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-26T15:30:46.763 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:30:46.870 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-26T15:30:46.884 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-26T15:30:46.912 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:30:47.007 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-26T15:30:47.022 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-26T15:30:47.065 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:30:47.198 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-26T15:30:47.212 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-26T15:30:47.216 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-base. 2020-01-26T15:30:47.231 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../20-ceph-base_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:47.248 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:30:47.283 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:47.519 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-base. 2020-01-26T15:30:47.533 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../20-ceph-base_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:47.586 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:47.972 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-cherrypy3. 2020-01-26T15:30:47.989 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:30:48.030 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:30:48.069 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-base. 2020-01-26T15:30:48.084 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../20-ceph-base_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:48.136 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:48.483 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-markupsafe. 2020-01-26T15:30:48.499 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:30:48.550 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-01-26T15:30:48.617 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-cherrypy3. 2020-01-26T15:30:48.630 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:30:48.667 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:30:48.858 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-cherrypy3. 2020-01-26T15:30:48.861 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-jinja2. 2020-01-26T15:30:48.874 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:30:48.875 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:30:48.908 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:30:48.919 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:30:49.029 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-markupsafe. 2020-01-26T15:30:49.042 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:30:49.087 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-01-26T15:30:49.187 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-markupsafe. 2020-01-26T15:30:49.203 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:30:49.237 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-01-26T15:30:49.352 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-openssl. 2020-01-26T15:30:49.369 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:30:49.381 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-jinja2. 2020-01-26T15:30:49.396 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:30:49.406 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:30:49.440 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:30:49.515 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-jinja2. 2020-01-26T15:30:49.528 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:30:49.565 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:30:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-logutils. 2020-01-26T15:30:49.733 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-01-26T15:30:49.783 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-01-26T15:30:49.809 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-openssl. 2020-01-26T15:30:49.824 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:30:49.868 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:30:49.943 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-openssl. 2020-01-26T15:30:49.958 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:30:50.002 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:30:50.092 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-mako. 2020-01-26T15:30:50.100 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:30:50.153 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-01-26T15:30:50.196 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-logutils. 2020-01-26T15:30:50.210 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-01-26T15:30:50.254 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-01-26T15:30:50.330 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-logutils. 2020-01-26T15:30:50.344 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-01-26T15:30:50.405 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-01-26T15:30:50.515 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-simplegeneric. 2020-01-26T15:30:50.534 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:30:50.540 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-mako. 2020-01-26T15:30:50.555 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:30:50.581 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-01-26T15:30:50.606 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-01-26T15:30:50.699 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-mako. 2020-01-26T15:30:50.713 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:30:50.750 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-01-26T15:30:50.875 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-singledispatch. 2020-01-26T15:30:50.892 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:30:50.934 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:30:50.968 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-simplegeneric. 2020-01-26T15:30:50.981 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:30:51.035 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-01-26T15:30:51.094 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-simplegeneric. 2020-01-26T15:30:51.108 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:30:51.153 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-01-26T15:30:51.236 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-simplejson. 2020-01-26T15:30:51.252 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:30:51.303 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-01-26T15:30:51.354 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-singledispatch. 2020-01-26T15:30:51.369 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:30:51.412 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:30:51.498 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-singledispatch. 2020-01-26T15:30:51.512 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:30:51.556 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:30:51.656 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-webob. 2020-01-26T15:30:51.669 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:30:51.706 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:30:51.707 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-simplejson. 2020-01-26T15:30:51.721 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:30:51.765 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-01-26T15:30:51.834 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-simplejson. 2020-01-26T15:30:51.850 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:30:51.892 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-01-26T15:30:52.042 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-bs4. 2020-01-26T15:30:52.055 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-01-26T15:30:52.092 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-01-26T15:30:52.093 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-webob. 2020-01-26T15:30:52.106 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:30:52.151 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:30:52.237 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-webob. 2020-01-26T15:30:52.253 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:30:52.296 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:30:52.420 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-waitress. 2020-01-26T15:30:52.433 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-01-26T15:30:52.462 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-bs4. 2020-01-26T15:30:52.478 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-01-26T15:30:52.487 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-01-26T15:30:52.520 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-01-26T15:30:52.715 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-bs4. 2020-01-26T15:30:52.731 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-01-26T15:30:52.774 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-01-26T15:30:52.832 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-dnspython. 2020-01-26T15:30:52.844 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-waitress. 2020-01-26T15:30:52.845 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-01-26T15:30:52.856 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-01-26T15:30:52.890 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-01-26T15:30:52.898 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-01-26T15:30:53.102 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-waitress. 2020-01-26T15:30:53.116 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-01-26T15:30:53.160 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-01-26T15:30:53.174 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package formencode-i18n. 2020-01-26T15:30:53.190 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:30:53.209 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-dnspython. 2020-01-26T15:30:53.225 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-01-26T15:30:53.233 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:30:53.276 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-01-26T15:30:53.489 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-dnspython. 2020-01-26T15:30:53.505 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-01-26T15:30:53.517 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-formencode. 2020-01-26T15:30:53.533 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:30:53.547 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-01-26T15:30:53.575 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:30:53.581 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package formencode-i18n. 2020-01-26T15:30:53.597 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:30:53.641 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:30:53.834 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package formencode-i18n. 2020-01-26T15:30:53.847 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:30:53.884 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:30:53.930 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-tempita. 2020-01-26T15:30:53.934 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-formencode. 2020-01-26T15:30:53.944 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-01-26T15:30:53.948 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:30:53.994 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:30:53.997 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-01-26T15:30:54.191 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-formencode. 2020-01-26T15:30:54.208 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:30:54.244 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:30:54.342 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-paste. 2020-01-26T15:30:54.343 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-tempita. 2020-01-26T15:30:54.360 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-01-26T15:30:54.361 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:30:54.396 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-01-26T15:30:54.400 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:30:54.602 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-tempita. 2020-01-26T15:30:54.616 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-01-26T15:30:54.660 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-01-26T15:30:54.727 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-paste. 2020-01-26T15:30:54.742 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:30:54.794 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:30:54.804 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-26T15:30:54.820 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-26T15:30:54.872 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:30:55.013 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-paste. 2020-01-26T15:30:55.027 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:30:55.073 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:30:55.127 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-26T15:30:55.143 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-26T15:30:55.186 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:30:55.196 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-pastedeploy. 2020-01-26T15:30:55.211 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:30:55.263 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-01-26T15:30:55.403 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-26T15:30:55.417 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-26T15:30:55.469 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:30:55.483 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pastedeploy. 2020-01-26T15:30:55.492 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:30:55.539 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-01-26T15:30:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-webtest. 2020-01-26T15:30:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:30:55.664 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:30:55.799 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastedeploy. 2020-01-26T15:30:55.813 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:30:55.855 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-webtest. 2020-01-26T15:30:55.858 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-01-26T15:30:55.870 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:30:55.914 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:30:56.030 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-pecan. 2020-01-26T15:30:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-01-26T15:30:56.089 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-01-26T15:30:56.207 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-webtest. 2020-01-26T15:30:56.222 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:30:56.265 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:30:56.466 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-bcrypt. 2020-01-26T15:30:56.480 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:30:56.506 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pecan. 2020-01-26T15:30:56.533 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-01-26T15:30:56.537 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-01-26T15:30:56.665 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pecan. 2020-01-26T15:30:56.679 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-01-26T15:30:56.730 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-01-26T15:30:56.781 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-01-26T15:30:56.851 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-werkzeug. 2020-01-26T15:30:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:30:56.906 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:30:57.108 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-bcrypt. 2020-01-26T15:30:57.123 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:30:57.157 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-bcrypt. 2020-01-26T15:30:57.165 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-01-26T15:30:57.174 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:30:57.223 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-01-26T15:30:57.339 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mgr. 2020-01-26T15:30:57.353 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../44-ceph-mgr_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:57.398 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:57.480 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-werkzeug. 2020-01-26T15:30:57.495 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:30:57.539 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:30:57.565 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-werkzeug. 2020-01-26T15:30:57.578 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:30:57.625 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:30:57.936 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr. 2020-01-26T15:30:57.949 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../44-ceph-mgr_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:57.987 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr. 2020-01-26T15:30:58.047 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../44-ceph-mgr_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:58.091 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:58.240 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mon. 2020-01-26T15:30:58.253 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../45-ceph-mon_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:58.298 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mon. 2020-01-26T15:30:58.788 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../45-ceph-mon_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:58.832 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:58.867 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mon. 2020-01-26T15:30:58.881 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../45-ceph-mon_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:58.925 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:58.960 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-osd. 2020-01-26T15:30:58.977 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../46-ceph-osd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:59.018 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:59.586 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-osd. 2020-01-26T15:30:59.602 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../46-ceph-osd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:59.644 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:30:59.653 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-osd. 2020-01-26T15:30:59.668 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../46-ceph-osd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:30:59.720 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph. 2020-01-26T15:31:00.304 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../47-ceph_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:00.356 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-fuse. 2020-01-26T15:31:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../48-ceph-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:00.734 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:00.882 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph. 2020-01-26T15:31:00.896 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../47-ceph_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:00.940 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:00.983 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph. 2020-01-26T15:31:00.998 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../47-ceph_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:01.041 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:01.137 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-mds. 2020-01-26T15:31:01.151 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../49-ceph-mds_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:01.189 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:01.262 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-fuse. 2020-01-26T15:31:01.273 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../48-ceph-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:01.309 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:01.360 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-fuse. 2020-01-26T15:31:01.376 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../48-ceph-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:01.419 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:01.707 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-26T15:31:01.721 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mds. 2020-01-26T15:31:01.724 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-01-26T15:31:01.735 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../49-ceph-mds_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:01.765 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:31:01.779 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:02.102 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-26T15:31:02.118 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:31:02.194 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:31:02.258 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-26T15:31:02.272 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-01-26T15:31:02.316 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:31:02.463 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package jq. 2020-01-26T15:31:02.478 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:31:02.521 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-26T15:31:02.581 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mds. 2020-01-26T15:31:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../49-ceph-mds_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:02.639 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:02.669 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-26T15:31:02.683 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:31:03.138 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-26T15:31:03.142 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:31:03.148 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-01-26T15:31:03.192 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:31:03.545 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-26T15:31:03.560 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:31:03.603 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:31:03.647 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package jq. 2020-01-26T15:31:03.660 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:31:03.705 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-26T15:31:03.824 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package socat. 2020-01-26T15:31:03.839 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-26T15:31:03.881 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package jq. 2020-01-26T15:31:03.882 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:31:03.897 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:31:03.939 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-26T15:31:03.957 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package socat. 2020-01-26T15:31:03.971 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-26T15:31:04.015 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:31:04.208 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package socat. 2020-01-26T15:31:04.225 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-26T15:31:04.267 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:31:04.269 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-26T15:31:04.285 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-26T15:31:04.327 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:31:04.394 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-26T15:31:04.408 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-26T15:31:04.452 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:31:04.589 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package xmlstarlet. 2020-01-26T15:31:04.603 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-26T15:31:04.649 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-26T15:31:04.653 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-26T15:31:04.668 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-26T15:31:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:31:04.747 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package xmlstarlet. 2020-01-26T15:31:04.763 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-26T15:31:04.813 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-26T15:31:04.987 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package xmlstarlet. 2020-01-26T15:31:05.010 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-26T15:31:05.033 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package ceph-test. 2020-01-26T15:31:05.046 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-26T15:31:05.048 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../56-ceph-test_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:05.091 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:05.172 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-test. 2020-01-26T15:31:05.185 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../56-ceph-test_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:05.230 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:05.357 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-test. 2020-01-26T15:31:05.373 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../56-ceph-test_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:05.415 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:06.995 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-26T15:31:07.009 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:07.054 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:07.108 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-26T15:31:07.121 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:07.158 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:07.318 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-26T15:31:07.332 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:07.365 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libjs-underscore. 2020-01-26T15:31:07.377 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:07.377 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-01-26T15:31:07.414 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:31:07.435 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjs-underscore. 2020-01-26T15:31:07.450 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-01-26T15:31:07.493 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:31:07.621 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjs-underscore. 2020-01-26T15:31:07.637 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-01-26T15:31:07.671 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:31:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-01-26T15:31:07.709 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-01-26T15:31:07.751 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:31:07.796 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-01-26T15:31:07.811 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-01-26T15:31:07.854 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:31:07.940 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-01-26T15:31:07.954 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-01-26T15:31:07.990 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:31:08.104 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-webencodings. 2020-01-26T15:31:08.120 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-01-26T15:31:08.162 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-webencodings (0.5-2) ... 2020-01-26T15:31:08.165 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-webencodings. 2020-01-26T15:31:08.180 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-01-26T15:31:08.223 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-webencodings (0.5-2) ... 2020-01-26T15:31:08.310 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-webencodings. 2020-01-26T15:31:08.324 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-01-26T15:31:08.368 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-webencodings (0.5-2) ... 2020-01-26T15:31:08.481 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-html5lib. 2020-01-26T15:31:08.499 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:31:08.510 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-html5lib. 2020-01-26T15:31:08.525 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:31:08.540 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-01-26T15:31:08.568 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-01-26T15:31:08.645 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-html5lib. 2020-01-26T15:31:08.660 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:31:08.704 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-01-26T15:31:08.876 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-lxml:amd64. 2020-01-26T15:31:08.892 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:31:08.921 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-lxml:amd64. 2020-01-26T15:31:08.935 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:31:08.935 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:31:08.979 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:31:09.040 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-lxml:amd64. 2020-01-26T15:31:09.064 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:31:09.099 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:31:09.346 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-openid. 2020-01-26T15:31:09.364 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-01-26T15:31:09.405 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-openid (2.2.5-6) ... 2020-01-26T15:31:09.475 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-openid. 2020-01-26T15:31:09.488 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-01-26T15:31:09.533 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-openid (2.2.5-6) ... 2020-01-26T15:31:09.535 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-openid. 2020-01-26T15:31:09.551 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-01-26T15:31:09.594 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-openid (2.2.5-6) ... 2020-01-26T15:31:09.725 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-pastescript. 2020-01-26T15:31:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:31:09.783 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-01-26T15:31:09.869 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastescript. 2020-01-26T15:31:09.884 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:31:09.932 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-01-26T15:31:09.966 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pastescript. 2020-01-26T15:31:09.980 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:31:10.024 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-01-26T15:31:10.154 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-pyinotify. 2020-01-26T15:31:10.168 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:31:10.218 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-01-26T15:31:10.347 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pyinotify. 2020-01-26T15:31:10.360 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pyinotify. 2020-01-26T15:31:10.361 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:31:10.377 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:31:10.405 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-01-26T15:31:10.419 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-01-26T15:31:10.518 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-repoze.lru. 2020-01-26T15:31:10.530 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:31:10.573 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-01-26T15:31:10.713 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-repoze.lru. 2020-01-26T15:31:10.730 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:31:10.735 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-repoze.lru. 2020-01-26T15:31:10.749 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:31:10.772 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-01-26T15:31:10.785 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-01-26T15:31:10.877 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-routes. 2020-01-26T15:31:10.892 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-01-26T15:31:10.935 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-routes (2.4.1-1) ... 2020-01-26T15:31:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-routes. 2020-01-26T15:31:11.089 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-routes. 2020-01-26T15:31:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-01-26T15:31:11.104 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-01-26T15:31:11.142 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-routes (2.4.1-1) ... 2020-01-26T15:31:11.146 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-routes (2.4.1-1) ... 2020-01-26T15:31:11.263 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python-scgi. 2020-01-26T15:31:11.277 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-01-26T15:31:11.321 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-01-26T15:31:11.453 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-scgi. 2020-01-26T15:31:11.469 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-01-26T15:31:11.475 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-scgi. 2020-01-26T15:31:11.488 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-01-26T15:31:11.511 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-01-26T15:31:11.533 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-01-26T15:31:11.641 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-26T15:31:11.656 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:11.708 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:11.831 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-26T15:31:11.837 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-26T15:31:11.845 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:11.851 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:11.908 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:11.941 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:11.977 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rados. 2020-01-26T15:31:11.994 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../70-python3-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.036 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.171 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rados. 2020-01-26T15:31:12.189 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../70-python3-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.192 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rados. 2020-01-26T15:31:12.207 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../70-python3-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.230 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.251 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.413 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-cephfs. 2020-01-26T15:31:12.427 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../71-python3-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.574 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cephfs. 2020-01-26T15:31:12.589 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../71-python3-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.603 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cephfs. 2020-01-26T15:31:12.619 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../71-python3-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.632 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.661 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.741 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rbd. 2020-01-26T15:31:12.754 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../72-python3-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.799 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.910 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rbd. 2020-01-26T15:31:12.922 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rbd. 2020-01-26T15:31:12.924 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../72-python3-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.936 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../72-python3-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:12.968 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:12.980 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:13.102 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package python3-rgw. 2020-01-26T15:31:13.115 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../73-python3-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:13.153 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:13.250 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rgw. 2020-01-26T15:31:13.264 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../73-python3-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:13.308 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:13.312 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rgw. 2020-01-26T15:31:13.327 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../73-python3-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:13.371 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:13.523 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package radosgw. 2020-01-26T15:31:13.536 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../74-radosgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:13.580 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:13.695 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package radosgw. 2020-01-26T15:31:13.709 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../74-radosgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:13.749 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package radosgw. 2020-01-26T15:31:13.753 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:13.763 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../74-radosgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:13.807 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:14.125 INFO:teuthology.orchestra.run.smithi008.stdout:Selecting previously unselected package rbd-fuse. 2020-01-26T15:31:14.140 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing to unpack .../75-rbd-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:14.183 INFO:teuthology.orchestra.run.smithi008.stdout:Unpacking rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:14.298 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package rbd-fuse. 2020-01-26T15:31:14.311 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../75-rbd-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:14.364 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:14.369 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-fuse. 2020-01-26T15:31:14.385 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../75-rbd-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:31:14.440 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:14.492 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-01-26T15:31:14.659 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-01-26T15:31:14.723 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-01-26T15:31:14.798 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-01-26T15:31:14.912 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-01-26T15:31:14.982 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-01-26T15:31:15.016 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-01-26T15:31:15.130 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-01-26T15:31:15.192 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-01-26T15:31:15.217 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-openid (2.2.5-6) ... 2020-01-26T15:31:15.323 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-openid (2.2.5-6) ... 2020-01-26T15:31:15.403 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-openid (2.2.5-6) ... 2020-01-26T15:31:15.478 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-01-26T15:31:15.562 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-01-26T15:31:15.633 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-01-26T15:31:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:31:15.751 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:31:15.829 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:31:15.905 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-01-26T15:31:15.977 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-01-26T15:31:16.064 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-01-26T15:31:16.098 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-chardet (3.0.4-1) ... 2020-01-26T15:31:16.170 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-chardet (3.0.4-1) ... 2020-01-26T15:31:16.257 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-chardet (3.0.4-1) ... 2020-01-26T15:31:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:31:16.438 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:31:16.492 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:31:16.524 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:31:16.569 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:31:16.650 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:31:16.702 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:16.766 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:16.877 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:17.011 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:31:17.059 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:31:17.137 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:31:17.178 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:31:17.184 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:31:17.263 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-01-26T15:31:17.304 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:31:17.310 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-01-26T15:31:17.447 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-01-26T15:31:17.465 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:31:17.503 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:31:17.616 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:31:17.629 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:31:17.631 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:31:17.742 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:31:17.755 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:31:17.757 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:31:17.883 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:31:17.968 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:17.982 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:18.104 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:18.110 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-waitress (1.0.1-1) ... 2020-01-26T15:31:18.111 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-waitress (1.0.1-1) ... 2020-01-26T15:31:18.227 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-waitress (1.0.1-1) ... 2020-01-26T15:31:18.385 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:31:18.471 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:31:18.589 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-01-26T15:31:18.665 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:31:18.670 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-01-26T15:31:18.782 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:31:18.862 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:31:19.050 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-01-26T15:31:19.123 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-01-26T15:31:19.155 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-01-26T15:31:19.251 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-01-26T15:31:19.315 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-01-26T15:31:19.339 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:31:19.445 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:31:19.525 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:31:19.571 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:31:19.599 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-01-26T15:31:19.667 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:31:19.697 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-01-26T15:31:19.793 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-01-26T15:31:19.800 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-01-26T15:31:19.923 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-01-26T15:31:20.002 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:31:20.020 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-01-26T15:31:20.127 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:31:20.141 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:31:20.238 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:31:20.253 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-01-26T15:31:20.275 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:31:20.363 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:31:20.480 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-01-26T15:31:20.502 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:31:20.573 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:31:20.697 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:31:20.729 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-26T15:31:20.791 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-26T15:31:20.798 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:31:20.904 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:31:20.976 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:31:20.983 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:31:21.106 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:31:21.169 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:31:21.176 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-26T15:31:21.231 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-tempita (0.5.2-2) ... 2020-01-26T15:31:21.295 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-tempita (0.5.2-2) ... 2020-01-26T15:31:21.358 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:31:21.425 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:31:21.488 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:31:21.554 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:31:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-webencodings (0.5-2) ... 2020-01-26T15:31:21.614 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-webencodings (0.5-2) ... 2020-01-26T15:31:21.679 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-tempita (0.5.2-2) ... 2020-01-26T15:31:21.744 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:31:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:31:21.864 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:31:21.981 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-webencodings (0.5-2) ... 2020-01-26T15:31:22.026 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-01-26T15:31:22.067 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-01-26T15:31:22.157 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:31:22.205 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-logutils (0.3.3-5) ... 2020-01-26T15:31:22.259 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-logutils (0.3.3-5) ... 2020-01-26T15:31:22.393 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-01-26T15:31:22.397 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-routes (2.4.1-1) ... 2020-01-26T15:31:22.454 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-routes (2.4.1-1) ... 2020-01-26T15:31:22.568 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-logutils (0.3.3-5) ... 2020-01-26T15:31:22.599 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:31:22.654 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:31:22.761 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-routes (2.4.1-1) ... 2020-01-26T15:31:22.850 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-26T15:31:22.896 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-26T15:31:22.962 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:31:22.976 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:31:23.033 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:31:23.196 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-26T15:31:23.211 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:31:23.257 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:31:23.322 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:31:23.504 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:31:23.540 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:31:23.550 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:31:23.605 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-26T15:31:23.676 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-26T15:31:23.706 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librados2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:23.794 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:31:23.802 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librados2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:23.815 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:23.901 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-26T15:31:23.928 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:23.941 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.027 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librados2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.054 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.067 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.153 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.180 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.194 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-01-26T15:31:24.279 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.307 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-01-26T15:31:24.405 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.445 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.536 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-01-26T15:31:24.563 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.567 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.693 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.730 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.782 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.847 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.883 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:24.894 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.021 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.051 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.116 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.169 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.275 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.321 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.402 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-01-26T15:31:25.447 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.453 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.573 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-01-26T15:31:25.579 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.603 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.705 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-01-26T15:31:25.783 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:25.834 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:31:25.834 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:31:25.906 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.020 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:31:26.021 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:31:26.121 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up librbd1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.127 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:31:26.127 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:31:26.222 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-01-26T15:31:26.310 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librbd1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.375 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librbd1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.423 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.435 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-01-26T15:31:26.475 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-01-26T15:31:26.533 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.654 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.659 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.676 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.780 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.802 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.914 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:26.928 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:27.235 INFO:teuthology.orchestra.run.smithi008.stdout:Adding group ceph....done 2020-01-26T15:31:27.498 INFO:teuthology.orchestra.run.smithi163.stdout:Adding group ceph....done 2020-01-26T15:31:27.597 INFO:teuthology.orchestra.run.smithi008.stdout:Adding system user ceph....done 2020-01-26T15:31:27.814 INFO:teuthology.orchestra.run.smithi008.stdout:Setting system user ceph properties....done 2020-01-26T15:31:27.824 INFO:teuthology.orchestra.run.smithi170.stdout:Adding group ceph....done 2020-01-26T15:31:27.866 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user ceph....done 2020-01-26T15:31:27.973 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-26T15:31:28.058 INFO:teuthology.orchestra.run.smithi163.stdout:Setting system user ceph properties....done 2020-01-26T15:31:28.188 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-26T15:31:28.216 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-26T15:31:28.227 INFO:teuthology.orchestra.run.smithi170.stdout:Adding system user ceph....done 2020-01-26T15:31:28.420 INFO:teuthology.orchestra.run.smithi170.stdout:Setting system user ceph properties....done 2020-01-26T15:31:28.452 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-26T15:31:28.487 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:28.581 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-26T15:31:28.755 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:28.826 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-26T15:31:28.866 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:31:28.866 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:31:29.118 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.175 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:31:29.175 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:31:29.256 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.358 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:31:29.509 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:31:29.509 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:31:29.552 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.600 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.695 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.701 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:31:29.821 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.902 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:29.962 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.028 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.088 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:31:30.154 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.249 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-26T15:31:30.290 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.424 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.549 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up python-pecan (1.2.1-2) ... 2020-01-26T15:31:30.584 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.604 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-26T15:31:30.622 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-26T15:31:30.663 INFO:teuthology.orchestra.run.smithi008.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-26T15:31:30.860 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:30.898 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pecan (1.2.1-2) ... 2020-01-26T15:31:30.988 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-26T15:31:31.030 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-26T15:31:31.030 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-26T15:31:31.218 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:31.312 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pecan (1.2.1-2) ... 2020-01-26T15:31:31.333 INFO:teuthology.orchestra.run.smithi008.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-01-26T15:31:31.402 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-26T15:31:31.442 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-26T15:31:31.602 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:31:31.602 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:31:31.640 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:31.643 INFO:teuthology.orchestra.run.smithi163.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-01-26T15:31:31.881 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:31.906 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:31:31.906 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:31:32.116 INFO:teuthology.orchestra.run.smithi170.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-01-26T15:31:32.197 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:31:32.201 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:31:32.205 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:32.372 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:31:32.372 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:31:32.500 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:32.547 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:31:32.547 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:31:32.669 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:32.824 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:31:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:31:33.020 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:31:33.020 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:31:33.136 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:33.155 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:31:33.155 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:31:33.330 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:33.426 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:33.686 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:31:33.686 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:31:33.691 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:31:33.691 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:31:33.955 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:31:33.955 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:31:33.958 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:34.034 INFO:teuthology.orchestra.run.smithi008.stdout:Setting up ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:34.160 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:31:34.231 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:34.344 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:31:34.358 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:31:34.523 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:31:34.527 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:31:34.576 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:31:34.813 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:31:34.940 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:31:35.149 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:31:35.847 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:31:35.898 INFO:teuthology.orchestra.run.smithi008.stdout:ureadahead will be reprofiled on next reboot 2020-01-26T15:31:35.956 INFO:teuthology.orchestra.run.smithi008.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:31:36.000 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:31:36.031 INFO:teuthology.orchestra.run.smithi163.stdout:ureadahead will be reprofiled on next reboot 2020-01-26T15:31:36.078 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:31:36.388 INFO:teuthology.orchestra.run.smithi008.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:31:36.390 DEBUG:teuthology.parallel:result is None 2020-01-26T15:31:36.491 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:31:36.494 DEBUG:teuthology.parallel:result is None 2020-01-26T15:31:36.585 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:31:36.624 INFO:teuthology.orchestra.run.smithi170.stdout:ureadahead will be reprofiled on next reboot 2020-01-26T15:31:36.677 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:31:37.112 INFO:teuthology.orchestra.run.smithi170.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:31:37.114 DEBUG:teuthology.parallel:result is None 2020-01-26T15:31:37.115 INFO:teuthology.orchestra.run.smithi008:> sudo lsb_release -is 2020-01-26T15:31:37.166 INFO:teuthology.orchestra.run.smithi008.stdout:Ubuntu 2020-01-26T15:31:37.171 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:31:37.171 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:31:37.171 INFO:teuthology.packaging:ref: None 2020-01-26T15:31:37.171 INFO:teuthology.packaging:tag: None 2020-01-26T15:31:37.171 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:31:37.172 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:31:37.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:31:37.534 INFO:teuthology.orchestra.run.smithi008:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:31:37.560 INFO:teuthology.orchestra.run.smithi008.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:31:37.560 INFO:teuthology.packaging:The installed version of ceph is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:31:37.560 INFO:teuthology.task.install:The correct ceph version 13.2.8-63-ge1c5fd9-1bionic is installed. 2020-01-26T15:31:37.561 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:31:37.612 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:31:37.616 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:31:37.617 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:31:37.617 INFO:teuthology.packaging:ref: None 2020-01-26T15:31:37.617 INFO:teuthology.packaging:tag: None 2020-01-26T15:31:37.617 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:31:37.617 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:31:37.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:31:37.877 INFO:teuthology.orchestra.run.smithi170:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:31:37.900 INFO:teuthology.orchestra.run.smithi170.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:31:37.900 INFO:teuthology.packaging:The installed version of ceph is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:31:37.901 INFO:teuthology.task.install:The correct ceph version 13.2.8-63-ge1c5fd9-1bionic is installed. 2020-01-26T15:31:37.901 INFO:teuthology.orchestra.run.smithi163:> sudo lsb_release -is 2020-01-26T15:31:37.953 INFO:teuthology.orchestra.run.smithi163.stdout:Ubuntu 2020-01-26T15:31:37.958 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:31:37.958 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:31:37.958 INFO:teuthology.packaging:ref: None 2020-01-26T15:31:37.959 INFO:teuthology.packaging:tag: None 2020-01-26T15:31:37.959 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:31:37.959 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:31:37.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:31:38.217 INFO:teuthology.orchestra.run.smithi163:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:31:38.242 INFO:teuthology.orchestra.run.smithi163.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:31:38.243 INFO:teuthology.packaging:The installed version of ceph is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:31:38.243 INFO:teuthology.task.install:The correct ceph version 13.2.8-63-ge1c5fd9-1bionic is installed. 2020-01-26T15:31:38.243 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-01-26T15:31:38.243 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-26T15:31:38.260 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-26T15:31:38.276 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-26T15:31:38.301 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-01-26T15:31:38.301 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-26T15:31:38.318 INFO:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-26T15:31:38.389 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-26T15:31:38.405 INFO:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-26T15:31:38.460 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-26T15:31:38.475 INFO:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-26T15:31:38.531 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-01-26T15:31:38.531 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-26T15:31:38.577 INFO:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-26T15:31:38.632 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-26T15:31:38.680 INFO:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-26T15:31:38.735 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-26T15:31:38.784 INFO:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-26T15:31:38.838 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:31:38.851 INFO:teuthology.task.print:**** done installing mimic 2020-01-26T15:31:38.852 INFO:teuthology.run_tasks:Running task ceph... 2020-01-26T15:31:38.929 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-01-26T15:31:38.930 INFO:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2020-01-26T15:31:38.932 INFO:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2020-01-26T15:31:38.935 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2020-01-26T15:31:38.947 INFO:tasks.ceph:Disabling ceph logrotate... 2020-01-26T15:31:38.948 INFO:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-26T15:31:38.988 INFO:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-26T15:31:38.991 INFO:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-26T15:31:39.003 INFO:tasks.ceph:Creating extra log directories... 2020-01-26T15:31:39.003 INFO:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-26T15:31:39.044 INFO:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-26T15:31:39.047 INFO:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-26T15:31:39.064 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-01-26T15:31:39.064 INFO:tasks.ceph:config {'mon_bind_addrvec': False, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'missing required features'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'bluestore warn on no per pool omap': False, 'bluestore warn on legacy statfs': False}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon warn on osd down out interval zero': False, 'mon op complaint time': 120, 'debug ms': 1}}} 2020-01-26T15:31:39.064 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'extra_packages': ['librados2'], 'branch': 'mimic', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm']}}, {'print': '**** done installing mimic'}, {'ceph': {'mon_bind_addrvec': False, 'fs': 'xfs', 'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'cluster': 'ceph', 'log-whitelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'missing required features'], 'mon_bind_msgr2': False, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'bluestore warn on no per pool omap': False, 'bluestore warn on legacy statfs': False}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon warn on osd down out interval zero': False, 'mon op complaint time': 120, 'debug ms': 1}}, 'max_mds': 2}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client mimic']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done mimic client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': None, 'mon.b': None}}, {'print': '**** done install.upgrade both hosts'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'wait-for-healthy': False, 'mon-health-to-clog': False}}, {'exec': {'mon.a': ['ceph config set global mon_warn_on_msgr2_not_enabled false']}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph mon enable-msgr2', 'ceph versions', 'ceph osd dump -f json-pretty', 'ceph config rm global mon_warn_on_msgr2_not_enabled', 'ceph osd require-osd-release octopus', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.1': {'skip': True}, 'client.0': {'mounted': False}}}, {'ceph-fuse': {'client.1': {'skip': True}, 'client.0': None}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs set cephfs min_compat_client octopus']}}, {'fs.clients_evicted': {'clients': {'client.1': True, 'client.0': False}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2498', 'meta': [{'desc': 'install ceph/mimic latest\n'}], 'owner': 'scheduled_sage@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi170.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7nAMPRKTdRqwToa7xphmYqXwjrrUMLuQ8+HPqLKWEUcIkLTyd6hHQljSYytlSIhaHreH+liYtodBaza7SRIbsGG5fjBSIPmIL4riF8V/npeSnEqwIh0AWJNJtZl8hEJTx3EoycCCzssx+GWXpgz17bHeWj9s6EsUzpBnH3IWOFTDekClpELsoxxFHvD9sgO7c1IS0akESN0IKCUox7wRD4wkEx19X4jteRDS1zuLcOk8mS3zr19CvaZmorlONSv9CQa2uwlhRSUMHoY/u65hqhFJpF/FOBlspvrS34D3+jmsCIP/Wm6gl4KG/Kp4qGnumt925uQmeoko5Mq0RIVh/', 'smithi008.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/eVQjVuHp2YS9MLG0ryFZ4HDHMF5Gd+gYPrtUroD7DQruFsnx4Nf17KZLM1Qz7d0isolKpg15+RYCDctcuPx/Sdic4XbzcnsSTrzpIOQclUOpzn0vssBGIuAkpQ7EVw8fmljDP7MjmCld/J3QPjOb8AdYHS4TJ28CSQZznP+rU6vxxbTiCbd+Vw0orm86dqAN60cvu+ywrqW6rdcmWZBfoC38hFmBgozXgzjTAuMjLHDTLvX5aSwQ5qsiMz8fbYOHEnDzx35AvpI+X22it6mqbkjwRCN8/NhHXmev8oO0GYR2D2RnJvkfzIDt4hYl+ngeJ8tNHTEFotMZjNUWRT4v', 'smithi163.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5F5RAYnX4LTWpMFIqdtDscqsLO79u1FShDnaXxdrEovnDGA+RJmon9ZSkztI1NpqCfirntsVimNbnZgjTDXsCBB/5vwIvHvVH6Kf1EjwGJdPnpXKj59uPn8bqX9zdeZGRbptX+f0hZFkPFtYmwz9yT+qWVG0B+m2yvQMOHOONYE2VlBNl9eXKcoCPsGJ/mPUUai/1jj60UGvxavQe+d+DiiBdsyPX+pyggfubA0Gi2y0k41osVr7vm5WseC6EGMUzBRetJn68Ldpe6sPt7pp4Y9Y1AXrcrkzXECFVj4UnR1qSz7Ii4/XECgyzpfZBmoveqR/JHD/QLRkIiFzyAJvb'}, 'job_id': '4709317', 'tube': 'smithi', 'suite_branch': 'wip-sage-testing-2020-01-26-0849', 'priority': 70, 'first_in_suite': False, 'branch': 'wip-sage2-testing-2020-01-24-1408', 'suite': 'upgrade:cephfs', 'email': None, 'archive_path': '/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709317', 'description': 'upgrade:cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}}', 'nuke-on-error': False, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'name': 'sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci', 'suite_sha1': 'aa93311c28f80541753eb7d86d811f1316c8e0c7', 'overrides': {'ceph': {'mon_bind_addrvec': False, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'missing required features'], 'mon_bind_msgr2': False, 'max_mds': 2, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'bluestore warn on no per pool omap': False, 'bluestore warn on legacy statfs': False, 'mon pg warn min per osd': 0}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon warn on osd down out interval zero': False, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}, 'fs': 'xfs', 'sha1': '084f0502288c3898c3a27b35934ea510597b049d'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'}}, 'admin_socket': {'branch': 'wip-sage2-testing-2020-01-24-1408'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'nuke-on-error': False, 'workunit': {'sha1': 'aa93311c28f80541753eb7d86d811f1316c8e0c7', 'branch': 'wip-sage-testing-2020-01-26-0849'}}} 2020-01-26T15:31:39.065 INFO:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-26T15:31:39.100 INFO:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-26T15:31:39.103 INFO:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-26T15:31:39.112 INFO:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2020-01-26T15:31:39.148 INFO:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2020-01-26T15:31:39.151 INFO:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2020-01-26T15:31:39.222 DEBUG:teuthology.orchestra.remote:smithi170:/scratch_devs is 72B 2020-01-26T15:31:39.273 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-26T15:31:39.273 INFO:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-01-26T15:31:39.280 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-01-26T15:31:39.281 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:31:39.281 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 443 Links: 1 2020-01-26T15:31:39.281 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:31:39.281 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2020-01-26 15:29:46.829353733 +0000 2020-01-26T15:31:39.282 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2020-01-26 15:29:46.705415716 +0000 2020-01-26T15:31:39.282 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2020-01-26 15:29:46.705415716 +0000 2020-01-26T15:31:39.282 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2020-01-26T15:31:39.290 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2020-01-26T15:31:39.290 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2020-01-26T15:31:39.290 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000368821 s, 1.4 MB/s 2020-01-26T15:31:39.295 INFO:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-01-26T15:31:39.344 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-01-26T15:31:39.344 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:31:39.345 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 449 Links: 1 2020-01-26T15:31:39.345 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:31:39.345 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2020-01-26 15:29:46.949293749 +0000 2020-01-26T15:31:39.345 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2020-01-26 15:29:46.945295749 +0000 2020-01-26T15:31:39.346 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2020-01-26 15:29:46.945295749 +0000 2020-01-26T15:31:39.346 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2020-01-26T15:31:39.354 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2020-01-26T15:31:39.354 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2020-01-26T15:31:39.354 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000343129 s, 1.5 MB/s 2020-01-26T15:31:39.359 INFO:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-01-26T15:31:39.409 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-01-26T15:31:39.409 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:31:39.410 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 455 Links: 1 2020-01-26T15:31:39.410 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:31:39.410 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2020-01-26 15:29:47.289123795 +0000 2020-01-26T15:31:39.410 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2020-01-26 15:29:47.169183779 +0000 2020-01-26T15:31:39.410 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2020-01-26 15:29:47.169183779 +0000 2020-01-26T15:31:39.411 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2020-01-26T15:31:39.421 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2020-01-26T15:31:39.422 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2020-01-26T15:31:39.422 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000335151 s, 1.5 MB/s 2020-01-26T15:31:39.424 INFO:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-01-26T15:31:39.474 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-01-26T15:31:39.474 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:31:39.474 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 461 Links: 1 2020-01-26T15:31:39.475 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:31:39.475 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2020-01-26 15:29:47.397069809 +0000 2020-01-26T15:31:39.475 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2020-01-26 15:29:47.393071809 +0000 2020-01-26T15:31:39.475 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2020-01-26 15:29:47.393071809 +0000 2020-01-26T15:31:39.475 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2020-01-26T15:31:39.483 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2020-01-26T15:31:39.483 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2020-01-26T15:31:39.483 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000349242 s, 1.5 MB/s 2020-01-26T15:31:39.487 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-01-26T15:31:39.487 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-26T15:31:39.487 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-01-26T15:31:39.488 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:31:39.488 INFO:tasks.ceph:Generating config... 2020-01-26T15:31:39.489 INFO:tasks.ceph:[mds] mds debug frag = True 2020-01-26T15:31:39.490 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-01-26T15:31:39.490 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-01-26T15:31:39.490 INFO:tasks.ceph:[mds] debug mds = 20 2020-01-26T15:31:39.490 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] debug ms = 1 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] mds bal frag = True 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-01-26T15:31:39.491 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-01-26T15:31:39.491 INFO:tasks.ceph:[client] debug ms = 1 2020-01-26T15:31:39.492 INFO:tasks.ceph:[client] debug client = 20 2020-01-26T15:31:39.492 INFO:tasks.ceph:[client] client mount timeout = 600 2020-01-26T15:31:39.492 INFO:tasks.ceph:[global] mon warn on pool no app = False 2020-01-26T15:31:39.492 INFO:tasks.ceph:[global] ms bind msgr2 = False 2020-01-26T15:31:39.492 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2020-01-26T15:31:39.492 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2020-01-26T15:31:39.492 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] debug ms = 1 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] debug osd = 25 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-01-26T15:31:39.493 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-01-26T15:31:39.494 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-01-26T15:31:39.494 INFO:tasks.ceph:[osd] debug journal = 20 2020-01-26T15:31:39.494 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-01-26T15:31:39.494 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-01-26T15:31:39.494 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-01-26T15:31:39.494 INFO:tasks.ceph:[osd] bdev async discard = True 2020-01-26T15:31:39.495 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-01-26T15:31:39.495 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-01-26T15:31:39.495 INFO:tasks.ceph:[osd] debug filestore = 20 2020-01-26T15:31:39.495 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-01-26T15:31:39.495 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-01-26T15:31:39.495 INFO:tasks.ceph:[mon] debug mon = 20 2020-01-26T15:31:39.495 INFO:tasks.ceph:[mon] debug paxos = 20 2020-01-26T15:31:39.495 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2020-01-26T15:31:39.496 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-01-26T15:31:39.496 INFO:tasks.ceph:[mon] debug ms = 1 2020-01-26T15:31:39.496 INFO:tasks.ceph:Setting up mon.a... 2020-01-26T15:31:39.496 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-01-26T15:31:39.610 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.keyring 2020-01-26T15:31:39.613 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-01-26T15:31:39.652 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:31:39.707 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.170:6789'), ('mon.c', '172.21.15.170:6791'), ('mon.b', '172.21.15.170:6790')] 2020-01-26T15:31:39.708 INFO:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --add a 172.21.15.170:6789 --add c 172.21.15.170:6791 --add b 172.21.15.170:6790 --print /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:39.776 INFO:teuthology.orchestra.run.smithi170.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:39.777 INFO:teuthology.orchestra.run.smithi170.stdout:monmaptool: generated fsid 8497d181-a5c1-4388-9117-8dc8db8c2871 2020-01-26T15:31:39.777 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 0 2020-01-26T15:31:39.777 INFO:teuthology.orchestra.run.smithi170.stdout:fsid 8497d181-a5c1-4388-9117-8dc8db8c2871 2020-01-26T15:31:39.778 INFO:teuthology.orchestra.run.smithi170.stdout:last_changed 2020-01-26 15:31:39.777476 2020-01-26T15:31:39.778 INFO:teuthology.orchestra.run.smithi170.stdout:created 2020-01-26 15:31:39.777476 2020-01-26T15:31:39.779 INFO:teuthology.orchestra.run.smithi170.stdout:0: 172.21.15.170:6789/0 mon.a 2020-01-26T15:31:39.779 INFO:teuthology.orchestra.run.smithi170.stdout:1: 172.21.15.170:6790/0 mon.b 2020-01-26T15:31:39.779 INFO:teuthology.orchestra.run.smithi170.stdout:2: 172.21.15.170:6791/0 mon.c 2020-01-26T15:31:39.779 INFO:teuthology.orchestra.run.smithi170.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-01-26T15:31:39.781 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8497d181-a5c1-4388-9117-8dc8db8c2871... 2020-01-26T15:31:39.783 INFO:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-26T15:31:39.785 INFO:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-26T15:31:39.791 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-26T15:31:39.825 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2020-01-26T15:31:39.825 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2020-01-26T15:31:39.825 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-26T15:31:39.825 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2020-01-26T15:31:39.825 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.825 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.826 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2020-01-26T15:31:39.827 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2020-01-26T15:31:39.828 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-26T15:31:39.829 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.830 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2020-01-26T15:31:39.830 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.830 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2020-01-26T15:31:39.830 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.170:6789,172.21.15.170:6791,172.21.15.170:6790" 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on pool no app = False 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: ms bind msgr2 = False 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn min per osd = 0 2020-01-26T15:31:39.831 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore warn on no per pool omap = False 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore warn on legacy statfs = False 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 8497d181-a5c1-4388-9117-8dc8db8c2871 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.832 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2020-01-26T15:31:39.833 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2020-01-26T15:31:39.834 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2020-01-26T15:31:39.834 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.834 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2020-01-26T15:31:39.834 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2020-01-26T15:31:39.834 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.834 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2020-01-26T15:31:39.835 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 25 2020-01-26T15:31:39.836 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 20 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 20 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 10 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: debug journal = 20 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore allocator = bitmap 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2020-01-26T15:31:39.837 INFO:teuthology.orchestra.run.smithi163.stdout: bdev async discard = True 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout: debug filestore = 20 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout: bdev enable discard = True 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.838 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2020-01-26T15:31:39.839 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.840 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2020-01-26T15:31:39.840 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2020-01-26T15:31:39.840 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2020-01-26T15:31:39.840 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2020-01-26T15:31:39.840 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2020-01-26T15:31:39.840 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = False 2020-01-26T15:31:39.841 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout: 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-26T15:31:39.842 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2020-01-26T15:31:39.843 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2020-01-26T15:31:39.844 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2020-01-26T15:31:39.844 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2020-01-26T15:31:39.844 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2020-01-26T15:31:39.844 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal split bits = 3 2020-01-26T15:31:39.844 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal split size = 100 2020-01-26T15:31:39.844 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal merge size = 5 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal frag = True 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal fragment size max = 10000 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2020-01-26T15:31:39.845 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.846 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.847 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-26T15:31:39.848 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2020-01-26T15:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.850 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2020-01-26T15:31:39.851 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.851 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2020-01-26T15:31:39.851 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.851 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2020-01-26T15:31:39.851 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2020-01-26T15:31:39.851 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.170:6789,172.21.15.170:6791,172.21.15.170:6790" 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on pool no app = False 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: ms bind msgr2 = False 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn min per osd = 0 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore warn on no per pool omap = False 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore warn on legacy statfs = False 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 8497d181-a5c1-4388-9117-8dc8db8c2871 2020-01-26T15:31:39.852 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2020-01-26T15:31:39.853 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2020-01-26T15:31:39.854 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.854 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2020-01-26T15:31:39.854 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2020-01-26T15:31:39.854 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2020-01-26T15:31:39.854 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.854 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.855 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2020-01-26T15:31:39.856 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 25 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2020-01-26T15:31:39.857 INFO:teuthology.orchestra.run.smithi008.stdout: debug journal = 20 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore allocator = bitmap 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: bdev async discard = True 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2020-01-26T15:31:39.858 INFO:teuthology.orchestra.run.smithi008.stdout: debug filestore = 20 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: bdev enable discard = True 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2020-01-26T15:31:39.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2020-01-26T15:31:39.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2020-01-26T15:31:39.861 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2020-01-26T15:31:39.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2020-01-26T15:31:39.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2020-01-26T15:31:39.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:31:39.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = False 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2020-01-26T15:31:39.862 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2020-01-26T15:31:39.863 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2020-01-26T15:31:39.864 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2020-01-26T15:31:39.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal split bits = 3 2020-01-26T15:31:39.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal split size = 100 2020-01-26T15:31:39.865 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2020-01-26T15:31:39.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal merge size = 5 2020-01-26T15:31:39.865 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2020-01-26T15:31:39.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal frag = True 2020-01-26T15:31:39.866 INFO:teuthology.orchestra.run.smithi008.stdout: mds bal fragment size max = 10000 2020-01-26T15:31:39.866 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2020-01-26T15:31:39.866 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2020-01-26T15:31:39.866 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2020-01-26T15:31:39.866 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2020-01-26T15:31:39.868 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2020-01-26T15:31:39.868 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2020-01-26T15:31:39.868 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.869 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2020-01-26T15:31:39.870 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.871 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2020-01-26T15:31:39.871 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-26T15:31:39.871 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.871 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2020-01-26T15:31:39.871 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2020-01-26T15:31:39.872 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.873 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.170:6789,172.21.15.170:6791,172.21.15.170:6790" 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on pool no app = False 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: ms bind msgr2 = False 2020-01-26T15:31:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn min per osd = 0 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore warn on no per pool omap = False 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore warn on legacy statfs = False 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 8497d181-a5c1-4388-9117-8dc8db8c2871 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2020-01-26T15:31:39.875 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.876 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.877 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2020-01-26T15:31:39.878 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 25 2020-01-26T15:31:39.879 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 20 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 20 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 10 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: debug journal = 20 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2020-01-26T15:31:39.880 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout: debug filestore = 20 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.881 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2020-01-26T15:31:39.882 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2020-01-26T15:31:39.882 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2020-01-26T15:31:39.882 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2020-01-26T15:31:39.882 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2020-01-26T15:31:39.882 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2020-01-26T15:31:39.883 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:31:39.884 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = False 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2020-01-26T15:31:39.885 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-26T15:31:39.886 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-26T15:31:39.886 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2020-01-26T15:31:39.886 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2020-01-26T15:31:39.886 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2020-01-26T15:31:39.886 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2020-01-26T15:31:39.886 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal split bits = 3 2020-01-26T15:31:39.887 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal split size = 100 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal merge size = 5 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal frag = True 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal fragment size max = 10000 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2020-01-26T15:31:39.888 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2020-01-26T15:31:39.889 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2020-01-26T15:31:39.889 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2020-01-26T15:31:39.889 INFO:tasks.ceph:Creating admin key on mon.a... 2020-01-26T15:31:39.889 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-01-26T15:31:39.951 INFO:tasks.ceph:Copying monmap to all nodes... 2020-01-26T15:31:40.001 DEBUG:teuthology.orchestra.remote:smithi170:/etc/ceph/ceph.keyring is 206B 2020-01-26T15:31:40.019 DEBUG:teuthology.orchestra.remote:smithi170:/home/ubuntu/cephtest/ceph.monmap is 357B 2020-01-26T15:31:40.075 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2020-01-26T15:31:40.075 INFO:teuthology.orchestra.run.smithi008:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:31:40.130 INFO:teuthology.orchestra.run.smithi008:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:40.220 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:31:40.220 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:31:40.277 INFO:teuthology.orchestra.run.smithi170:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:40.367 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2020-01-26T15:31:40.367 INFO:teuthology.orchestra.run.smithi163:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:31:40.425 INFO:teuthology.orchestra.run.smithi163:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:40.515 INFO:tasks.ceph:Setting up mon nodes... 2020-01-26T15:31:40.515 INFO:tasks.ceph:Setting up mgr nodes... 2020-01-26T15:31:40.515 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-01-26T15:31:40.555 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-01-26T15:31:40.558 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-01-26T15:31:40.644 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-01-26T15:31:40.647 INFO:tasks.ceph:Setting up mds nodes... 2020-01-26T15:31:40.647 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-01-26T15:31:40.732 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-01-26T15:31:40.735 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-01-26T15:31:40.791 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-01-26T15:31:40.873 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-01-26T15:31:40.875 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-01-26T15:31:40.932 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-01-26T15:31:41.014 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-01-26T15:31:41.017 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-01-26T15:31:41.072 INFO:tasks.ceph_client:Setting up client nodes... 2020-01-26T15:31:41.072 INFO:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-01-26T15:31:41.187 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-01-26T15:31:41.196 INFO:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-01-26T15:31:41.313 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-01-26T15:31:41.326 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-01-26T15:31:41.326 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-01-26T15:31:41.327 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-01-26T15:31:41.342 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:31:41.342 INFO:tasks.ceph:{} 2020-01-26T15:31:41.342 INFO:tasks.ceph:osd.0 2020-01-26T15:31:41.342 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:31:41.342 INFO:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:31:41.867 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:31:41.868 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:31:41.868 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:31:41.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2020-01-26T15:31:41.869 INFO:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-01-26T15:31:41.953 INFO:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-01-26T15:31:41.964 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:31:41.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:31:41.965 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-01-26T15:31:42.018 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:31:42.018 INFO:tasks.ceph:{} 2020-01-26T15:31:42.018 INFO:tasks.ceph:osd.1 2020-01-26T15:31:42.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:31:42.018 INFO:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-01-26T15:31:42.552 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:31:42.552 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:31:42.553 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:31:42.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2020-01-26T15:31:42.555 INFO:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-01-26T15:31:42.594 INFO:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-01-26T15:31:42.648 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:31:42.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:31:42.650 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-01-26T15:31:42.704 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:31:42.704 INFO:tasks.ceph:{} 2020-01-26T15:31:42.704 INFO:tasks.ceph:osd.2 2020-01-26T15:31:42.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:31:42.705 INFO:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-01-26T15:31:43.210 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:31:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:31:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:31:43.210 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:31:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:31:43.211 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:31:43.211 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:31:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:31:43.211 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:31:43.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2020-01-26T15:31:43.212 INFO:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-01-26T15:31:43.245 INFO:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-01-26T15:31:43.299 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:31:43.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:31:43.300 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-01-26T15:31:43.356 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:31:43.356 INFO:tasks.ceph:{} 2020-01-26T15:31:43.356 INFO:tasks.ceph:osd.3 2020-01-26T15:31:43.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:31:43.356 INFO:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-01-26T15:31:43.893 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:31:43.893 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:31:43.894 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:31:43.894 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:31:43.894 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:31:43.894 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:31:43.894 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:31:43.894 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:31:43.895 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:31:43.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2020-01-26T15:31:43.896 INFO:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2020-01-26T15:31:43.950 INFO:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-01-26T15:31:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:31:43.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:31:43.962 INFO:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:44.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:44.072 7f6dab4c9c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-01-26T15:31:44.082 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:44.072 7f6dab4c9c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-01-26T15:31:44.082 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:44.072 7f6dab4c9c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-26T15:31:44.083 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:44.072 7f6dab4c9c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-26T15:31:44.083 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:44.072 7f6dab4c9c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-26T15:31:44.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:44.080 7f6dab4c9c00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-01-26T15:31:46.246 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-01-26T15:31:46.260 INFO:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:46.342 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:46.340 7f0b4b3d5c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-01-26T15:31:46.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:46.340 7f0b4b3d5c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-01-26T15:31:46.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:46.340 7f0b4b3d5c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-26T15:31:46.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:46.340 7f0b4b3d5c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-26T15:31:46.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:46.340 7f0b4b3d5c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-26T15:31:46.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:46.340 7f0b4b3d5c00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-01-26T15:31:48.510 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-01-26T15:31:48.569 INFO:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:48.652 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:48.648 7f7b1410cc00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-01-26T15:31:48.652 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:48.648 7f7b1410cc00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-01-26T15:31:48.653 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:48.648 7f7b1410cc00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-26T15:31:48.653 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:48.648 7f7b1410cc00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-26T15:31:48.653 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:48.648 7f7b1410cc00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-26T15:31:48.653 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:48.648 7f7b1410cc00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-01-26T15:31:50.805 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-01-26T15:31:50.860 INFO:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:50.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:50.940 7f2fc3d8dc00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-01-26T15:31:50.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:50.940 7f2fc3d8dc00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-01-26T15:31:50.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:50.940 7f2fc3d8dc00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-26T15:31:50.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:50.940 7f2fc3d8dc00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-26T15:31:50.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:50.940 7f2fc3d8dc00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-26T15:31:50.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:50.944 7f2fc3d8dc00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-01-26T15:31:53.117 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-01-26T15:31:53.172 INFO:tasks.ceph:Reading keys from all nodes... 2020-01-26T15:31:53.173 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:53.219 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.Ml9dCB5wkK 2020-01-26T15:31:53.219 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.Ml9dCB5wkK 2020-01-26T15:31:53.276 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.Ml9dCB5wkK 2020-01-26T15:31:53.381 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.Ml9dCB5wkK is 56B 2020-01-26T15:31:53.431 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.Ml9dCB5wkK 2020-01-26T15:31:53.437 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:53.483 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.QLcZ8epDQT 2020-01-26T15:31:53.483 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.QLcZ8epDQT 2020-01-26T15:31:53.543 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.QLcZ8epDQT 2020-01-26T15:31:53.649 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.QLcZ8epDQT is 56B 2020-01-26T15:31:53.660 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.QLcZ8epDQT 2020-01-26T15:31:53.667 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:53.719 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.Y1mPUYY0L3 2020-01-26T15:31:53.719 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.Y1mPUYY0L3 2020-01-26T15:31:53.776 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.Y1mPUYY0L3 2020-01-26T15:31:53.881 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.Y1mPUYY0L3 is 56B 2020-01-26T15:31:53.892 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.Y1mPUYY0L3 2020-01-26T15:31:53.898 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:53.947 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.FZuPP0J7eA 2020-01-26T15:31:53.947 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.FZuPP0J7eA 2020-01-26T15:31:54.004 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.FZuPP0J7eA 2020-01-26T15:31:54.109 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.FZuPP0J7eA is 56B 2020-01-26T15:31:54.160 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.FZuPP0J7eA 2020-01-26T15:31:54.167 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:54.215 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.UbsY7Uz0jE 2020-01-26T15:31:54.215 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.UbsY7Uz0jE 2020-01-26T15:31:54.272 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.UbsY7Uz0jE 2020-01-26T15:31:54.377 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.UbsY7Uz0jE is 56B 2020-01-26T15:31:54.389 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.UbsY7Uz0jE 2020-01-26T15:31:54.394 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:54.443 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.UokkgKZzEC 2020-01-26T15:31:54.443 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.UokkgKZzEC 2020-01-26T15:31:54.499 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.UokkgKZzEC 2020-01-26T15:31:54.609 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.UokkgKZzEC is 56B 2020-01-26T15:31:54.620 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.UokkgKZzEC 2020-01-26T15:31:54.626 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:54.675 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.pawl53NIGS 2020-01-26T15:31:54.675 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.pawl53NIGS 2020-01-26T15:31:54.731 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.pawl53NIGS 2020-01-26T15:31:54.850 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.pawl53NIGS is 56B 2020-01-26T15:31:54.861 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.pawl53NIGS 2020-01-26T15:31:54.868 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:54.915 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.A5cjrCpXtB 2020-01-26T15:31:54.915 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.A5cjrCpXtB 2020-01-26T15:31:54.972 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.A5cjrCpXtB 2020-01-26T15:31:55.077 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.A5cjrCpXtB is 56B 2020-01-26T15:31:55.087 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.A5cjrCpXtB 2020-01-26T15:31:55.093 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:31:55.143 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.g6aLtO4Dgm 2020-01-26T15:31:55.143 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.g6aLtO4Dgm 2020-01-26T15:31:55.202 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.g6aLtO4Dgm 2020-01-26T15:31:55.309 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.g6aLtO4Dgm is 56B 2020-01-26T15:31:55.321 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.g6aLtO4Dgm 2020-01-26T15:31:55.337 DEBUG:teuthology.orchestra.remote:smithi008:/etc/ceph/ceph.client.0.keyring is 59B 2020-01-26T15:31:55.357 DEBUG:teuthology.orchestra.remote:smithi163:/etc/ceph/ceph.client.1.keyring is 59B 2020-01-26T15:31:55.378 INFO:tasks.ceph:Adding keys to all mons... 2020-01-26T15:31:55.378 INFO:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2020-01-26T15:31:55.392 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2020-01-26T15:31:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDcsC1eoTouIRAAZq2qdSPR2ymGexB3CY3O2A== 2020-01-26T15:31:55.392 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2020-01-26T15:31:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDcsC1eLPx2JhAAo6wiG9qjX3X4PtfyrJmkrQ== 2020-01-26T15:31:55.392 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2020-01-26T15:31:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDcsC1eE3q0KxAA8S78vRmZIWrktIYoaJOPEw== 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDcsC1eocUbNBAAR3xXow9qCaHv1J3XnmNIcg== 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDdsC1eybrmABAA7+I1UZ1tAkkVYf5ET7WHlg== 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDgsC1eiDmIBBAA5hL1t8zcZLu+c387fHmvZA== 2020-01-26T15:31:55.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDisC1ef052FBAALM8yYLr0Fd8vYU5NJUzamQ== 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDksC1eOJPxJhAA+LmIRH2x4QYZvL42hUPtuw== 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDmsC1ekHxiOBAAwg4znpRX+RozokvwYhmnRw== 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2020-01-26T15:31:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDdsC1elbgwCxAAm51rl7xypiQIrQU2ACGEQA== 2020-01-26T15:31:55.395 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2020-01-26T15:31:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDdsC1eiaK/EhAAgIaGs9z/xM6a4D6P0/A7zw== 2020-01-26T15:31:55.395 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-26T15:31:55.477 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-26T15:31:55.560 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-26T15:31:55.642 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-26T15:31:55.727 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-26T15:31:55.810 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:31:55.895 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:31:55.977 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:31:56.063 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:31:56.149 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-01-26T15:31:56.232 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-01-26T15:31:56.316 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-01-26T15:31:56.316 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-01-26T15:31:56.372 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-26T15:31:56.469 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-01-26T15:31:56.484 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-01-26T15:31:56.538 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-26T15:31:56.640 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-01-26T15:31:56.656 INFO:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-01-26T15:31:56.709 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-26T15:31:56.807 INFO:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-01-26T15:31:56.822 INFO:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:31:56.871 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-01-26T15:31:56.871 INFO:tasks.ceph.mon.a:Restarting daemon 2020-01-26T15:31:56.871 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-01-26T15:31:56.915 INFO:tasks.ceph.mon.a:Started 2020-01-26T15:31:56.915 INFO:tasks.ceph.mon.b:Restarting daemon 2020-01-26T15:31:56.915 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-01-26T15:31:56.918 INFO:tasks.ceph.mon.b:Started 2020-01-26T15:31:56.918 INFO:tasks.ceph.mon.c:Restarting daemon 2020-01-26T15:31:56.918 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-01-26T15:31:56.921 INFO:tasks.ceph.mon.c:Started 2020-01-26T15:31:56.921 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-01-26T15:31:56.922 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-01-26T15:31:56.922 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-01-26T15:31:56.924 INFO:tasks.ceph.mgr.x:Started 2020-01-26T15:31:56.925 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-01-26T15:31:56.925 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-01-26T15:31:56.927 INFO:tasks.ceph.mgr.y:Started 2020-01-26T15:31:56.928 INFO:tasks.ceph:Setting crush tunables to default 2020-01-26T15:31:56.928 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd crush tunables default 2020-01-26T15:31:57.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:57.044 7f98d9321700 1 Processor -- start 2020-01-26T15:31:57.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:57.044 7f98d9321700 1 -- - start start 2020-01-26T15:31:57.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:57.044 7f98d9321700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d414bb30 con 0 2020-01-26T15:31:57.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:57.044 7f98d9321700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d414bed0 con 0 2020-01-26T15:31:57.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:31:57.044 7f98d3269700 1 -- 172.21.15.170:0/3607726403 learned_addr learned my addr 172.21.15.170:0/3607726403 2020-01-26T15:32:02.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.060 7f98d2267700 1 -- 172.21.15.170:0/3607726403 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f98c4003630 con 0x7f98d41480f0 2020-01-26T15:32:02.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.060 7f98d2267700 1 -- 172.21.15.170:0/3607726403 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2928358807 0 0) 0x7f98c40039b0 con 0x7f98d41480f0 2020-01-26T15:32:02.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.060 7f98d2267700 1 -- 172.21.15.170:0/3607726403 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f98c0002a20 con 0 2020-01-26T15:32:02.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d2267700 1 -- 172.21.15.170:0/3607726403 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2815177099 0 0) 0x7f98c4003f80 con 0x7f98d41480f0 2020-01-26T15:32:02.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d2267700 1 -- 172.21.15.170:0/3607726403 >> 172.21.15.170:6791/0 conn(0x7f98d414b3f0 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:32:02.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d2267700 1 -- 172.21.15.170:0/3607726403 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d407a890 con 0 2020-01-26T15:32:02.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d2267700 1 -- 172.21.15.170:0/3607726403 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f98d40ea010 con 0x7f98d41480f0 2020-01-26T15:32:02.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d2267700 1 -- 172.21.15.170:0/3607726403 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f98c4001050 con 0x7f98d41480f0 2020-01-26T15:32:02.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d9321700 1 -- 172.21.15.170:0/3607726403 >> 172.21.15.170:6789/0 conn(0x7f98d41480f0 :-1 s=STATE_OPEN pgs=5 cs=1 l=1).mark_down 2020-01-26T15:32:02.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d9321700 1 -- 172.21.15.170:0/3607726403 shutdown_connections 2020-01-26T15:32:02.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d9321700 1 -- 172.21.15.170:0/3607726403 shutdown_connections 2020-01-26T15:32:02.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d9321700 1 -- 172.21.15.170:0/3607726403 wait complete. 2020-01-26T15:32:02.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.064 7f98d9321700 1 -- 172.21.15.170:0/3607726403 >> 172.21.15.170:0/3607726403 conn(0x7f98d4144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:02.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.068 7f98d9321700 1 Processor -- start 2020-01-26T15:32:02.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.068 7f98d9321700 1 -- - start start 2020-01-26T15:32:02.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.068 7f98d9321700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40a3c50 con 0 2020-01-26T15:32:02.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.068 7f98d9321700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40a6990 con 0 2020-01-26T15:32:02.072 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.068 7f98d3269700 1 -- 172.21.15.170:0/2234796337 learned_addr learned my addr 172.21.15.170:0/2234796337 2020-01-26T15:32:02.073 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.068 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f98c8002270 con 0x7f98d40a61e0 2020-01-26T15:32:02.073 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2696922771 0 0) 0x7f98c8002570 con 0x7f98d40a61e0 2020-01-26T15:32:02.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f98b4002960 con 0 2020-01-26T15:32:02.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3728166531 0 0) 0x7f98c8002a10 con 0x7f98d40a61e0 2020-01-26T15:32:02.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98b4004170 con 0 2020-01-26T15:32:02.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1093505874 0 0) 0x7f98c80010f0 con 0x7f98d40a61e0 2020-01-26T15:32:02.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 >> 172.21.15.170:6791/0 conn(0x7f98d40a3260 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-01-26T15:32:02.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d407aaf0 con 0 2020-01-26T15:32:02.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d9321700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d40b26f0 con 0 2020-01-26T15:32:02.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d9321700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d418b130 con 0 2020-01-26T15:32:02.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f98d4116ea0 con 0x7f98d40a61e0 2020-01-26T15:32:02.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f98c8001360 con 0x7f98d40a61e0 2020-01-26T15:32:02.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 1) v1 ==== 142+0+0 (1513742652 0 0) 0x7f98c8001740 con 0x7f98d40a61e0 2020-01-26T15:32:02.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.072 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 718+0+0 (2711622516 0 0) 0x7f98c80031f0 con 0x7f98d40a61e0 2020-01-26T15:32:02.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.076 7f98d9321700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b0002070 con 0 2020-01-26T15:32:02.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.080 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f98c80036a0 con 0x7f98d40a61e0 2020-01-26T15:32:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.176 7f98d9321700 1 -- 172.21.15.170:0/2234796337 --> 172.21.15.170:6790/0 -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f98b00011e0 con 0 2020-01-26T15:32:02.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.180 7f98d0a64700 1 -- 172.21.15.170:0/2234796337 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (2119647551 0 0) 0x7f98c80038e0 con 0x7f98d40a61e0 2020-01-26T15:32:02.182 INFO:teuthology.orchestra.run.smithi170.stderr:adjusted tunables profile to default 2020-01-26T15:32:02.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.180 7f98d9321700 1 -- 172.21.15.170:0/2234796337 >> 172.21.15.170:6790/0 conn(0x7f98d40a61e0 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-01-26T15:32:02.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.180 7f98d9321700 1 -- 172.21.15.170:0/2234796337 shutdown_connections 2020-01-26T15:32:02.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.180 7f98d9321700 1 -- 172.21.15.170:0/2234796337 shutdown_connections 2020-01-26T15:32:02.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.180 7f98d9321700 1 -- 172.21.15.170:0/2234796337 wait complete. 2020-01-26T15:32:02.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:02.180 7f98d9321700 1 -- 172.21.15.170:0/2234796337 >> 172.21.15.170:0/2234796337 conn(0x7f98d4099440 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:02.195 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-01-26T15:32:02.196 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:32:02.207 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.hU8eqPm302 2020-01-26T15:32:02.208 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.hU8eqPm302 2020-01-26T15:32:02.264 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.hU8eqPm302 2020-01-26T15:32:02.365 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.hU8eqPm302 is 37B 2020-01-26T15:32:02.375 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.hU8eqPm302 2020-01-26T15:32:02.392 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:32:02.439 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.LhotfW1z3D 2020-01-26T15:32:02.439 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.LhotfW1z3D 2020-01-26T15:32:02.505 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.LhotfW1z3D 2020-01-26T15:32:02.613 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.LhotfW1z3D is 37B 2020-01-26T15:32:02.626 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.LhotfW1z3D 2020-01-26T15:32:02.631 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:32:02.679 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.AIORATopJw 2020-01-26T15:32:02.679 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.AIORATopJw 2020-01-26T15:32:02.733 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.AIORATopJw 2020-01-26T15:32:02.840 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.AIORATopJw is 37B 2020-01-26T15:32:02.889 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.AIORATopJw 2020-01-26T15:32:02.896 INFO:teuthology.orchestra.run.smithi170:> mktemp 2020-01-26T15:32:02.942 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.tmwCEnJgyK 2020-01-26T15:32:02.957 INFO:teuthology.orchestra.run.smithi170:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.tmwCEnJgyK 2020-01-26T15:32:03.000 INFO:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.tmwCEnJgyK 2020-01-26T15:32:03.105 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.tmwCEnJgyK is 37B 2020-01-26T15:32:03.160 INFO:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.tmwCEnJgyK 2020-01-26T15:32:03.167 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 6fdaa328-9697-4ff6-9ca7-e68075640913 0 2020-01-26T15:32:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.300 7fc6df971700 1 Processor -- start 2020-01-26T15:32:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.300 7fc6df971700 1 -- - start start 2020-01-26T15:32:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d814bb30 con 0 2020-01-26T15:32:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d814bed0 con 0 2020-01-26T15:32:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dd196700 1 -- 172.21.15.170:0/261223670 learned_addr learned my addr 172.21.15.170:0/261223670 2020-01-26T15:32:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc6cc003630 con 0x7fc6d814b3f0 2020-01-26T15:32:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4282695261 0 0) 0x7fc6cc0039b0 con 0x7fc6d814b3f0 2020-01-26T15:32:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc6bc002a20 con 0 2020-01-26T15:32:03.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (801785011 0 0) 0x7fc6cc003f80 con 0x7fc6d814b3f0 2020-01-26T15:32:03.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 >> 172.21.15.170:6791/0 conn(0x7fc6d81480f0 :-1 s=STATE_OPEN pgs=10 cs=1 l=1).mark_down 2020-01-26T15:32:03.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d807a890 con 0 2020-01-26T15:32:03.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc6d8116ea0 con 0x7fc6d814b3f0 2020-01-26T15:32:03.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6dc995700 1 -- 172.21.15.170:0/261223670 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc6cc001050 con 0x7fc6d814b3f0 2020-01-26T15:32:03.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- 172.21.15.170:0/261223670 >> 172.21.15.170:6790/0 conn(0x7fc6d814b3f0 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-01-26T15:32:03.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- 172.21.15.170:0/261223670 shutdown_connections 2020-01-26T15:32:03.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- 172.21.15.170:0/261223670 shutdown_connections 2020-01-26T15:32:03.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- 172.21.15.170:0/261223670 wait complete. 2020-01-26T15:32:03.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.304 7fc6df971700 1 -- 172.21.15.170:0/261223670 >> 172.21.15.170:0/261223670 conn(0x7fc6d8144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6df971700 1 Processor -- start 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6df971700 1 -- - start start 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6df971700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d80a3bf0 con 0 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6df971700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d80a6930 con 0 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6dd997700 1 -- 172.21.15.170:0/1625311246 learned_addr learned my addr 172.21.15.170:0/1625311246 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc6cc000e50 con 0x7fc6d80a6180 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc6d40024f0 con 0x7fc6d80a3200 2020-01-26T15:32:03.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (964146684 0 0) 0x7fc6cc001570 con 0x7fc6d80a6180 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc6c0002df0 con 0 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2085949207 0 0) 0x7fc6d40027f0 con 0x7fc6d80a3200 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc6c0004620 con 0 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2598950413 0 0) 0x7fc6cc001940 con 0x7fc6d80a6180 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6c0004df0 con 0 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1097359655 0 0) 0x7fc6d4002be0 con 0x7fc6d80a3200 2020-01-26T15:32:03.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6c0006570 con 0 2020-01-26T15:32:03.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.308 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3496962542 0 0) 0x7fc6cc003680 con 0x7fc6d80a6180 2020-01-26T15:32:03.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 >> 172.21.15.170:6790/0 conn(0x7fc6d80a3200 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=13 cs=1 l=1).mark_down 2020-01-26T15:32:03.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d807aaf0 con 0 2020-01-26T15:32:03.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6df971700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d80b26f0 con 0 2020-01-26T15:32:03.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6df971700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d818b0e0 con 0 2020-01-26T15:32:03.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc6cc001360 con 0x7fc6d80a6180 2020-01-26T15:32:03.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc6cc0038f0 con 0x7fc6d80a6180 2020-01-26T15:32:03.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1815887190 0 0) 0x7fc6cc004650 con 0x7fc6d80a6180 2020-01-26T15:32:03.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.312 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 718+0+0 (2246195370 0 0) 0x7fc6cc004ed0 con 0x7fc6d80a6180 2020-01-26T15:32:03.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.316 7fc6df971700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d807ae70 con 0 2020-01-26T15:32:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.320 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7fc6d807ae70 con 0x7fc6d80a6180 2020-01-26T15:32:03.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.396 7fc6df971700 1 -- 172.21.15.170:0/1625311246 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd new", "uuid": "6fdaa328-9697-4ff6-9ca7-e68075640913", "id": 0} v 0) v1 -- 0x7fc6d80b51a0 con 0 2020-01-26T15:32:03.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.404 7fc6caffd700 1 -- 172.21.15.170:0/1625311246 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fdaa328-9697-4ff6-9ca7-e68075640913", "id": 0}]=0 v3) v1 ==== 112+0+2 (2773500494 0 732707515) 0x7fc6cc005170 con 0x7fc6d80a6180 2020-01-26T15:32:03.414 INFO:teuthology.orchestra.run.smithi170.stdout:0 2020-01-26T15:32:03.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.412 7fc6df971700 1 -- 172.21.15.170:0/1625311246 >> 172.21.15.170:6791/0 conn(0x7fc6d80a6180 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-01-26T15:32:03.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.412 7fc6df971700 1 -- 172.21.15.170:0/1625311246 shutdown_connections 2020-01-26T15:32:03.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.412 7fc6df971700 1 -- 172.21.15.170:0/1625311246 shutdown_connections 2020-01-26T15:32:03.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.412 7fc6df971700 1 -- 172.21.15.170:0/1625311246 wait complete. 2020-01-26T15:32:03.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.412 7fc6df971700 1 -- 172.21.15.170:0/1625311246 >> 172.21.15.170:0/1625311246 conn(0x7fc6d8099440 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.427 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 32b5087d-d77d-4c3d-8736-f4f41237b81e 1 2020-01-26T15:32:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcfbabe700 1 Processor -- start 2020-01-26T15:32:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcfbabe700 1 -- - start start 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcfbabe700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf414bb30 con 0 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcfbabe700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf414bed0 con 0 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf92e3700 1 -- 172.21.15.170:0/267265726 learned_addr learned my addr 172.21.15.170:0/267265726 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdcf00022a0 con 0x7fdcf41480f0 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1752344332 0 0) 0x7fdcf0002620 con 0x7fdcf41480f0 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdcd8002a20 con 0 2020-01-26T15:32:03.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdce40035b0 con 0x7fdcf414b3f0 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1765799573 0 0) 0x7fdce40038b0 con 0x7fdcf414b3f0 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdcd80046c0 con 0 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3149400151 0 0) 0x7fdcf0002bf0 con 0x7fdcf41480f0 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 >> 172.21.15.170:6789/0 conn(0x7fdcf414b3f0 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.512 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf407a890 con 0 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fdcf40ea010 con 0x7fdcf41480f0 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- 172.21.15.170:0/267265726 >> 172.21.15.170:6790/0 conn(0x7fdcf41480f0 :-1 s=STATE_OPEN pgs=14 cs=1 l=1).mark_down 2020-01-26T15:32:03.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcf8ae2700 1 -- 172.21.15.170:0/267265726 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdcf0001050 con 0x7fdcf41480f0 2020-01-26T15:32:03.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- 172.21.15.170:0/267265726 shutdown_connections 2020-01-26T15:32:03.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- 172.21.15.170:0/267265726 shutdown_connections 2020-01-26T15:32:03.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- 172.21.15.170:0/267265726 wait complete. 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- 172.21.15.170:0/267265726 >> 172.21.15.170:0/267265726 conn(0x7fdcf4144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 Processor -- start 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- - start start 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40a3bb0 con 0 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcfbabe700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40a6820 con 0 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdcf92e3700 1 -- 172.21.15.170:0/393097494 learned_addr learned my addr 172.21.15.170:0/393097494 2020-01-26T15:32:03.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdce4003850 con 0x7fdcf40a61d0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (47550700 0 0) 0x7fdce4003bd0 con 0x7fdcf40a61d0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdcdc002960 con 0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdcf0000e50 con 0x7fdcf40a31c0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1597710139 0 0) 0x7fdcf0001ff0 con 0x7fdcf40a31c0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdcdc004620 con 0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (16372633 0 0) 0x7fdcf0002380 con 0x7fdcf40a31c0 2020-01-26T15:32:03.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdcdc002ee0 con 0 2020-01-26T15:32:03.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1772639328 0 0) 0x7fdce4000e50 con 0x7fdcf40a61d0 2020-01-26T15:32:03.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.516 7fdceaffd700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdcdc003540 con 0 2020-01-26T15:32:03.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3234934986 0 0) 0x7fdcf0001800 con 0x7fdcf40a31c0 2020-01-26T15:32:03.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 >> 172.21.15.170:6791/0 conn(0x7fdcf40a61d0 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-01-26T15:32:03.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf407aaf0 con 0 2020-01-26T15:32:03.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf40b2580 con 0 2020-01-26T15:32:03.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf418b040 con 0 2020-01-26T15:32:03.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fdcf0000bf0 con 0x7fdcf40a31c0 2020-01-26T15:32:03.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdcf0001a70 con 0x7fdcf40a31c0 2020-01-26T15:32:03.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1815887190 0 0) 0x7fdcf00030b0 con 0x7fdcf40a31c0 2020-01-26T15:32:03.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.520 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 989+0+0 (226745696 0 0) 0x7fdcf0003950 con 0x7fdcf40a31c0 2020-01-26T15:32:03.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.528 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd0002070 con 0 2020-01-26T15:32:03.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.532 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7fdcf0013db0 con 0x7fdcf40a31c0 2020-01-26T15:32:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.608 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd new", "uuid": "32b5087d-d77d-4c3d-8736-f4f41237b81e", "id": 1} v 0) v1 -- 0x7fdcd0001290 con 0 2020-01-26T15:32:03.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.616 7fdceaffd700 1 -- 172.21.15.170:0/393097494 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32b5087d-d77d-4c3d-8736-f4f41237b81e", "id": 1}]=0 v4) v1 ==== 112+0+2 (4242191332 0 940483276) 0x7fdcf0004020 con 0x7fdcf40a31c0 2020-01-26T15:32:03.627 INFO:teuthology.orchestra.run.smithi170.stdout:1 2020-01-26T15:32:03.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.624 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 >> 172.21.15.170:6790/0 conn(0x7fdcf40a31c0 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).mark_down 2020-01-26T15:32:03.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.624 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 shutdown_connections 2020-01-26T15:32:03.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.624 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 shutdown_connections 2020-01-26T15:32:03.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.624 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 wait complete. 2020-01-26T15:32:03.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.624 7fdcfbabe700 1 -- 172.21.15.170:0/393097494 >> 172.21.15.170:0/393097494 conn(0x7fdcf4099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.639 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new f8248e42-e78d-4926-9c81-1a1c4199b946 2 2020-01-26T15:32:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f330935c700 1 Processor -- start 2020-01-26T15:32:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f330935c700 1 -- - start start 2020-01-26T15:32:03.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f330935c700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330414bb30 con 0 2020-01-26T15:32:03.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f330935c700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330414bed0 con 0 2020-01-26T15:32:03.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302a68700 1 -- 172.21.15.170:0/2786789749 learned_addr learned my addr 172.21.15.170:0/2786789749 2020-01-26T15:32:03.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32f8003630 con 0x7f330414b3f0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (460912683 0 0) 0x7f32f80039b0 con 0x7f330414b3f0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f32f0002a20 con 0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32f40022a0 con 0x7f33041480f0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2610663877 0 0) 0x7f32f4002620 con 0x7f33041480f0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f32f00046c0 con 0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1700534545 0 0) 0x7f32f8003f80 con 0x7f330414b3f0 2020-01-26T15:32:03.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 >> 172.21.15.170:6790/0 conn(0x7f33041480f0 :-1 s=STATE_OPEN pgs=16 cs=1 l=1).mark_down 2020-01-26T15:32:03.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330407a890 con 0 2020-01-26T15:32:03.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3304116ea0 con 0x7f330414b3f0 2020-01-26T15:32:03.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f3302267700 1 -- 172.21.15.170:0/2786789749 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32f8001050 con 0x7f330414b3f0 2020-01-26T15:32:03.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.720 7f330935c700 1 -- 172.21.15.170:0/2786789749 >> 172.21.15.170:6791/0 conn(0x7f330414b3f0 :-1 s=STATE_OPEN pgs=13 cs=1 l=1).mark_down 2020-01-26T15:32:03.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- 172.21.15.170:0/2786789749 shutdown_connections 2020-01-26T15:32:03.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- 172.21.15.170:0/2786789749 shutdown_connections 2020-01-26T15:32:03.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- 172.21.15.170:0/2786789749 wait complete. 2020-01-26T15:32:03.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- 172.21.15.170:0/2786789749 >> 172.21.15.170:0/2786789749 conn(0x7f3304144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 Processor -- start 2020-01-26T15:32:03.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- - start start 2020-01-26T15:32:03.731 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040a3c90 con 0 2020-01-26T15:32:03.731 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f330935c700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040a6870 con 0 2020-01-26T15:32:03.731 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3302a68700 1 -- 172.21.15.170:0/3590056078 learned_addr learned my addr 172.21.15.170:0/3590056078 2020-01-26T15:32:03.731 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32f8000e50 con 0x7f33040a6220 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32f4002b60 con 0x7f33040a32d0 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (92941814 0 0) 0x7f32f8001570 con 0x7f33040a6220 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f32e4002df0 con 0 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2006633569 0 0) 0x7f32f4002130 con 0x7f33040a32d0 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f32e4004620 con 0 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2156720674 0 0) 0x7f32f8001940 con 0x7f33040a6220 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.724 7f3300a64700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f32e4004df0 con 0 2020-01-26T15:32:03.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2135610097 0 0) 0x7f32f40024f0 con 0x7f33040a32d0 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f32e40034b0 con 0 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2218056008 0 0) 0x7f32f8003620 con 0x7f33040a6220 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 >> 172.21.15.170:6789/0 conn(0x7f33040a32d0 :-1 s=STATE_OPEN pgs=9 cs=1 l=1).mark_down 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330407aaf0 con 0 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f330935c700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33040b2640 con 0 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f330935c700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f330418b190 con 0 2020-01-26T15:32:03.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f32f8000bf0 con 0x7f33040a6220 2020-01-26T15:32:03.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32f8003a50 con 0x7f33040a6220 2020-01-26T15:32:03.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1815887190 0 0) 0x7f32f8004530 con 0x7f33040a6220 2020-01-26T15:32:03.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.728 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1260+0+0 (2521021866 0 0) 0x7f32f80049f0 con 0x7f33040a6220 2020-01-26T15:32:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.732 7f330935c700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0002070 con 0 2020-01-26T15:32:03.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.740 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f32f8014db0 con 0x7f33040a6220 2020-01-26T15:32:03.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.812 7f330935c700 1 -- 172.21.15.170:0/3590056078 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd new", "uuid": "f8248e42-e78d-4926-9c81-1a1c4199b946", "id": 2} v 0) v1 -- 0x7f32e00012c0 con 0 2020-01-26T15:32:03.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.820 7f3300a64700 1 -- 172.21.15.170:0/3590056078 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8248e42-e78d-4926-9c81-1a1c4199b946", "id": 2}]=0 v5) v1 ==== 112+0+2 (1792337394 0 216599125) 0x7f32f8005020 con 0x7f33040a6220 2020-01-26T15:32:03.831 INFO:teuthology.orchestra.run.smithi170.stdout:2 2020-01-26T15:32:03.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.832 7f330935c700 1 -- 172.21.15.170:0/3590056078 >> 172.21.15.170:6791/0 conn(0x7f33040a6220 :-1 s=STATE_OPEN pgs=14 cs=1 l=1).mark_down 2020-01-26T15:32:03.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.832 7f330935c700 1 -- 172.21.15.170:0/3590056078 shutdown_connections 2020-01-26T15:32:03.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.832 7f330935c700 1 -- 172.21.15.170:0/3590056078 shutdown_connections 2020-01-26T15:32:03.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.832 7f330935c700 1 -- 172.21.15.170:0/3590056078 wait complete. 2020-01-26T15:32:03.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.832 7f330935c700 1 -- 172.21.15.170:0/3590056078 >> 172.21.15.170:0/3590056078 conn(0x7f3304099390 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.850 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 6e582686-4f2c-467b-8c9a-c79a94d3887f 3 2020-01-26T15:32:03.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f837f351700 1 Processor -- start 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f837f351700 1 -- - start start 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f837f351700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837814bb80 con 0 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f837f351700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837814bf20 con 0 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f837d377700 1 -- 172.21.15.170:0/1141306568 learned_addr learned my addr 172.21.15.170:0/1141306568 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8370003630 con 0x7f83781480f0 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f83680022a0 con 0x7f837814b3f0 2020-01-26T15:32:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1987033249 0 0) 0x7f83700039b0 con 0x7f83781480f0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f835c002ea0 con 0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1777526163 0 0) 0x7f8368002620 con 0x7f837814b3f0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f835c0046a0 con 0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4138551566 0 0) 0x7f8368002ac0 con 0x7f837814b3f0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 >> 172.21.15.170:6789/0 conn(0x7f83781480f0 :-1 s=STATE_OPEN pgs=10 cs=1 l=1).mark_down 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837807a890 con 0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8378116ea0 con 0x7f837814b3f0 2020-01-26T15:32:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f836ffff700 1 -- 172.21.15.170:0/1141306568 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8368001010 con 0x7f837814b3f0 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.932 7f837f351700 1 -- 172.21.15.170:0/1141306568 >> 172.21.15.170:6791/0 conn(0x7f837814b3f0 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).mark_down 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- 172.21.15.170:0/1141306568 shutdown_connections 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- 172.21.15.170:0/1141306568 shutdown_connections 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- 172.21.15.170:0/1141306568 wait complete. 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- 172.21.15.170:0/1141306568 >> 172.21.15.170:0/1141306568 conn(0x7f8378144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 Processor -- start 2020-01-26T15:32:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- - start start 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83780a3cc0 con 0 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837f351700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83780a5120 con 0 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f837d377700 1 -- 172.21.15.170:0/2655362887 learned_addr learned my addr 172.21.15.170:0/2655362887 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8368000e50 con 0x7f8378095bb0 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3980379236 0 0) 0x7f83680020b0 con 0x7f8378095bb0 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8360002960 con 0 2020-01-26T15:32:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8370003380 con 0x7f83780a3370 2020-01-26T15:32:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (993953824 0 0) 0x7f8370003640 con 0x7f83780a3370 2020-01-26T15:32:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8360004620 con 0 2020-01-26T15:32:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3393416906 0 0) 0x7f8368002500 con 0x7f8378095bb0 2020-01-26T15:32:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8360002ee0 con 0 2020-01-26T15:32:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.936 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (952518819 0 0) 0x7f83700039c0 con 0x7f83780a3370 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8360003540 con 0 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3648803164 0 0) 0x7f83680017d0 con 0x7f8378095bb0 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 >> 172.21.15.170:6789/0 conn(0x7f83780a3370 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837807aaf0 con 0 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f837f351700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83780b2750 con 0 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f837f351700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f83780a69b0 con 0 2020-01-26T15:32:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8368001320 con 0x7f8378095bb0 2020-01-26T15:32:03.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8368002da0 con 0x7f8378095bb0 2020-01-26T15:32:03.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (1815887190 0 0) 0x7f83680032e0 con 0x7f8378095bb0 2020-01-26T15:32:03.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.940 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1531+0+0 (434584803 0 0) 0x7f8368004320 con 0x7f8378095bb0 2020-01-26T15:32:03.963 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.948 7f837f351700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837807ae70 con 0 2020-01-26T15:32:03.963 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:03.952 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f837807ae70 con 0x7f8378095bb0 2020-01-26T15:32:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.028 7f837f351700 1 -- 172.21.15.170:0/2655362887 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd new", "uuid": "6e582686-4f2c-467b-8c9a-c79a94d3887f", "id": 3} v 0) v1 -- 0x7f8378070bc0 con 0 2020-01-26T15:32:04.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.036 7f836e7fc700 1 -- 172.21.15.170:0/2655362887 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e582686-4f2c-467b-8c9a-c79a94d3887f", "id": 3}]=0 v6) v1 ==== 112+0+2 (1847741778 0 525046306) 0x7f83680045c0 con 0x7f8378095bb0 2020-01-26T15:32:04.045 INFO:teuthology.orchestra.run.smithi170.stdout:3 2020-01-26T15:32:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.044 7f837f351700 1 -- 172.21.15.170:0/2655362887 >> 172.21.15.170:6791/0 conn(0x7f8378095bb0 :-1 s=STATE_OPEN pgs=16 cs=1 l=1).mark_down 2020-01-26T15:32:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.044 7f837f351700 1 -- 172.21.15.170:0/2655362887 shutdown_connections 2020-01-26T15:32:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.044 7f837f351700 1 -- 172.21.15.170:0/2655362887 shutdown_connections 2020-01-26T15:32:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.044 7f837f351700 1 -- 172.21.15.170:0/2655362887 wait complete. 2020-01-26T15:32:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:04.044 7f837f351700 1 -- 172.21.15.170:0/2655362887 >> 172.21.15.170:0/2655362887 conn(0x7f8378099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:04.058 INFO:tasks.ceph.osd.0:Restarting daemon 2020-01-26T15:32:04.058 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-01-26T15:32:04.061 INFO:tasks.ceph.osd.0:Started 2020-01-26T15:32:04.061 INFO:tasks.ceph.osd.1:Restarting daemon 2020-01-26T15:32:04.061 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-01-26T15:32:04.063 INFO:tasks.ceph.osd.1:Started 2020-01-26T15:32:04.063 INFO:tasks.ceph.osd.2:Restarting daemon 2020-01-26T15:32:04.064 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-01-26T15:32:04.066 INFO:tasks.ceph.osd.2:Started 2020-01-26T15:32:04.066 INFO:tasks.ceph.osd.3:Restarting daemon 2020-01-26T15:32:04.067 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-01-26T15:32:04.069 INFO:tasks.ceph.osd.3:Started 2020-01-26T15:32:04.069 INFO:tasks.ceph:Waiting for OSDs to come up 2020-01-26T15:32:04.129 INFO:tasks.ceph.osd.0.smithi170.stdout:starting osd.0 at - osd_data /var/lib/ceph/osd/ceph-0 /var/lib/ceph/osd/ceph-0/journal 2020-01-26T15:32:04.140 INFO:tasks.ceph.osd.2.smithi170.stdout:starting osd.2 at - osd_data /var/lib/ceph/osd/ceph-2 /var/lib/ceph/osd/ceph-2/journal 2020-01-26T15:32:04.143 INFO:tasks.ceph.osd.1.smithi170.stdout:starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal 2020-01-26T15:32:04.147 INFO:tasks.ceph.osd.3.smithi170.stdout:starting osd.3 at - osd_data /var/lib/ceph/osd/ceph-3 /var/lib/ceph/osd/ceph-3/journal 2020-01-26T15:32:04.471 INFO:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:04.556 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31fa4ae700 1 Processor -- start 2020-01-26T15:32:04.556 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31fa4ae700 1 -- - start start 2020-01-26T15:32:04.557 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31fa4ae700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f414bb10 con 0 2020-01-26T15:32:04.557 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31fa4ae700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f414beb0 con 0 2020-01-26T15:32:04.557 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f3fff700 1 -- 172.21.15.170:0/608810788 learned_addr learned my addr 172.21.15.170:0/608810788 2020-01-26T15:32:04.562 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31e4003630 con 0x7f31f41480d0 2020-01-26T15:32:04.562 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (242383637 0 0) 0x7f31e40039b0 con 0x7f31f41480d0 2020-01-26T15:32:04.562 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31d4002a20 con 0 2020-01-26T15:32:04.563 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31dc0022a0 con 0x7f31f414b3d0 2020-01-26T15:32:04.563 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (722094547 0 0) 0x7f31dc002620 con 0x7f31f414b3d0 2020-01-26T15:32:04.563 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31d40046c0 con 0 2020-01-26T15:32:04.563 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3514554603 0 0) 0x7f31e4003f80 con 0x7f31f41480d0 2020-01-26T15:32:04.563 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 >> 172.21.15.170:6790/0 conn(0x7f31f414b3d0 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f407a930 con 0 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.552 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f31f40e9ff0 con 0x7f31f41480d0 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f37fe700 1 -- 172.21.15.170:0/608810788 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31e4001050 con 0x7f31f41480d0 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- 172.21.15.170:0/608810788 >> 172.21.15.170:6789/0 conn(0x7f31f41480d0 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).mark_down 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- 172.21.15.170:0/608810788 shutdown_connections 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- 172.21.15.170:0/608810788 shutdown_connections 2020-01-26T15:32:04.564 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- 172.21.15.170:0/608810788 wait complete. 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- 172.21.15.170:0/608810788 >> 172.21.15.170:0/608810788 conn(0x7f31f4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 Processor -- start 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- - start start 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40a3d30 con 0 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40a51e0 con 0 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f3fff700 1 -- 172.21.15.170:0/1765455274 learned_addr learned my addr 172.21.15.170:0/1765455274 2020-01-26T15:32:04.565 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31e4000e50 con 0x7f31f40a3430 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3782327851 0 0) 0x7f31e4001570 con 0x7f31f40a3430 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31d8002960 con 0 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31dc002b60 con 0x7f31f4095c70 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2069820326 0 0) 0x7f31dc0020e0 con 0x7f31f4095c70 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31d8004620 con 0 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2786005137 0 0) 0x7f31e40019c0 con 0x7f31f40a3430 2020-01-26T15:32:04.568 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31d8004fa0 con 0 2020-01-26T15:32:04.569 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (812857929 0 0) 0x7f31e4003620 con 0x7f31f40a3430 2020-01-26T15:32:04.569 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 >> 172.21.15.170:6791/0 conn(0x7f31f4095c70 :-1 s=STATE_OPEN pgs=18 cs=1 l=1).mark_down 2020-01-26T15:32:04.569 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f407ab90 con 0 2020-01-26T15:32:04.569 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.556 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f40b27b0 con 0 2020-01-26T15:32:04.569 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.560 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f40a6a50 con 0 2020-01-26T15:32:04.569 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.560 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f31e4000bf0 con 0x7f31f40a3430 2020-01-26T15:32:04.570 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.560 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31e4003890 con 0x7f31f40a3430 2020-01-26T15:32:04.570 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.560 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 3) v1 ==== 662+0+0 (1623228678 0 0) 0x7f31e4004760 con 0x7f31f40a3430 2020-01-26T15:32:04.570 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.560 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1802+0+0 (160319955 0 0) 0x7f31e40058b0 con 0x7f31f40a3430 2020-01-26T15:32:04.570 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.568 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc002070 con 0 2020-01-26T15:32:04.575 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.572 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f31e4005b50 con 0x7f31f40a3430 2020-01-26T15:32:04.664 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.660 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31cc0011e0 con 0 2020-01-26T15:32:04.665 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.660 7f31f1ffb700 1 -- 172.21.15.170:0/1765455274 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+2575 (3955300355 0 1032065493) 0x7f31e4004d10 con 0x7f31f40a3430 2020-01-26T15:32:04.666 INFO:teuthology.misc.health.smithi170.stdout: 2020-01-26T15:32:04.666 INFO:teuthology.misc.health.smithi170.stdout:{"epoch":6,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:04.033281","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:04.668 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.664 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 >> 172.21.15.170:6800/11008 conn(0x7f31d8002d90 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:32:04.668 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.664 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 >> 172.21.15.170:6789/0 conn(0x7f31f40a3430 :-1 s=STATE_OPEN pgs=16 cs=1 l=1).mark_down 2020-01-26T15:32:04.668 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.664 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 shutdown_connections 2020-01-26T15:32:04.668 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.664 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 shutdown_connections 2020-01-26T15:32:04.668 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.664 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 wait complete. 2020-01-26T15:32:04.668 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:04.664 7f31fa4ae700 1 -- 172.21.15.170:0/1765455274 >> 172.21.15.170:0/1765455274 conn(0x7f31f4099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:04.675 DEBUG:teuthology.misc:0 of 4 OSDs are up 2020-01-26T15:32:04.757 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26 15:32:04.752 7f6210421c00 -1 osd.0 0 log_to_monitors {default=true} 2020-01-26T15:32:04.771 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26 15:32:04.768 7f5a89ccbc00 -1 osd.2 0 log_to_monitors {default=true} 2020-01-26T15:32:04.982 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26 15:32:04.980 7f1057c79c00 -1 osd.1 0 log_to_monitors {default=true} 2020-01-26T15:32:05.021 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26 15:32:05.016 7fe2d8e1bc00 -1 osd.3 0 log_to_monitors {default=true} 2020-01-26T15:32:06.093 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26 15:32:06.092 7f5a640b9700 -1 osd.2 0 waiting for initial osdmap 2020-01-26T15:32:06.095 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26 15:32:06.092 7f61ea80f700 -1 osd.0 0 waiting for initial osdmap 2020-01-26T15:32:06.095 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26 15:32:06.092 7fe2b3209700 -1 osd.3 0 waiting for initial osdmap 2020-01-26T15:32:06.096 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26 15:32:06.092 7f1032067700 -1 osd.1 0 waiting for initial osdmap 2020-01-26T15:32:11.080 INFO:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:11.167 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f0059ca7700 1 Processor -- start 2020-01-26T15:32:11.167 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f0059ca7700 1 -- - start start 2020-01-26T15:32:11.168 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f0059ca7700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005414bb10 con 0 2020-01-26T15:32:11.168 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f0059ca7700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005414beb0 con 0 2020-01-26T15:32:11.168 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00537fe700 1 -- 172.21.15.170:0/1173140493 learned_addr learned my addr 172.21.15.170:0/1173140493 2020-01-26T15:32:11.170 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f003c0022a0 con 0x7f005414b3d0 2020-01-26T15:32:11.170 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1927111673 0 0) 0x7f003c002620 con 0x7f005414b3d0 2020-01-26T15:32:11.170 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0034002a20 con 0 2020-01-26T15:32:11.170 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f00440039b0 con 0x7f00541480d0 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (147602225 0 0) 0x7f0044003cb0 con 0x7f00541480d0 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f00340046c0 con 0 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2727286367 0 0) 0x7f003c002bf0 con 0x7f005414b3d0 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 >> 172.21.15.170:6791/0 conn(0x7f00541480d0 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.164 7f00527fc700 1 -- 172.21.15.170:0/1173140493 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005407a930 con 0 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0054116e80 con 0x7f005414b3d0 2020-01-26T15:32:11.171 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f00527fc700 1 -- 172.21.15.170:0/1173140493 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f003c001050 con 0x7f005414b3d0 2020-01-26T15:32:11.172 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- 172.21.15.170:0/1173140493 >> 172.21.15.170:6790/0 conn(0x7f005414b3d0 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:32:11.172 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- 172.21.15.170:0/1173140493 shutdown_connections 2020-01-26T15:32:11.172 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- 172.21.15.170:0/1173140493 shutdown_connections 2020-01-26T15:32:11.172 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- 172.21.15.170:0/1173140493 wait complete. 2020-01-26T15:32:11.172 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- 172.21.15.170:0/1173140493 >> 172.21.15.170:0/1173140493 conn(0x7f0054144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:11.173 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 Processor -- start 2020-01-26T15:32:11.173 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- - start start 2020-01-26T15:32:11.176 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.168 7f0059ca7700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540a3d50 con 0 2020-01-26T15:32:11.176 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0059ca7700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540a5200 con 0 2020-01-26T15:32:11.176 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0052ffd700 1 -- 172.21.15.170:0/1368488045 learned_addr learned my addr 172.21.15.170:0/1368488045 2020-01-26T15:32:11.176 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f003c001010 con 0x7f0054095cd0 2020-01-26T15:32:11.176 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3040782688 0 0) 0x7f003c001ff0 con 0x7f0054095cd0 2020-01-26T15:32:11.176 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0038002960 con 0 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f00440041f0 con 0x7f00540a3450 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2937212164 0 0) 0x7f00440037f0 con 0x7f00540a3450 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0038004620 con 0 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3290733565 0 0) 0x7f003c002620 con 0x7f0054095cd0 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0038002ee0 con 0 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (519986986 0 0) 0x7f0044003c00 con 0x7f00540a3450 2020-01-26T15:32:11.177 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0038003540 con 0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2326753950 0 0) 0x7f003c0019c0 con 0x7f0054095cd0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 >> 172.21.15.170:6789/0 conn(0x7f00540a3450 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005407ab90 con 0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540712f0 con 0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f003c000bf0 con 0x7f0054095cd0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f003c002ed0 con 0x7f0054095cd0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f00540a6cd0 con 0 2020-01-26T15:32:11.178 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f003c003910 con 0x7f0054095cd0 2020-01-26T15:32:11.179 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.172 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1938+0+0 (893752976 0 0) 0x7f003c006060 con 0x7f0054095cd0 2020-01-26T15:32:11.180 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.176 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005407af30 con 0 2020-01-26T15:32:11.185 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.180 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f005407af30 con 0x7f0054095cd0 2020-01-26T15:32:11.278 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0054073330 con 0 2020-01-26T15:32:11.279 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0050ff9700 1 -- 172.21.15.170:0/1368488045 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+3011 (4128480379 0 946219886) 0x7f003c004fa0 con 0x7f0054095cd0 2020-01-26T15:32:11.280 INFO:teuthology.misc.health.smithi170.stdout: 2020-01-26T15:32:11.280 INFO:teuthology.misc.health.smithi170.stdout:{"epoch":9,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:07.093115","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:11.281 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 >> 172.21.15.170:6800/11008 conn(0x7f0038006ed0 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:32:11.281 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 >> 172.21.15.170:6791/0 conn(0x7f0054095cd0 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-01-26T15:32:11.281 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 shutdown_connections 2020-01-26T15:32:11.282 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 shutdown_connections 2020-01-26T15:32:11.282 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 wait complete. 2020-01-26T15:32:11.282 INFO:teuthology.misc.health.smithi170.stderr:2020-01-26 15:32:11.276 7f0059ca7700 1 -- 172.21.15.170:0/1368488045 >> 172.21.15.170:0/1368488045 conn(0x7f0054099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:11.289 DEBUG:teuthology.misc:4 of 4 OSDs are up 2020-01-26T15:32:11.289 INFO:tasks.ceph:Creating RBD pool 2020-01-26T15:32:11.290 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd pool create rbd 8 2020-01-26T15:32:11.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.376 7f3bd4250700 1 Processor -- start 2020-01-26T15:32:11.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.376 7f3bd4250700 1 -- - start start 2020-01-26T15:32:11.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.376 7f3bd4250700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc14bb50 con 0 2020-01-26T15:32:11.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.376 7f3bd4250700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc14bef0 con 0 2020-01-26T15:32:11.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1a75700 1 -- 172.21.15.170:0/3512219143 learned_addr learned my addr 172.21.15.170:0/3512219143 2020-01-26T15:32:11.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3bbc002620 con 0x7f3bcc148110 2020-01-26T15:32:11.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2580767890 0 0) 0x7f3bbc0029a0 con 0x7f3bcc148110 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3bb8002a20 con 0 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3bc0003630 con 0x7f3bcc14b410 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2462958870 0 0) 0x7f3bc0003930 con 0x7f3bcc14b410 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3bb80046c0 con 0 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (584883191 0 0) 0x7f3bbc002f70 con 0x7f3bcc148110 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 >> 172.21.15.170:6791/0 conn(0x7f3bcc14b410 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc07a8b0 con 0 2020-01-26T15:32:11.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3bcc0ea030 con 0x7f3bcc148110 2020-01-26T15:32:11.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd1274700 1 -- 172.21.15.170:0/3512219143 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3bbc0013d0 con 0x7f3bcc148110 2020-01-26T15:32:11.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd4250700 1 -- 172.21.15.170:0/3512219143 >> 172.21.15.170:6789/0 conn(0x7f3bcc148110 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:32:11.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd4250700 1 -- 172.21.15.170:0/3512219143 shutdown_connections 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd4250700 1 -- 172.21.15.170:0/3512219143 shutdown_connections 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd4250700 1 -- 172.21.15.170:0/3512219143 wait complete. 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.380 7f3bd4250700 1 -- 172.21.15.170:0/3512219143 >> 172.21.15.170:0/3512219143 conn(0x7f3bcc144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd4250700 1 Processor -- start 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd4250700 1 -- - start start 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd4250700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc0a3cb0 con 0 2020-01-26T15:32:11.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd4250700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc0a6a80 con 0 2020-01-26T15:32:11.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd1a75700 1 -- 172.21.15.170:0/1870839591 learned_addr learned my addr 172.21.15.170:0/1870839591 2020-01-26T15:32:11.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3bc0003f60 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1195172977 0 0) 0x7f3bc0003470 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3bac002960 con 0 2020-01-26T15:32:11.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3bbc0011d0 con 0x7f3bcc0a32c0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3792753264 0 0) 0x7f3bbc002370 con 0x7f3bcc0a32c0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3bac004620 con 0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2092196325 0 0) 0x7f3bc0000e50 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3bac002ee0 con 0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3531453816 0 0) 0x7f3bbc002700 con 0x7f3bcc0a32c0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3bac003540 con 0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (460423803 0 0) 0x7f3bc0001360 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 >> 172.21.15.170:6789/0 conn(0x7f3bcc0a32c0 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc07ab10 con 0 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc0b2900 con 0 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3bc0000bf0 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc18b220 con 0 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3bc0001790 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f3bc0004780 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.384 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1938+0+0 (893752976 0 0) 0x7f3bc0005cb0 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.392 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc07ae90 con 0 2020-01-26T15:32:11.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.396 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f3bcc07ae90 con 0x7f3bcc0a62d0 2020-01-26T15:32:11.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:11.488 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7f3bcc156410 con 0 2020-01-26T15:32:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.124 7f3bcb7fe700 1 -- 172.21.15.170:0/1870839591 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (1706632610 0 0) 0x7f3bc0004b60 con 0x7f3bcc0a62d0 2020-01-26T15:32:12.163 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'rbd' created 2020-01-26T15:32:12.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.156 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 >> 172.21.15.170:6800/11008 conn(0x7f3bac006ed0 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-01-26T15:32:12.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.156 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 >> 172.21.15.170:6791/0 conn(0x7f3bcc0a62d0 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-01-26T15:32:12.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.156 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 shutdown_connections 2020-01-26T15:32:12.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.156 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 shutdown_connections 2020-01-26T15:32:12.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.156 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 wait complete. 2020-01-26T15:32:12.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.156 7f3bd4250700 1 -- 172.21.15.170:0/1870839591 >> 172.21.15.170:0/1870839591 conn(0x7f3bcc099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:12.171 INFO:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-01-26T15:32:12.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.256 7f2c88b29700 1 Processor -- start 2020-01-26T15:32:12.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.256 7f2c88b29700 1 -- - start start 2020-01-26T15:32:12.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.256 7f2c88b29700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8414bb40 con 0 2020-01-26T15:32:12.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.256 7f2c88b29700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8414bee0 con 0 2020-01-26T15:32:12.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.256 7f2c82a68700 1 -- 172.21.15.170:0/2228678751 learned_addr learned my addr 172.21.15.170:0/2228678751 2020-01-26T15:32:12.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c6c0022a0 con 0x7f2c8414b400 2020-01-26T15:32:12.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c7c0039b0 con 0x7f2c84148100 2020-01-26T15:32:12.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (823452920 0 0) 0x7f2c6c002620 con 0x7f2c8414b400 2020-01-26T15:32:12.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c64002ea0 con 0 2020-01-26T15:32:12.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4248822083 0 0) 0x7f2c7c003cb0 con 0x7f2c84148100 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c640046b0 con 0 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1893502409 0 0) 0x7f2c6c002b10 con 0x7f2c8414b400 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 >> 172.21.15.170:6791/0 conn(0x7f2c84148100 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8407a960 con 0 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2c84116eb0 con 0x7f2c8414b400 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c81a66700 1 -- 172.21.15.170:0/2228678751 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c6c001010 con 0x7f2c8414b400 2020-01-26T15:32:12.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c88b29700 1 -- 172.21.15.170:0/2228678751 >> 172.21.15.170:6790/0 conn(0x7f2c8414b400 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:32:12.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c88b29700 1 -- 172.21.15.170:0/2228678751 shutdown_connections 2020-01-26T15:32:12.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c88b29700 1 -- 172.21.15.170:0/2228678751 shutdown_connections 2020-01-26T15:32:12.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c88b29700 1 -- 172.21.15.170:0/2228678751 wait complete. 2020-01-26T15:32:12.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.260 7f2c88b29700 1 -- 172.21.15.170:0/2228678751 >> 172.21.15.170:0/2228678751 conn(0x7f2c84144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:12.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c88b29700 1 Processor -- start 2020-01-26T15:32:12.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c88b29700 1 -- - start start 2020-01-26T15:32:12.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c88b29700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c840a3d30 con 0 2020-01-26T15:32:12.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c88b29700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c840a6b00 con 0 2020-01-26T15:32:12.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c82a68700 1 -- 172.21.15.170:0/300872598 learned_addr learned my addr 172.21.15.170:0/300872598 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c6c000e50 con 0x7f2c840a6350 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c7c0042e0 con 0x7f2c840a3340 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1465023632 0 0) 0x7f2c6c002050 con 0x7f2c840a6350 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c68002df0 con 0 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1452678234 0 0) 0x7f2c7c003790 con 0x7f2c840a3340 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c68004620 con 0 2020-01-26T15:32:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (245227600 0 0) 0x7f2c7c003c30 con 0x7f2c840a3340 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c68004df0 con 0 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1317085813 0 0) 0x7f2c6c0023d0 con 0x7f2c840a6350 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.264 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c68006570 con 0 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3398349157 0 0) 0x7f2c7c001470 con 0x7f2c840a3340 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 >> 172.21.15.170:6789/0 conn(0x7f2c840a6350 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8407abc0 con 0 2020-01-26T15:32:12.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c88b29700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c840712f0 con 0 2020-01-26T15:32:12.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c88b29700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8418b1b0 con 0 2020-01-26T15:32:12.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2c840ea020 con 0x7f2c840a3340 2020-01-26T15:32:12.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c7c0018a0 con 0x7f2c840a3340 2020-01-26T15:32:12.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2c7c0045e0 con 0x7f2c840a3340 2020-01-26T15:32:12.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.268 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(10..10 src has 1..10) v4 ==== 2196+0+0 (814007988 0 0) 0x7f2c7c005fa0 con 0x7f2c840a3340 2020-01-26T15:32:12.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.272 7f2c88b29700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5c002070 con 0 2020-01-26T15:32:12.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.276 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2c7c001cf0 con 0x7f2c840a3340 2020-01-26T15:32:12.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:12.372 7f2c88b29700 1 -- 172.21.15.170:0/300872598 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd pool application enable", "force": "--yes-i-really-mean-it", "app": "rbd", "pool": "rbd"} v 0) v1 -- 0x7f2c5c0012d0 con 0 2020-01-26T15:32:13.138 INFO:teuthology.orchestra.run.smithi170.stderr:enabled application 'rbd' on pool 'rbd' 2020-01-26T15:32:13.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.136 7f2c7bfff700 1 -- 172.21.15.170:0/300872598 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "force": "--yes-i-really-mean-it", "app": "rbd", "pool": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 178+0+0 (3289075488 0 0) 0x7f2c7c004cd0 con 0x7f2c840a3340 2020-01-26T15:32:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.140 7f2c88b29700 1 -- 172.21.15.170:0/300872598 >> 172.21.15.170:6800/11008 conn(0x7f2c680072a0 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-01-26T15:32:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.140 7f2c88b29700 1 -- 172.21.15.170:0/300872598 >> 172.21.15.170:6790/0 conn(0x7f2c840a3340 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:32:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.140 7f2c88b29700 1 -- 172.21.15.170:0/300872598 shutdown_connections 2020-01-26T15:32:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.140 7f2c88b29700 1 -- 172.21.15.170:0/300872598 shutdown_connections 2020-01-26T15:32:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.140 7f2c88b29700 1 -- 172.21.15.170:0/300872598 wait complete. 2020-01-26T15:32:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.140 7f2c88b29700 1 -- 172.21.15.170:0/300872598 >> 172.21.15.170:0/300872598 conn(0x7f2c84099740 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.153 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-01-26T15:32:13.154 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:13.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.232 7f2c69446700 1 Processor -- start 2020-01-26T15:32:13.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.232 7f2c69446700 1 -- - start start 2020-01-26T15:32:13.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6414bb10 con 0 2020-01-26T15:32:13.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6414beb0 con 0 2020-01-26T15:32:13.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62a68700 1 -- 172.21.15.170:0/2277792573 learned_addr learned my addr 172.21.15.170:0/2277792573 2020-01-26T15:32:13.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c58003630 con 0x7f2c6414b3d0 2020-01-26T15:32:13.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3406869000 0 0) 0x7f2c580039b0 con 0x7f2c6414b3d0 2020-01-26T15:32:13.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c50002a20 con 0 2020-01-26T15:32:13.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c540022a0 con 0x7f2c641480d0 2020-01-26T15:32:13.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (642368311 0 0) 0x7f2c540025a0 con 0x7f2c641480d0 2020-01-26T15:32:13.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c500046c0 con 0 2020-01-26T15:32:13.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (401277444 0 0) 0x7f2c54002a40 con 0x7f2c641480d0 2020-01-26T15:32:13.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 >> 172.21.15.170:6790/0 conn(0x7f2c6414b3d0 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=28 cs=1 l=1).mark_down 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6407a930 con 0 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2c640e9ff0 con 0x7f2c641480d0 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c62267700 1 -- 172.21.15.170:0/2277792573 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c54000e50 con 0x7f2c641480d0 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- 172.21.15.170:0/2277792573 >> 172.21.15.170:6789/0 conn(0x7f2c641480d0 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- 172.21.15.170:0/2277792573 shutdown_connections 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- 172.21.15.170:0/2277792573 shutdown_connections 2020-01-26T15:32:13.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- 172.21.15.170:0/2277792573 wait complete. 2020-01-26T15:32:13.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.236 7f2c69446700 1 -- 172.21.15.170:0/2277792573 >> 172.21.15.170:0/2277792573 conn(0x7f2c64144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c69446700 1 Processor -- start 2020-01-26T15:32:13.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c69446700 1 -- - start start 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c69446700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640a3cf0 con 0 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c69446700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640a68d0 con 0 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c62a68700 1 -- 172.21.15.170:0/3085170002 learned_addr learned my addr 172.21.15.170:0/3085170002 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c58003440 con 0x7f2c640a6280 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c54002a40 con 0x7f2c640a3300 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2258079032 0 0) 0x7f2c58003780 con 0x7f2c640a6280 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c44002df0 con 0 2020-01-26T15:32:13.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (109020999 0 0) 0x7f2c54002080 con 0x7f2c640a3300 2020-01-26T15:32:13.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2c44004620 con 0 2020-01-26T15:32:13.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1056040946 0 0) 0x7f2c58000e50 con 0x7f2c640a6280 2020-01-26T15:32:13.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c44004df0 con 0 2020-01-26T15:32:13.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4170139733 0 0) 0x7f2c54002410 con 0x7f2c640a3300 2020-01-26T15:32:13.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c44006570 con 0 2020-01-26T15:32:13.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2964458588 0 0) 0x7f2c58001360 con 0x7f2c640a6280 2020-01-26T15:32:13.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 >> 172.21.15.170:6790/0 conn(0x7f2c640a3300 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:32:13.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6407ab90 con 0 2020-01-26T15:32:13.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c69446700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640b26b0 con 0 2020-01-26T15:32:13.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2c58000bf0 con 0x7f2c640a6280 2020-01-26T15:32:13.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c69446700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6418b100 con 0 2020-01-26T15:32:13.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2c58001790 con 0x7f2c640a6280 2020-01-26T15:32:13.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2c58004750 con 0x7f2c640a6280 2020-01-26T15:32:13.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.240 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1038469349 0 0) 0x7f2c58005dd0 con 0x7f2c640a6280 2020-01-26T15:32:13.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.248 7f2c69446700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6407af30 con 0 2020-01-26T15:32:13.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.252 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2c6407af30 con 0x7f2c640a6280 2020-01-26T15:32:13.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.344 7f2c69446700 1 -- 172.21.15.170:0/3085170002 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c64073330 con 0 2020-01-26T15:32:13.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.344 7f2c60a64700 1 -- 172.21.15.170:0/3085170002 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+4100 (238102980 0 3242286738) 0x7f2c58004af0 con 0x7f2c640a6280 2020-01-26T15:32:13.349 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:13.349 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:13.131789","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:13.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.348 7f2c69446700 1 -- 172.21.15.170:0/3085170002 >> 172.21.15.170:6800/11008 conn(0x7f2c440072a0 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-01-26T15:32:13.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.348 7f2c69446700 1 -- 172.21.15.170:0/3085170002 >> 172.21.15.170:6791/0 conn(0x7f2c640a6280 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:32:13.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.348 7f2c69446700 1 -- 172.21.15.170:0/3085170002 shutdown_connections 2020-01-26T15:32:13.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.348 7f2c69446700 1 -- 172.21.15.170:0/3085170002 shutdown_connections 2020-01-26T15:32:13.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.348 7f2c69446700 1 -- 172.21.15.170:0/3085170002 wait complete. 2020-01-26T15:32:13.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.348 7f2c69446700 1 -- 172.21.15.170:0/3085170002 >> 172.21.15.170:0/3085170002 conn(0x7f2c640993f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:11.534039', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:32:13.360 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:32:13.459 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f0204c54700 1 Processor -- start 2020-01-26T15:32:13.459 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f0204c54700 1 -- - start start 2020-01-26T15:32:13.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f0204c54700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020014bb50 con 0 2020-01-26T15:32:13.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f0204c54700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020014bef0 con 0 2020-01-26T15:32:13.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fe267700 1 -- 172.21.15.170:0/2620687610 learned_addr learned my addr 172.21.15.170:0/2620687610 2020-01-26T15:32:13.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f01f4003630 con 0x7f020014b410 2020-01-26T15:32:13.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f01f00022a0 con 0x7f0200148110 2020-01-26T15:32:13.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2487758924 0 0) 0x7f01f40039b0 con 0x7f020014b410 2020-01-26T15:32:13.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f01e4002ea0 con 0 2020-01-26T15:32:13.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3124100029 0 0) 0x7f01f00025a0 con 0x7f0200148110 2020-01-26T15:32:13.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f01e40046b0 con 0 2020-01-26T15:32:13.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3749290303 0 0) 0x7f01f0002a40 con 0x7f0200148110 2020-01-26T15:32:13.463 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 >> 172.21.15.170:6790/0 conn(0x7f020014b410 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:32:13.463 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020007a8b0 con 0 2020-01-26T15:32:13.463 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f02000ea030 con 0x7f0200148110 2020-01-26T15:32:13.463 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f01fda66700 1 -- 172.21.15.170:0/2620687610 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f01f0001010 con 0x7f0200148110 2020-01-26T15:32:13.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.456 7f0204c54700 1 -- 172.21.15.170:0/2620687610 >> 172.21.15.170:6791/0 conn(0x7f0200148110 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:32:13.467 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- 172.21.15.170:0/2620687610 shutdown_connections 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- 172.21.15.170:0/2620687610 shutdown_connections 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- 172.21.15.170:0/2620687610 wait complete. 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- 172.21.15.170:0/2620687610 >> 172.21.15.170:0/2620687610 conn(0x7f0200144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 Processor -- start 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- - start start 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000a3c90 con 0 2020-01-26T15:32:13.468 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f0204c54700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000a6a60 con 0 2020-01-26T15:32:13.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01fea68700 1 -- 172.21.15.170:0/3516170178 learned_addr learned my addr 172.21.15.170:0/3516170178 2020-01-26T15:32:13.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f01f0000e50 con 0x7f02000a32a0 2020-01-26T15:32:13.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3961559836 0 0) 0x7f01f00020b0 con 0x7f02000a32a0 2020-01-26T15:32:13.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f01dc002960 con 0 2020-01-26T15:32:13.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f01f4003f40 con 0x7f02000a62b0 2020-01-26T15:32:13.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4259851772 0 0) 0x7f01f4003380 con 0x7f02000a62b0 2020-01-26T15:32:13.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f01dc004620 con 0 2020-01-26T15:32:13.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1579160745 0 0) 0x7f01f00025d0 con 0x7f02000a32a0 2020-01-26T15:32:13.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01dc002ee0 con 0 2020-01-26T15:32:13.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2508126979 0 0) 0x7f01f4003820 con 0x7f02000a62b0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.460 7f01effff700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01dc003540 con 0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4263125577 0 0) 0x7f01f0001950 con 0x7f02000a32a0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 >> 172.21.15.170:6791/0 conn(0x7f02000a62b0 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020007ab10 con 0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f0204c54700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02000b2900 con 0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f0204c54700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f020018b200 con 0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f01f0000bf0 con 0x7f02000a32a0 2020-01-26T15:32:13.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f01f0002ed0 con 0x7f02000a32a0 2020-01-26T15:32:13.472 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f01f0003630 con 0x7f02000a32a0 2020-01-26T15:32:13.472 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.464 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1038469349 0 0) 0x7f01f0003c30 con 0x7f02000a32a0 2020-01-26T15:32:13.473 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.472 7f0204c54700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e0002070 con 0 2020-01-26T15:32:13.479 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.476 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f01f0003320 con 0x7f02000a32a0 2020-01-26T15:32:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f01e00012a0 con 0 2020-01-26T15:32:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f01effff700 1 -- 172.21.15.170:0/3516170178 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v11) v1 ==== 92+0+10 (846493769 0 265718887) 0x7f01f00050b0 con 0x7f02000a32a0 2020-01-26T15:32:13.571 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:13.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 >> 172.21.15.170:6800/11008 conn(0x7f01dc006e70 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:32:13.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 >> 172.21.15.170:6790/0 conn(0x7f02000a32a0 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:32:13.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 shutdown_connections 2020-01-26T15:32:13.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 shutdown_connections 2020-01-26T15:32:13.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 wait complete. 2020-01-26T15:32:13.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.568 7f0204c54700 1 -- 172.21.15.170:0/3516170178 >> 172.21.15.170:0/3516170178 conn(0x7f0200099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.582 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-01-26T15:32:13.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ae5db9700 1 Processor -- start 2020-01-26T15:32:13.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ae5db9700 1 -- - start start 2020-01-26T15:32:13.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ae5db9700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae014bb60 con 0 2020-01-26T15:32:13.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ae5db9700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae014bf00 con 0 2020-01-26T15:32:13.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6adf7fe700 1 -- 172.21.15.170:0/3929993975 learned_addr learned my addr 172.21.15.170:0/3929993975 2020-01-26T15:32:13.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6ad0003630 con 0x7f6ae01480d0 2020-01-26T15:32:13.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2224461761 0 0) 0x7f6ad00039b0 con 0x7f6ae01480d0 2020-01-26T15:32:13.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6ac0002a20 con 0 2020-01-26T15:32:13.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6ac80022a0 con 0x7f6ae014b3d0 2020-01-26T15:32:13.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2019999207 0 0) 0x7f6ac8002620 con 0x7f6ae014b3d0 2020-01-26T15:32:13.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6ac00046c0 con 0 2020-01-26T15:32:13.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.668 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1622803706 0 0) 0x7f6ad0003f80 con 0x7f6ae01480d0 2020-01-26T15:32:13.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 >> 172.21.15.170:6791/0 conn(0x7f6ae014b3d0 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:32:13.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae007a930 con 0 2020-01-26T15:32:13.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6ae00e9ff0 con 0x7f6ae01480d0 2020-01-26T15:32:13.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ade7fc700 1 -- 172.21.15.170:0/3929993975 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6ad0001050 con 0x7f6ae01480d0 2020-01-26T15:32:13.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ae5db9700 1 -- 172.21.15.170:0/3929993975 >> 172.21.15.170:6790/0 conn(0x7f6ae01480d0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:32:13.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ae5db9700 1 -- 172.21.15.170:0/3929993975 shutdown_connections 2020-01-26T15:32:13.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ae5db9700 1 -- 172.21.15.170:0/3929993975 shutdown_connections 2020-01-26T15:32:13.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ae5db9700 1 -- 172.21.15.170:0/3929993975 wait complete. 2020-01-26T15:32:13.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.672 7f6ae5db9700 1 -- 172.21.15.170:0/3929993975 >> 172.21.15.170:0/3929993975 conn(0x7f6ae0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6ae5db9700 1 Processor -- start 2020-01-26T15:32:13.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6ae5db9700 1 -- - start start 2020-01-26T15:32:13.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6ae5db9700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae00a3e10 con 0 2020-01-26T15:32:13.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6ae5db9700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae00a6b00 con 0 2020-01-26T15:32:13.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adeffd700 1 -- 172.21.15.170:0/2942770997 learned_addr learned my addr 172.21.15.170:0/2942770997 2020-01-26T15:32:13.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6ac80022a0 con 0x7f6ae00a6350 2020-01-26T15:32:13.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1341327911 0 0) 0x7f6ac80029b0 con 0x7f6ae00a6350 2020-01-26T15:32:13.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6ac4002960 con 0 2020-01-26T15:32:13.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6ad0000e50 con 0x7f6ae00a33d0 2020-01-26T15:32:13.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2563520453 0 0) 0x7f6ad0001570 con 0x7f6ae00a33d0 2020-01-26T15:32:13.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6ac4004620 con 0 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (287495738 0 0) 0x7f6ac8000e50 con 0x7f6ae00a6350 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ac4002ee0 con 0 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1073258624 0 0) 0x7f6ad00018f0 con 0x7f6ae00a33d0 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ac4003540 con 0 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4045720279 0 0) 0x7f6ac8001570 con 0x7f6ae00a6350 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 >> 172.21.15.170:6789/0 conn(0x7f6ae00a33d0 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:32:13.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae007ab90 con 0 2020-01-26T15:32:13.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae00b27b0 con 0 2020-01-26T15:32:13.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae018b3f0 con 0 2020-01-26T15:32:13.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6ae0116e80 con 0x7f6ae00a6350 2020-01-26T15:32:13.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6ac80019a0 con 0x7f6ae00a6350 2020-01-26T15:32:13.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f6ac80044b0 con 0x7f6ae00a6350 2020-01-26T15:32:13.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.676 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1038469349 0 0) 0x7f6ac8005b30 con 0x7f6ae00a6350 2020-01-26T15:32:13.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.684 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab8002070 con 0 2020-01-26T15:32:13.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.688 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f6ac8003f90 con 0x7f6ae00a6350 2020-01-26T15:32:13.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6ab8001220 con 0 2020-01-26T15:32:13.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6adcff9700 1 -- 172.21.15.170:0/2942770997 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v11) v1 ==== 84+0+64 (203525128 0 1889981992) 0x7f6ac8004e00 con 0x7f6ae00a6350 2020-01-26T15:32:13.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 >> 172.21.15.170:6800/11008 conn(0x7f6ac4006e70 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:32:13.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 >> 172.21.15.170:6790/0 conn(0x7f6ae00a6350 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:32:13.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 shutdown_connections 2020-01-26T15:32:13.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 shutdown_connections 2020-01-26T15:32:13.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 wait complete. 2020-01-26T15:32:13.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.780 7f6ae5db9700 1 -- 172.21.15.170:0/2942770997 >> 172.21.15.170:0/2942770997 conn(0x7f6ae0099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:13.789 INFO:teuthology.orchestra.run.smithi170.stdout:[ 2020-01-26T15:32:13.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:32:13.789 INFO:teuthology.orchestra.run.smithi170.stdout: "poolnum": 1, 2020-01-26T15:32:13.789 INFO:teuthology.orchestra.run.smithi170.stdout: "poolname": "rbd" 2020-01-26T15:32:13.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:32:13.790 INFO:teuthology.orchestra.run.smithi170.stdout:] 2020-01-26T15:32:13.795 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-01-26T15:32:13.795 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-01-26T15:32:13.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd8475c5700 1 Processor -- start 2020-01-26T15:32:13.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd8475c5700 1 -- - start start 2020-01-26T15:32:13.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd8475c5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84014bb50 con 0 2020-01-26T15:32:13.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd8475c5700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84014bef0 con 0 2020-01-26T15:32:13.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd8455eb700 1 -- 172.21.15.170:0/873538347 learned_addr learned my addr 172.21.15.170:0/873538347 2020-01-26T15:32:13.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd8380039b0 con 0x7fd840148110 2020-01-26T15:32:13.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (423636901 0 0) 0x7fd838003d30 con 0x7fd840148110 2020-01-26T15:32:13.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd824002a20 con 0 2020-01-26T15:32:13.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd8300022a0 con 0x7fd84014b410 2020-01-26T15:32:13.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2744592612 0 0) 0x7fd830002620 con 0x7fd84014b410 2020-01-26T15:32:13.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd8240046b0 con 0 2020-01-26T15:32:13.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2497166071 0 0) 0x7fd838004300 con 0x7fd840148110 2020-01-26T15:32:13.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 >> 172.21.15.170:6791/0 conn(0x7fd84014b410 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:32:13.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.888 7fd837fff700 1 -- 172.21.15.170:0/873538347 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84007a8b0 con 0 2020-01-26T15:32:13.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd838000f70 con 0x7fd840148110 2020-01-26T15:32:13.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd837fff700 1 -- 172.21.15.170:0/873538347 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd8380013d0 con 0x7fd840148110 2020-01-26T15:32:13.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- 172.21.15.170:0/873538347 >> 172.21.15.170:6790/0 conn(0x7fd840148110 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:32:13.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- 172.21.15.170:0/873538347 shutdown_connections 2020-01-26T15:32:13.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- 172.21.15.170:0/873538347 shutdown_connections 2020-01-26T15:32:13.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- 172.21.15.170:0/873538347 wait complete. 2020-01-26T15:32:13.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- 172.21.15.170:0/873538347 >> 172.21.15.170:0/873538347 conn(0x7fd840144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:13.902 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 Processor -- start 2020-01-26T15:32:13.902 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- - start start 2020-01-26T15:32:13.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84009fcc0 con 0 2020-01-26T15:32:13.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8475c5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8400a2a00 con 0 2020-01-26T15:32:13.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8455eb700 1 -- 172.21.15.170:0/1745486413 learned_addr learned my addr 172.21.15.170:0/1745486413 2020-01-26T15:32:13.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd8380011d0 con 0x7fd84009f2d0 2020-01-26T15:32:13.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1697501207 0 0) 0x7fd8380018f0 con 0x7fd84009f2d0 2020-01-26T15:32:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd828002960 con 0 2020-01-26T15:32:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd8300020e0 con 0x7fd8400a2250 2020-01-26T15:32:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2646094953 0 0) 0x7fd8300029b0 con 0x7fd8400a2250 2020-01-26T15:32:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.892 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd828004620 con 0 2020-01-26T15:32:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (86017528 0 0) 0x7fd838001d40 con 0x7fd84009f2d0 2020-01-26T15:32:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd828002ee0 con 0 2020-01-26T15:32:13.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2490535498 0 0) 0x7fd830002c20 con 0x7fd8400a2250 2020-01-26T15:32:13.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd828003540 con 0 2020-01-26T15:32:13.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3131325821 0 0) 0x7fd8380039a0 con 0x7fd84009f2d0 2020-01-26T15:32:13.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 >> 172.21.15.170:6789/0 conn(0x7fd8400a2250 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:32:13.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84007ab10 con 0 2020-01-26T15:32:13.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8400711a0 con 0 2020-01-26T15:32:13.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84018b4b0 con 0 2020-01-26T15:32:13.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd8400ea030 con 0x7fd84009f2d0 2020-01-26T15:32:13.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd838003c10 con 0x7fd84009f2d0 2020-01-26T15:32:13.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fd838004b00 con 0x7fd84009f2d0 2020-01-26T15:32:13.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.896 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1038469349 0 0) 0x7fd838005fa0 con 0x7fd84009f2d0 2020-01-26T15:32:13.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.904 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81c002070 con 0 2020-01-26T15:32:13.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:13.908 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd8380045e0 con 0x7fd84009f2d0 2020-01-26T15:32:14.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.000 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd81c0012a0 con 0 2020-01-26T15:32:14.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.144 7fd8367fc700 1 -- 172.21.15.170:0/1745486413 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v12) v1 ==== 133+0+0 (3604228011 0 0) 0x7fd838005270 con 0x7fd84009f2d0 2020-01-26T15:32:14.166 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'cephfs_metadata' created 2020-01-26T15:32:14.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.164 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 >> 172.21.15.170:6800/11008 conn(0x7fd828006ed0 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:32:14.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.164 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 >> 172.21.15.170:6790/0 conn(0x7fd84009f2d0 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:32:14.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.164 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 shutdown_connections 2020-01-26T15:32:14.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.164 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 shutdown_connections 2020-01-26T15:32:14.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.164 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 wait complete. 2020-01-26T15:32:14.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.164 7fd8475c5700 1 -- 172.21.15.170:0/1745486413 >> 172.21.15.170:0/1745486413 conn(0x7fd840177fc0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:14.179 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2020-01-26T15:32:14.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.276 7ff48d74a700 1 Processor -- start 2020-01-26T15:32:14.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.276 7ff48d74a700 1 -- - start start 2020-01-26T15:32:14.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.276 7ff48d74a700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48814bb50 con 0 2020-01-26T15:32:14.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.276 7ff48d74a700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48814bef0 con 0 2020-01-26T15:32:14.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff487572700 1 -- 172.21.15.170:0/1485556909 learned_addr learned my addr 172.21.15.170:0/1485556909 2020-01-26T15:32:14.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff47c0022a0 con 0x7ff48814b410 2020-01-26T15:32:14.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (392279682 0 0) 0x7ff47c002620 con 0x7ff48814b410 2020-01-26T15:32:14.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff474002a20 con 0 2020-01-26T15:32:14.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff478003630 con 0x7ff488148110 2020-01-26T15:32:14.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2497140011 0 0) 0x7ff478003930 con 0x7ff488148110 2020-01-26T15:32:14.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff4740046c0 con 0 2020-01-26T15:32:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1673144711 0 0) 0x7ff47c002bf0 con 0x7ff48814b410 2020-01-26T15:32:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 >> 172.21.15.170:6790/0 conn(0x7ff488148110 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:32:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48807a8b0 con 0 2020-01-26T15:32:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff488116ec0 con 0x7ff48814b410 2020-01-26T15:32:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff486570700 1 -- 172.21.15.170:0/1485556909 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff47c001050 con 0x7ff48814b410 2020-01-26T15:32:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff48d74a700 1 -- 172.21.15.170:0/1485556909 >> 172.21.15.170:6789/0 conn(0x7ff48814b410 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:32:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff48d74a700 1 -- 172.21.15.170:0/1485556909 shutdown_connections 2020-01-26T15:32:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff48d74a700 1 -- 172.21.15.170:0/1485556909 shutdown_connections 2020-01-26T15:32:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff48d74a700 1 -- 172.21.15.170:0/1485556909 wait complete. 2020-01-26T15:32:14.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.280 7ff48d74a700 1 -- 172.21.15.170:0/1485556909 >> 172.21.15.170:0/1485556909 conn(0x7ff488144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:14.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff48d74a700 1 Processor -- start 2020-01-26T15:32:14.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff48d74a700 1 -- - start start 2020-01-26T15:32:14.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff48d74a700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880a3c90 con 0 2020-01-26T15:32:14.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff48d74a700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880a5140 con 0 2020-01-26T15:32:14.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff487572700 1 -- 172.21.15.170:0/3285484259 learned_addr learned my addr 172.21.15.170:0/3285484259 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff478003f60 con 0x7ff4880a3390 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2394779817 0 0) 0x7ff478003470 con 0x7ff4880a3390 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff468002960 con 0 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff47c000e50 con 0x7ff488095bd0 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4018015752 0 0) 0x7ff47c001ff0 con 0x7ff488095bd0 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff468004620 con 0 2020-01-26T15:32:14.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (686801879 0 0) 0x7ff47c002370 con 0x7ff488095bd0 2020-01-26T15:32:14.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff468002ee0 con 0 2020-01-26T15:32:14.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (67920085 0 0) 0x7ff478000e50 con 0x7ff4880a3390 2020-01-26T15:32:14.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.284 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff468003540 con 0 2020-01-26T15:32:14.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1780687912 0 0) 0x7ff47c001570 con 0x7ff488095bd0 2020-01-26T15:32:14.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 >> 172.21.15.170:6789/0 conn(0x7ff4880a3390 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48807ab10 con 0 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880b2900 con 0 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880a6c10 con 0 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff47c001360 con 0x7ff488095bd0 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff47c0019a0 con 0x7ff488095bd0 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7ff47c0033f0 con 0x7ff488095bd0 2020-01-26T15:32:14.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.288 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 2477+0+0 (1618863385 0 0) 0x7ff47c002ed0 con 0x7ff488095bd0 2020-01-26T15:32:14.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.292 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48807ae90 con 0 2020-01-26T15:32:14.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.296 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff48807ae90 con 0x7ff488095bd0 2020-01-26T15:32:14.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:14.388 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7ff488073260 con 0 2020-01-26T15:32:15.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.148 7ff484d6d700 1 -- 172.21.15.170:0/3285484259 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v13) v1 ==== 125+0+0 (4153913060 0 0) 0x7ff47c003770 con 0x7ff488095bd0 2020-01-26T15:32:15.155 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'cephfs_data' created 2020-01-26T15:32:15.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.160 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 >> 172.21.15.170:6800/11008 conn(0x7ff468006ed0 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:32:15.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.160 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 >> 172.21.15.170:6790/0 conn(0x7ff488095bd0 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:32:15.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.160 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 shutdown_connections 2020-01-26T15:32:15.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.160 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 shutdown_connections 2020-01-26T15:32:15.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.160 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 wait complete. 2020-01-26T15:32:15.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.160 7ff48d74a700 1 -- 172.21.15.170:0/3285484259 >> 172.21.15.170:0/3285484259 conn(0x7ff4880994d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.173 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-01-26T15:32:15.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a712f1700 1 Processor -- start 2020-01-26T15:32:15.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a712f1700 1 -- - start start 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a712f1700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c14bb90 con 0 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a712f1700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c14bf30 con 0 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6aa68700 1 -- 172.21.15.170:0/3669748291 learned_addr learned my addr 172.21.15.170:0/3669748291 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f5a54003630 con 0x7f5a6c14b400 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1731990048 0 0) 0x7f5a540039b0 con 0x7f5a6c14b400 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5a4c002a20 con 0 2020-01-26T15:32:15.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f5a5c002620 con 0x7f5a6c148100 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3544386634 0 0) 0x7f5a5c002920 con 0x7f5a6c148100 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5a4c0046c0 con 0 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3955500873 0 0) 0x7f5a54003f80 con 0x7f5a6c14b400 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 >> 172.21.15.170:6790/0 conn(0x7f5a6c148100 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c07a960 con 0 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5a6c116eb0 con 0x7f5a6c14b400 2020-01-26T15:32:15.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a6a267700 1 -- 172.21.15.170:0/3669748291 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f5a54001050 con 0x7f5a6c14b400 2020-01-26T15:32:15.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a712f1700 1 -- 172.21.15.170:0/3669748291 >> 172.21.15.170:6791/0 conn(0x7f5a6c14b400 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:32:15.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.260 7f5a712f1700 1 -- 172.21.15.170:0/3669748291 shutdown_connections 2020-01-26T15:32:15.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 -- 172.21.15.170:0/3669748291 shutdown_connections 2020-01-26T15:32:15.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 -- 172.21.15.170:0/3669748291 wait complete. 2020-01-26T15:32:15.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 -- 172.21.15.170:0/3669748291 >> 172.21.15.170:0/3669748291 conn(0x7f5a6c144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 Processor -- start 2020-01-26T15:32:15.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 -- - start start 2020-01-26T15:32:15.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0a3ff0 con 0 2020-01-26T15:32:15.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a712f1700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0a54c0 con 0 2020-01-26T15:32:15.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.264 7f5a6b269700 1 -- 172.21.15.170:0/2614031016 learned_addr learned my addr 172.21.15.170:0/2614031016 2020-01-26T15:32:15.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f5a5c002460 con 0x7f5a6c095d50 2020-01-26T15:32:15.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (956748326 0 0) 0x7f5a5c002760 con 0x7f5a6c095d50 2020-01-26T15:32:15.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5a50002960 con 0 2020-01-26T15:32:15.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f5a54000e50 con 0x7f5a6c0a35b0 2020-01-26T15:32:15.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4232032298 0 0) 0x7f5a54003380 con 0x7f5a6c0a35b0 2020-01-26T15:32:15.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5a50004620 con 0 2020-01-26T15:32:15.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (728587045 0 0) 0x7f5a54003700 con 0x7f5a6c0a35b0 2020-01-26T15:32:15.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a50002ee0 con 0 2020-01-26T15:32:15.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1004359199 0 0) 0x7f5a5c0011d0 con 0x7f5a6c095d50 2020-01-26T15:32:15.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a50003540 con 0 2020-01-26T15:32:15.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (289248483 0 0) 0x7f5a5c001860 con 0x7f5a6c095d50 2020-01-26T15:32:15.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 >> 172.21.15.170:6790/0 conn(0x7f5a6c0a35b0 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-01-26T15:32:15.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c07abc0 con 0 2020-01-26T15:32:15.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0b2970 con 0 2020-01-26T15:32:15.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5a6c0ea020 con 0x7f5a6c095d50 2020-01-26T15:32:15.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f5a5c001c90 con 0x7f5a6c095d50 2020-01-26T15:32:15.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c18b790 con 0 2020-01-26T15:32:15.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f5a5c004830 con 0x7f5a6c095d50 2020-01-26T15:32:15.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.268 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 2743+0+0 (3737870314 0 0) 0x7f5a5c0062b0 con 0x7f5a6c095d50 2020-01-26T15:32:15.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.272 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c07af60 con 0 2020-01-26T15:32:15.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.276 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f5a6c07af60 con 0x7f5a6c095d50 2020-01-26T15:32:15.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.368 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 --> 172.21.15.170:6791/0 -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": "--force", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f5a6c156400 con 0 2020-01-26T15:32:15.374 INFO:tasks.ceph.mon.a.smithi170.stderr:2020-01-26 15:32:15.372 7f8805061700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-01-26T15:32:15.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.380 7f5a68a64700 1 -- 172.21.15.170:0/2614031016 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": "--force", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 192+0+0 (3633460107 0 0) 0x7f5a5c004df0 con 0x7f5a6c095d50 2020-01-26T15:32:15.388 INFO:teuthology.orchestra.run.smithi170.stderr:new fs with metadata pool 2 and data pool 3 2020-01-26T15:32:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.388 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 >> 172.21.15.170:6800/11008 conn(0x7f5a50006e70 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:32:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.388 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 >> 172.21.15.170:6791/0 conn(0x7f5a6c095d50 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:32:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.388 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 shutdown_connections 2020-01-26T15:32:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.388 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 shutdown_connections 2020-01-26T15:32:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.388 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 wait complete. 2020-01-26T15:32:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.388 7f5a712f1700 1 -- 172.21.15.170:0/2614031016 >> 172.21.15.170:0/2614031016 conn(0x7f5a6c099730 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.399 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:15.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f2295e72700 1 Processor -- start 2020-01-26T15:32:15.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f2295e72700 1 -- - start start 2020-01-26T15:32:15.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f2295e72700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229014bb10 con 0 2020-01-26T15:32:15.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f2295e72700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229014beb0 con 0 2020-01-26T15:32:15.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228effd700 1 -- 172.21.15.170:0/2047540330 learned_addr learned my addr 172.21.15.170:0/2047540330 2020-01-26T15:32:15.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f22880022a0 con 0x7f22901480d0 2020-01-26T15:32:15.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (782355700 0 0) 0x7f2288002620 con 0x7f22901480d0 2020-01-26T15:32:15.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2270002a20 con 0 2020-01-26T15:32:15.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2278003630 con 0x7f229014b3d0 2020-01-26T15:32:15.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (821395942 0 0) 0x7f22780039b0 con 0x7f229014b3d0 2020-01-26T15:32:15.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f22700046c0 con 0 2020-01-26T15:32:15.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (689447049 0 0) 0x7f2288002bf0 con 0x7f22901480d0 2020-01-26T15:32:15.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 >> 172.21.15.170:6790/0 conn(0x7f229014b3d0 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-01-26T15:32:15.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229007a930 con 0 2020-01-26T15:32:15.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f22900e9ff0 con 0x7f22901480d0 2020-01-26T15:32:15.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f228e7fc700 1 -- 172.21.15.170:0/2047540330 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2288001050 con 0x7f22901480d0 2020-01-26T15:32:15.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.476 7f2295e72700 1 -- 172.21.15.170:0/2047540330 >> 172.21.15.170:6791/0 conn(0x7f22901480d0 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:32:15.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- 172.21.15.170:0/2047540330 shutdown_connections 2020-01-26T15:32:15.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- 172.21.15.170:0/2047540330 shutdown_connections 2020-01-26T15:32:15.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- 172.21.15.170:0/2047540330 wait complete. 2020-01-26T15:32:15.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- 172.21.15.170:0/2047540330 >> 172.21.15.170:0/2047540330 conn(0x7f2290144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 Processor -- start 2020-01-26T15:32:15.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- - start start 2020-01-26T15:32:15.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900a3db0 con 0 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900a6990 con 0 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228f7fe700 1 -- 172.21.15.170:0/1086196383 learned_addr learned my addr 172.21.15.170:0/1086196383 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2288001010 con 0x7f22900a33c0 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1039141530 0 0) 0x7f2288001ff0 con 0x7f22900a33c0 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2274002960 con 0 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2278003470 con 0x7f22900a6340 2020-01-26T15:32:15.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4063065675 0 0) 0x7f2278003d40 con 0x7f22900a6340 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2274004620 con 0 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3032918234 0 0) 0x7f22880025a0 con 0x7f22900a33c0 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2274002ee0 con 0 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (961781670 0 0) 0x7f2278003fb0 con 0x7f22900a6340 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2274003540 con 0 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1110282653 0 0) 0x7f2288001890 con 0x7f22900a33c0 2020-01-26T15:32:15.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 >> 172.21.15.170:6789/0 conn(0x7f22900a6340 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:32:15.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f228cff9700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229007ab90 con 0 2020-01-26T15:32:15.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22900b27b0 con 0 2020-01-26T15:32:15.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.480 7f2295e72700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f229018b1c0 con 0 2020-01-26T15:32:15.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.484 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2288000bf0 con 0x7f22900a33c0 2020-01-26T15:32:15.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.484 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2288001cc0 con 0x7f22900a33c0 2020-01-26T15:32:15.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.484 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f22880033f0 con 0x7f22900a33c0 2020-01-26T15:32:15.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.484 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (1291249158 0 0) 0x7f2288005f30 con 0x7f22900a33c0 2020-01-26T15:32:15.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.492 7f2295e72700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2268002070 con 0 2020-01-26T15:32:15.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.496 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2288002ed0 con 0x7f22900a33c0 2020-01-26T15:32:15.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.584 7f2295e72700 1 -- 172.21.15.170:0/1086196383 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2268001220 con 0 2020-01-26T15:32:15.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.588 7f228cff9700 1 -- 172.21.15.170:0/1086196383 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+6330 (92231148 0 3079468852) 0x7f22880061d0 con 0x7f22900a33c0 2020-01-26T15:32:15.592 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:15.592 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":14,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:15.375856","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:15.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.592 7f2295e72700 1 -- 172.21.15.170:0/1086196383 >> 172.21.15.170:6800/11008 conn(0x7f2274006ed0 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:32:15.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.592 7f2295e72700 1 -- 172.21.15.170:0/1086196383 >> 172.21.15.170:6790/0 conn(0x7f22900a33c0 :-1 s=STATE_OPEN pgs=41 cs=1 l=1).mark_down 2020-01-26T15:32:15.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.592 7f2295e72700 1 -- 172.21.15.170:0/1086196383 shutdown_connections 2020-01-26T15:32:15.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.592 7f2295e72700 1 -- 172.21.15.170:0/1086196383 shutdown_connections 2020-01-26T15:32:15.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.592 7f2295e72700 1 -- 172.21.15.170:0/1086196383 wait complete. 2020-01-26T15:32:15.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.592 7f2295e72700 1 -- 172.21.15.170:0/1086196383 >> 172.21.15.170:0/1086196383 conn(0x7f2290099470 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.603 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:15.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e46aa700 1 Processor -- start 2020-01-26T15:32:15.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e46aa700 1 -- - start start 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e46aa700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc14bb70 con 0 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e46aa700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc14bf10 con 0 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e1ecf700 1 -- 172.21.15.170:0/2022718136 learned_addr learned my addr 172.21.15.170:0/2022718136 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f65d4002620 con 0x7f65dc148130 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1978918702 0 0) 0x7f65d40029a0 con 0x7f65dc148130 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f65c4002a20 con 0 2020-01-26T15:32:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f65cc003630 con 0x7f65dc14b430 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3192683026 0 0) 0x7f65cc003930 con 0x7f65dc14b430 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f65c40046c0 con 0 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2450285305 0 0) 0x7f65d4002f70 con 0x7f65dc148130 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 >> 172.21.15.170:6789/0 conn(0x7f65dc14b430 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc07a990 con 0 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f65dc0ea050 con 0x7f65dc148130 2020-01-26T15:32:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e16ce700 1 -- 172.21.15.170:0/2022718136 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f65d40013d0 con 0x7f65dc148130 2020-01-26T15:32:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.688 7f65e46aa700 1 -- 172.21.15.170:0/2022718136 >> 172.21.15.170:6790/0 conn(0x7f65dc148130 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-01-26T15:32:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- 172.21.15.170:0/2022718136 shutdown_connections 2020-01-26T15:32:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- 172.21.15.170:0/2022718136 shutdown_connections 2020-01-26T15:32:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- 172.21.15.170:0/2022718136 wait complete. 2020-01-26T15:32:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- 172.21.15.170:0/2022718136 >> 172.21.15.170:0/2022718136 conn(0x7f65dc144060 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 Processor -- start 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- - start start 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc0a3d50 con 0 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e46aa700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc0a6b20 con 0 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65e26d0700 1 -- 172.21.15.170:0/1116203552 learned_addr learned my addr 172.21.15.170:0/1116203552 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f65d4001390 con 0x7f65dc0a3360 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (29218983 0 0) 0x7f65d40023f0 con 0x7f65dc0a3360 2020-01-26T15:32:15.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f65bc002960 con 0 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.692 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f65cc003e70 con 0x7f65dc0a6370 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (38353104 0 0) 0x7f65cc003470 con 0x7f65dc0a6370 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f65bc004620 con 0 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (413439963 0 0) 0x7f65d4002960 con 0x7f65dc0a3360 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f65bc002ee0 con 0 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1126139019 0 0) 0x7f65cc0038d0 con 0x7f65dc0a6370 2020-01-26T15:32:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f65bc003540 con 0 2020-01-26T15:32:15.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1776751025 0 0) 0x7f65d4001ce0 con 0x7f65dc0a3360 2020-01-26T15:32:15.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 >> 172.21.15.170:6791/0 conn(0x7f65dc0a6370 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:32:15.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc07abf0 con 0 2020-01-26T15:32:15.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc0b2970 con 0 2020-01-26T15:32:15.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc18b1d0 con 0 2020-01-26T15:32:15.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f65d4000f70 con 0x7f65dc0a3360 2020-01-26T15:32:15.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f65d4003250 con 0x7f65dc0a3360 2020-01-26T15:32:15.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f65d4003a30 con 0x7f65dc0a3360 2020-01-26T15:32:15.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.696 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (1291249158 0 0) 0x7f65d40066f0 con 0x7f65dc0a3360 2020-01-26T15:32:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.704 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b8002070 con 0 2020-01-26T15:32:15.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.708 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f65d4003720 con 0x7f65dc0a3360 2020-01-26T15:32:15.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65b8001220 con 0 2020-01-26T15:32:15.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65cb7fe700 1 -- 172.21.15.170:0/1116203552 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+6330 (92231148 0 3079468852) 0x7f65d4006990 con 0x7f65dc0a3360 2020-01-26T15:32:15.803 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:15.804 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":14,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:15.375856","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:15.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 >> 172.21.15.170:6800/11008 conn(0x7f65bc006ed0 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:32:15.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 >> 172.21.15.170:6790/0 conn(0x7f65dc0a3360 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:32:15.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 shutdown_connections 2020-01-26T15:32:15.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 shutdown_connections 2020-01-26T15:32:15.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 wait complete. 2020-01-26T15:32:15.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.800 7f65e46aa700 1 -- 172.21.15.170:0/1116203552 >> 172.21.15.170:0/1116203552 conn(0x7f65dc0994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.819 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-01-26T15:32:15.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7ad18e700 1 Processor -- start 2020-01-26T15:32:15.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7ad18e700 1 -- - start start 2020-01-26T15:32:15.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7ad18e700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a814bb50 con 0 2020-01-26T15:32:15.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7ad18e700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a814bef0 con 0 2020-01-26T15:32:15.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a7027700 1 -- 172.21.15.170:0/3866041977 learned_addr learned my addr 172.21.15.170:0/3866041977 2020-01-26T15:32:15.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd798003630 con 0x7fd7a8148110 2020-01-26T15:32:15.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd79c0022a0 con 0x7fd7a814b410 2020-01-26T15:32:15.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2275539675 0 0) 0x7fd7980039b0 con 0x7fd7a8148110 2020-01-26T15:32:15.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd794002ea0 con 0 2020-01-26T15:32:15.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2051005114 0 0) 0x7fd79c002620 con 0x7fd7a814b410 2020-01-26T15:32:15.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd7940046b0 con 0 2020-01-26T15:32:15.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2677368009 0 0) 0x7fd79c002ac0 con 0x7fd7a814b410 2020-01-26T15:32:15.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.908 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 >> 172.21.15.170:6790/0 conn(0x7fd7a8148110 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-01-26T15:32:15.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a807a8b0 con 0 2020-01-26T15:32:15.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd7a8116ec0 con 0x7fd7a814b410 2020-01-26T15:32:15.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7a6025700 1 -- 172.21.15.170:0/3866041977 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd79c001010 con 0x7fd7a814b410 2020-01-26T15:32:15.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7ad18e700 1 -- 172.21.15.170:0/3866041977 >> 172.21.15.170:6791/0 conn(0x7fd7a814b410 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:32:15.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7ad18e700 1 -- 172.21.15.170:0/3866041977 shutdown_connections 2020-01-26T15:32:15.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7ad18e700 1 -- 172.21.15.170:0/3866041977 shutdown_connections 2020-01-26T15:32:15.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7ad18e700 1 -- 172.21.15.170:0/3866041977 wait complete. 2020-01-26T15:32:15.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.912 7fd7ad18e700 1 -- 172.21.15.170:0/3866041977 >> 172.21.15.170:0/3866041977 conn(0x7fd7a8144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:15.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7ad18e700 1 Processor -- start 2020-01-26T15:32:15.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7ad18e700 1 -- - start start 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7ad18e700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80a3c80 con 0 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7ad18e700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80a5130 con 0 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a7027700 1 -- 172.21.15.170:0/2593020676 learned_addr learned my addr 172.21.15.170:0/2593020676 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd79c000e50 con 0x7fd7a8095c00 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4110602934 0 0) 0x7fd79c0020b0 con 0x7fd7a8095c00 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd788002960 con 0 2020-01-26T15:32:15.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd798003380 con 0x7fd7a80a3380 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2746064605 0 0) 0x7fd7980036c0 con 0x7fd7a80a3380 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd788004620 con 0 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (505294779 0 0) 0x7fd798003a00 con 0x7fd7a80a3380 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd788002ee0 con 0 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3534142819 0 0) 0x7fd79c002500 con 0x7fd7a8095c00 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd788003540 con 0 2020-01-26T15:32:15.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (505236899 0 0) 0x7fd7980010f0 con 0x7fd7a80a3380 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 >> 172.21.15.170:6789/0 conn(0x7fd7a8095c00 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a807ab10 con 0 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a80b26e0 con 0 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a80a6bc0 con 0 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd798000bf0 con 0x7fd7a80a3380 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd798001520 con 0x7fd7a80a3380 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fd798001970 con 0x7fd7a80a3380 2020-01-26T15:32:15.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.916 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (1291249158 0 0) 0x7fd798005f10 con 0x7fd7a80a3380 2020-01-26T15:32:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.920 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a807ae90 con 0 2020-01-26T15:32:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:15.924 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd7a807ae90 con 0x7fd7a80a3380 2020-01-26T15:32:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.016 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 --> 172.21.15.170:6790/0 -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fd7a8073260 con 0 2020-01-26T15:32:16.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.376 7fd7a4822700 1 -- 172.21.15.170:0/2593020676 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (2292374382 0 0) 0x7fd798004a20 con 0x7fd7a80a3380 2020-01-26T15:32:16.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.388 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 >> 172.21.15.170:6800/11008 conn(0x7fd788006ed0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:32:16.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.388 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 >> 172.21.15.170:6790/0 conn(0x7fd7a80a3380 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-01-26T15:32:16.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.388 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 shutdown_connections 2020-01-26T15:32:16.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.388 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 shutdown_connections 2020-01-26T15:32:16.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.388 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 wait complete. 2020-01-26T15:32:16.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.388 7fd7ad18e700 1 -- 172.21.15.170:0/2593020676 >> 172.21.15.170:0/2593020676 conn(0x7fd7a80994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:16.400 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:16.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 Processor -- start 2020-01-26T15:32:16.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- - start start 2020-01-26T15:32:16.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e414bb10 con 0 2020-01-26T15:32:16.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e414beb0 con 0 2020-01-26T15:32:16.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e9829700 1 -- 172.21.15.170:0/247299129 learned_addr learned my addr 172.21.15.170:0/247299129 2020-01-26T15:32:16.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f68e00039b0 con 0x7f68e41480d0 2020-01-26T15:32:16.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2629074564 0 0) 0x7f68e0003d30 con 0x7f68e41480d0 2020-01-26T15:32:16.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f68c8002a20 con 0 2020-01-26T15:32:16.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f68d40022a0 con 0x7f68e414b3d0 2020-01-26T15:32:16.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3476071587 0 0) 0x7f68d4002620 con 0x7f68e414b3d0 2020-01-26T15:32:16.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f68c80046b0 con 0 2020-01-26T15:32:16.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1882856007 0 0) 0x7f68e0004300 con 0x7f68e41480d0 2020-01-26T15:32:16.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 >> 172.21.15.170:6789/0 conn(0x7f68e414b3d0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:32:16.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e407a930 con 0 2020-01-26T15:32:16.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f68e0000f70 con 0x7f68e41480d0 2020-01-26T15:32:16.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68e8827700 1 -- 172.21.15.170:0/247299129 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f68e00013d0 con 0x7f68e41480d0 2020-01-26T15:32:16.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- 172.21.15.170:0/247299129 >> 172.21.15.170:6791/0 conn(0x7f68e41480d0 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:32:16.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- 172.21.15.170:0/247299129 shutdown_connections 2020-01-26T15:32:16.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- 172.21.15.170:0/247299129 shutdown_connections 2020-01-26T15:32:16.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- 172.21.15.170:0/247299129 wait complete. 2020-01-26T15:32:16.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.484 7f68eb803700 1 -- 172.21.15.170:0/247299129 >> 172.21.15.170:0/247299129 conn(0x7f68e4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:16.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.488 7f68eb803700 1 Processor -- start 2020-01-26T15:32:16.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.488 7f68eb803700 1 -- - start start 2020-01-26T15:32:16.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.488 7f68eb803700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e409fb00 con 0 2020-01-26T15:32:16.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.488 7f68eb803700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40a28d0 con 0 2020-01-26T15:32:16.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.488 7f68e9829700 1 -- 172.21.15.170:0/528599217 learned_addr learned my addr 172.21.15.170:0/528599217 2020-01-26T15:32:16.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.488 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f68d40020b0 con 0x7f68e40a2120 2020-01-26T15:32:16.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (788596814 0 0) 0x7f68d40029b0 con 0x7f68e40a2120 2020-01-26T15:32:16.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f68cc002960 con 0 2020-01-26T15:32:16.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f68e00011d0 con 0x7f68e409f110 2020-01-26T15:32:16.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2447339551 0 0) 0x7f68e00018f0 con 0x7f68e409f110 2020-01-26T15:32:16.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f68cc004620 con 0 2020-01-26T15:32:16.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1749800668 0 0) 0x7f68d4000e50 con 0x7f68e40a2120 2020-01-26T15:32:16.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f68cc002ee0 con 0 2020-01-26T15:32:16.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2573009655 0 0) 0x7f68e0001410 con 0x7f68e409f110 2020-01-26T15:32:16.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f68cc003540 con 0 2020-01-26T15:32:16.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2066101556 0 0) 0x7f68d4001360 con 0x7f68e40a2120 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 >> 172.21.15.170:6790/0 conn(0x7f68e409f110 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e407ab90 con 0 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68eb803700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40712f0 con 0 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68eb803700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e418b350 con 0 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f68d4000bf0 con 0x7f68e40a2120 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f68d4001790 con 0x7f68e40a2120 2020-01-26T15:32:16.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f68d40019d0 con 0x7f68e40a2120 2020-01-26T15:32:16.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.492 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (561481128 0 0) 0x7f68d40049f0 con 0x7f68e40a2120 2020-01-26T15:32:16.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.496 7f68eb803700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e407af30 con 0 2020-01-26T15:32:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.504 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f68e407af30 con 0x7f68e40a2120 2020-01-26T15:32:16.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.596 7f68eb803700 1 -- 172.21.15.170:0/528599217 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68e4073330 con 0 2020-01-26T15:32:16.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.596 7f68daffd700 1 -- 172.21.15.170:0/528599217 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1415 (2837298644 0 1093232737) 0x7f68d4002ed0 con 0x7f68e40a2120 2020-01-26T15:32:16.601 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 3 2020-01-26T15:32:16.601 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:16.601 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:16.378065","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:16.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.600 7f68eb803700 1 -- 172.21.15.170:0/528599217 >> 172.21.15.170:6800/11008 conn(0x7f68cc006ed0 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:32:16.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.600 7f68eb803700 1 -- 172.21.15.170:0/528599217 >> 172.21.15.170:6789/0 conn(0x7f68e40a2120 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:32:16.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.600 7f68eb803700 1 -- 172.21.15.170:0/528599217 shutdown_connections 2020-01-26T15:32:16.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.600 7f68eb803700 1 -- 172.21.15.170:0/528599217 shutdown_connections 2020-01-26T15:32:16.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.600 7f68eb803700 1 -- 172.21.15.170:0/528599217 wait complete. 2020-01-26T15:32:16.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.600 7f68eb803700 1 -- 172.21.15.170:0/528599217 >> 172.21.15.170:0/528599217 conn(0x7f68e4177e30 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:16.612 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:16.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1befd84700 1 Processor -- start 2020-01-26T15:32:16.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1befd84700 1 -- - start start 2020-01-26T15:32:16.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1befd84700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be814bb10 con 0 2020-01-26T15:32:16.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1befd84700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be814beb0 con 0 2020-01-26T15:32:16.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1beddaa700 1 -- 172.21.15.170:0/1193735190 learned_addr learned my addr 172.21.15.170:0/1193735190 2020-01-26T15:32:16.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1be40039b0 con 0x7f1be81480d0 2020-01-26T15:32:16.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2162995254 0 0) 0x7f1be4003d30 con 0x7f1be81480d0 2020-01-26T15:32:16.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bcc002a20 con 0 2020-01-26T15:32:16.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1bd80022a0 con 0x7f1be814b3d0 2020-01-26T15:32:16.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3745728989 0 0) 0x7f1bd8002620 con 0x7f1be814b3d0 2020-01-26T15:32:16.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bcc0046b0 con 0 2020-01-26T15:32:16.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3511115446 0 0) 0x7f1be4004300 con 0x7f1be81480d0 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 >> 172.21.15.170:6790/0 conn(0x7f1be814b3d0 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be807a930 con 0 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1be80e9ff0 con 0x7f1be81480d0 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1becda8700 1 -- 172.21.15.170:0/1193735190 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1be40013d0 con 0x7f1be81480d0 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.704 7f1befd84700 1 -- 172.21.15.170:0/1193735190 >> 172.21.15.170:6789/0 conn(0x7f1be81480d0 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- 172.21.15.170:0/1193735190 shutdown_connections 2020-01-26T15:32:16.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- 172.21.15.170:0/1193735190 shutdown_connections 2020-01-26T15:32:16.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- 172.21.15.170:0/1193735190 wait complete. 2020-01-26T15:32:16.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- 172.21.15.170:0/1193735190 >> 172.21.15.170:0/1193735190 conn(0x7f1be8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:16.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 Processor -- start 2020-01-26T15:32:16.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- - start start 2020-01-26T15:32:16.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be80a3ce0 con 0 2020-01-26T15:32:16.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1befd84700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be80a6ab0 con 0 2020-01-26T15:32:16.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.708 7f1beddaa700 1 -- 172.21.15.170:0/739354059 learned_addr learned my addr 172.21.15.170:0/739354059 2020-01-26T15:32:16.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1be40011d0 con 0x7f1be80a32f0 2020-01-26T15:32:16.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (725327034 0 0) 0x7f1be40018f0 con 0x7f1be80a32f0 2020-01-26T15:32:16.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bd0002960 con 0 2020-01-26T15:32:16.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1bd8002b60 con 0x7f1be80a6300 2020-01-26T15:32:16.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3081738747 0 0) 0x7f1bd80020b0 con 0x7f1be80a6300 2020-01-26T15:32:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bd0004620 con 0 2020-01-26T15:32:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2718997557 0 0) 0x7f1be4001d40 con 0x7f1be80a32f0 2020-01-26T15:32:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bd0002ee0 con 0 2020-01-26T15:32:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2892785751 0 0) 0x7f1bd8002440 con 0x7f1be80a6300 2020-01-26T15:32:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bd0003540 con 0 2020-01-26T15:32:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2546675356 0 0) 0x7f1be40039a0 con 0x7f1be80a32f0 2020-01-26T15:32:16.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 >> 172.21.15.170:6789/0 conn(0x7f1be80a6300 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:32:16.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be807ab90 con 0 2020-01-26T15:32:16.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1befd84700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be80b2970 con 0 2020-01-26T15:32:16.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1befd84700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be818b1a0 con 0 2020-01-26T15:32:16.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1be4000f70 con 0x7f1be80a32f0 2020-01-26T15:32:16.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1be4003dd0 con 0x7f1be80a32f0 2020-01-26T15:32:16.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f1be4004b00 con 0x7f1be80a32f0 2020-01-26T15:32:16.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.712 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (561481128 0 0) 0x7f1be4006480 con 0x7f1be80a32f0 2020-01-26T15:32:16.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.720 7f1befd84700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4002070 con 0 2020-01-26T15:32:16.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.724 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1be40045e0 con 0x7f1be80a32f0 2020-01-26T15:32:16.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.812 7f1befd84700 1 -- 172.21.15.170:0/739354059 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bc4001220 con 0 2020-01-26T15:32:16.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1bdeffd700 1 -- 172.21.15.170:0/739354059 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1511778180) 0x7f1be40048a0 con 0x7f1be80a32f0 2020-01-26T15:32:16.817 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:16.818 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":15,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:16.378696","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:16.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1befd84700 1 -- 172.21.15.170:0/739354059 >> 172.21.15.170:6800/11008 conn(0x7f1bd0006ed0 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:32:16.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1befd84700 1 -- 172.21.15.170:0/739354059 >> 172.21.15.170:6791/0 conn(0x7f1be80a32f0 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:32:16.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1befd84700 1 -- 172.21.15.170:0/739354059 shutdown_connections 2020-01-26T15:32:16.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1befd84700 1 -- 172.21.15.170:0/739354059 shutdown_connections 2020-01-26T15:32:16.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1befd84700 1 -- 172.21.15.170:0/739354059 wait complete. 2020-01-26T15:32:16.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.816 7f1befd84700 1 -- 172.21.15.170:0/739354059 >> 172.21.15.170:0/739354059 conn(0x7f1be8099450 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:16.829 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2020-01-26T15:32:16.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.920 7fc3991b5700 1 Processor -- start 2020-01-26T15:32:16.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.920 7fc3991b5700 1 -- - start start 2020-01-26T15:32:16.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.920 7fc3991b5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39414bb50 con 0 2020-01-26T15:32:16.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.920 7fc3991b5700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39414bef0 con 0 2020-01-26T15:32:16.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.920 7fc393027700 1 -- 172.21.15.170:0/2750277958 learned_addr learned my addr 172.21.15.170:0/2750277958 2020-01-26T15:32:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc37c0022a0 con 0x7fc39414b410 2020-01-26T15:32:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc3840039b0 con 0x7fc394148110 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1445191174 0 0) 0x7fc37c002620 con 0x7fc39414b410 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc374002ea0 con 0 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (762869595 0 0) 0x7fc384003d30 con 0x7fc394148110 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc3740046a0 con 0 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2171570913 0 0) 0x7fc37c002b10 con 0x7fc39414b410 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 >> 172.21.15.170:6789/0 conn(0x7fc394148110 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:32:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39407a8b0 con 0 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc37c000bf0 con 0x7fc39414b410 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc3991b5700 1 -- 172.21.15.170:0/2750277958 >> 172.21.15.170:6791/0 conn(0x7fc39414b410 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc392025700 1 -- 172.21.15.170:0/2750277958 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc37c001010 con 0x7fc39414b410 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc3991b5700 1 -- 172.21.15.170:0/2750277958 shutdown_connections 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc3991b5700 1 -- 172.21.15.170:0/2750277958 shutdown_connections 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc3991b5700 1 -- 172.21.15.170:0/2750277958 wait complete. 2020-01-26T15:32:16.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.924 7fc3991b5700 1 -- 172.21.15.170:0/2750277958 >> 172.21.15.170:0/2750277958 conn(0x7fc394144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:16.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc3991b5700 1 Processor -- start 2020-01-26T15:32:16.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc3991b5700 1 -- - start start 2020-01-26T15:32:16.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc3991b5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39409fab0 con 0 2020-01-26T15:32:16.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc3991b5700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940a2880 con 0 2020-01-26T15:32:16.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc393027700 1 -- 172.21.15.170:0/3927945436 learned_addr learned my addr 172.21.15.170:0/3927945436 2020-01-26T15:32:16.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc384004360 con 0x7fc39409f0c0 2020-01-26T15:32:16.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1366743056 0 0) 0x7fc384003850 con 0x7fc39409f0c0 2020-01-26T15:32:16.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc378002960 con 0 2020-01-26T15:32:16.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc37c002b10 con 0x7fc3940a20d0 2020-01-26T15:32:16.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1446574973 0 0) 0x7fc37c000e50 con 0x7fc3940a20d0 2020-01-26T15:32:16.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fc378004620 con 0 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (613905345 0 0) 0x7fc3840011d0 con 0x7fc39409f0c0 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc378002ee0 con 0 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4124997820 0 0) 0x7fc37c002050 con 0x7fc3940a20d0 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc378003540 con 0 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1821028850 0 0) 0x7fc384001740 con 0x7fc39409f0c0 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 >> 172.21.15.170:6789/0 conn(0x7fc3940a20d0 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:32:16.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39407ab10 con 0 2020-01-26T15:32:16.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940711a0 con 0 2020-01-26T15:32:16.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39418b3a0 con 0 2020-01-26T15:32:16.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fc384000f70 con 0x7fc39409f0c0 2020-01-26T15:32:16.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fc384001b70 con 0x7fc39409f0c0 2020-01-26T15:32:16.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fc384004b00 con 0x7fc39409f0c0 2020-01-26T15:32:16.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.928 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (561481128 0 0) 0x7fc384005540 con 0x7fc39409f0c0 2020-01-26T15:32:16.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.936 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39407ae90 con 0 2020-01-26T15:32:16.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:16.940 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fc39407ae90 con 0x7fc39409f0c0 2020-01-26T15:32:17.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.032 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 --> 172.21.15.170:6791/0 -- mon_command({"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "2"} v 0) v1 -- 0x7fc394070bc0 con 0 2020-01-26T15:32:17.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.388 7fc390822700 1 -- 172.21.15.170:0/3927945436 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "2"}]=0 v4) v1 ==== 105+0+0 (3556622176 0 0) 0x7fc384004750 con 0x7fc39409f0c0 2020-01-26T15:32:17.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.396 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 >> 172.21.15.170:6800/11008 conn(0x7fc378006e70 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:32:17.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.396 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 >> 172.21.15.170:6791/0 conn(0x7fc39409f0c0 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-01-26T15:32:17.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.396 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 shutdown_connections 2020-01-26T15:32:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.396 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 shutdown_connections 2020-01-26T15:32:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.396 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 wait complete. 2020-01-26T15:32:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.396 7fc3991b5700 1 -- 172.21.15.170:0/3927945436 >> 172.21.15.170:0/3927945436 conn(0x7fc394177ec0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:17.415 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-01-26T15:32:17.416 INFO:tasks.ceph.mds.a:Restarting daemon 2020-01-26T15:32:17.416 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-01-26T15:32:17.425 INFO:tasks.ceph.mds.a:Started 2020-01-26T15:32:17.425 INFO:tasks.ceph.mds.b:Restarting daemon 2020-01-26T15:32:17.425 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-01-26T15:32:17.428 INFO:tasks.ceph.mds.b:Started 2020-01-26T15:32:17.428 INFO:tasks.ceph.mds.c:Restarting daemon 2020-01-26T15:32:17.428 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-01-26T15:32:17.431 INFO:tasks.ceph.mds.c:Started 2020-01-26T15:32:17.431 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:17.432 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-01-26T15:32:17.500 INFO:tasks.ceph.mds.c.smithi170.stdout:starting mds.c at - 2020-01-26T15:32:17.512 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at - 2020-01-26T15:32:17.515 INFO:tasks.ceph.mds.a.smithi170.stdout:starting mds.a at - 2020-01-26T15:32:17.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 Processor -- start 2020-01-26T15:32:17.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- - start start 2020-01-26T15:32:17.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266814bb10 con 0 2020-01-26T15:32:17.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266814beb0 con 0 2020-01-26T15:32:17.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266cdea700 1 -- 172.21.15.170:0/4190526889 learned_addr learned my addr 172.21.15.170:0/4190526889 2020-01-26T15:32:17.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2660002620 con 0x7f26681480d0 2020-01-26T15:32:17.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (698917250 0 0) 0x7f26600029a0 con 0x7f26681480d0 2020-01-26T15:32:17.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f264c002a20 con 0 2020-01-26T15:32:17.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2338328518 0 0) 0x7f2660002f70 con 0x7f26681480d0 2020-01-26T15:32:17.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 >> 172.21.15.170:6790/0 conn(0x7f266814b3d0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:32:17.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266807a930 con 0 2020-01-26T15:32:17.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f26680e9ff0 con 0x7f26681480d0 2020-01-26T15:32:17.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f265ffff700 1 -- 172.21.15.170:0/4190526889 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f26600013d0 con 0x7f26681480d0 2020-01-26T15:32:17.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- 172.21.15.170:0/4190526889 >> 172.21.15.170:6789/0 conn(0x7f26681480d0 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-01-26T15:32:17.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- 172.21.15.170:0/4190526889 shutdown_connections 2020-01-26T15:32:17.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- 172.21.15.170:0/4190526889 shutdown_connections 2020-01-26T15:32:17.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- 172.21.15.170:0/4190526889 wait complete. 2020-01-26T15:32:17.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.516 7f266f5c5700 1 -- 172.21.15.170:0/4190526889 >> 172.21.15.170:0/4190526889 conn(0x7f2668144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:17.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266f5c5700 1 Processor -- start 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266f5c5700 1 -- - start start 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266f5c5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680a3dc0 con 0 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266f5c5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2668095e30 con 0 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266cdea700 1 -- 172.21.15.170:0/2378067468 learned_addr learned my addr 172.21.15.170:0/2378067468 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f26600011d0 con 0x7f26680a33d0 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (943242017 0 0) 0x7f26600023d0 con 0x7f26680a33d0 2020-01-26T15:32:17.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2650002960 con 0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4034650417 0 0) 0x7f26600027d0 con 0x7f26680a33d0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2650004170 con 0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (762731634 0 0) 0x7f2660001b90 con 0x7f26680a33d0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 >> 172.21.15.170:6790/0 conn(0x7f26680a5180 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266807ab90 con 0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26680b29a0 con 0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f26680a6bc0 con 0 2020-01-26T15:32:17.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f26600016e0 con 0x7f26680a33d0 2020-01-26T15:32:17.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2660001fc0 con 0x7f26680a33d0 2020-01-26T15:32:17.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2660003980 con 0x7f26680a33d0 2020-01-26T15:32:17.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.520 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f2660003d00 con 0x7f26680a33d0 2020-01-26T15:32:17.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.524 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266807af30 con 0 2020-01-26T15:32:17.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.524 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f266807af30 con 0x7f26680a33d0 2020-01-26T15:32:17.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.608 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26681563d0 con 0 2020-01-26T15:32:17.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.608 7f265e7fc700 1 -- 172.21.15.170:0/2378067468 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 1605628788) 0x7f2660003460 con 0x7f26680a33d0 2020-01-26T15:32:17.613 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:17.614 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":16,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:17.386083","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:17.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.612 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 >> 172.21.15.170:6800/11008 conn(0x7f2650005a40 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-01-26T15:32:17.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.612 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 >> 172.21.15.170:6789/0 conn(0x7f26680a33d0 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:32:17.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.612 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 shutdown_connections 2020-01-26T15:32:17.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.612 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 shutdown_connections 2020-01-26T15:32:17.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.612 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 wait complete. 2020-01-26T15:32:17.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.612 7f266f5c5700 1 -- 172.21.15.170:0/2378067468 >> 172.21.15.170:0/2378067468 conn(0x7f26680994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:17.624 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:11.534039', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.037219', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.435582', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:32:17.625 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:32:17.731 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c7b6f700 1 Processor -- start 2020-01-26T15:32:17.731 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c7b6f700 1 -- - start start 2020-01-26T15:32:17.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c7b6f700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c014bb50 con 0 2020-01-26T15:32:17.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c7b6f700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c014bef0 con 0 2020-01-26T15:32:17.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c5394700 1 -- 172.21.15.170:0/1573972890 learned_addr learned my addr 172.21.15.170:0/1573972890 2020-01-26T15:32:17.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f14b0003630 con 0x7f14c014b410 2020-01-26T15:32:17.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3338400026 0 0) 0x7f14b00039b0 con 0x7f14c014b410 2020-01-26T15:32:17.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f14a8002a20 con 0 2020-01-26T15:32:17.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f14bc0022a0 con 0x7f14c0148110 2020-01-26T15:32:17.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3787392960 0 0) 0x7f14bc002620 con 0x7f14c0148110 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.728 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f14a80046c0 con 0 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1019183840 0 0) 0x7f14b0003f80 con 0x7f14c014b410 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 >> 172.21.15.170:6791/0 conn(0x7f14c0148110 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c007a8b0 con 0 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f14c0116ec0 con 0x7f14c014b410 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c4b93700 1 -- 172.21.15.170:0/1573972890 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f14b0001050 con 0x7f14c014b410 2020-01-26T15:32:17.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c7b6f700 1 -- 172.21.15.170:0/1573972890 >> 172.21.15.170:6790/0 conn(0x7f14c014b410 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:32:17.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c7b6f700 1 -- 172.21.15.170:0/1573972890 shutdown_connections 2020-01-26T15:32:17.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c7b6f700 1 -- 172.21.15.170:0/1573972890 shutdown_connections 2020-01-26T15:32:17.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c7b6f700 1 -- 172.21.15.170:0/1573972890 wait complete. 2020-01-26T15:32:17.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c7b6f700 1 -- 172.21.15.170:0/1573972890 >> 172.21.15.170:0/1573972890 conn(0x7f14c0144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:17.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.732 7f14c7b6f700 1 Processor -- start 2020-01-26T15:32:17.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14c7b6f700 1 -- - start start 2020-01-26T15:32:17.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14c7b6f700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c00a3d30 con 0 2020-01-26T15:32:17.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14c7b6f700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c00a6910 con 0 2020-01-26T15:32:17.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14c5394700 1 -- 172.21.15.170:0/1872217575 learned_addr learned my addr 172.21.15.170:0/1872217575 2020-01-26T15:32:17.740 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f14b0000e50 con 0x7f14c00a62c0 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3067993141 0 0) 0x7f14b0001570 con 0x7f14c00a62c0 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f14a0002960 con 0 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f14bc002b60 con 0x7f14c00a3340 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2639327001 0 0) 0x7f14bc0020e0 con 0x7f14c00a3340 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f14a0004620 con 0 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3648319892 0 0) 0x7f14b00019c0 con 0x7f14c00a62c0 2020-01-26T15:32:17.741 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14a0002ee0 con 0 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3140554141 0 0) 0x7f14bc0024f0 con 0x7f14c00a3340 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14a0003540 con 0 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (899462983 0 0) 0x7f14b0003620 con 0x7f14c00a62c0 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 >> 172.21.15.170:6789/0 conn(0x7f14c00a3340 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c007ab10 con 0 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c00b2710 con 0 2020-01-26T15:32:17.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c018b220 con 0 2020-01-26T15:32:17.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f14b0001360 con 0x7f14c00a62c0 2020-01-26T15:32:17.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f14b0003a50 con 0x7f14c00a62c0 2020-01-26T15:32:17.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f14b0004750 con 0x7f14c00a62c0 2020-01-26T15:32:17.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.736 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f14b00060d0 con 0x7f14c00a62c0 2020-01-26T15:32:17.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.744 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c007ae90 con 0 2020-01-26T15:32:17.753 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.748 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f14c007ae90 con 0x7f14c00a62c0 2020-01-26T15:32:17.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.840 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 --> 172.21.15.170:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f14c018ba20 con 0 2020-01-26T15:32:17.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.840 7f14aeffd700 1 -- 172.21.15.170:0/1872217575 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (3245944037 0 265718887) 0x7f14b0004230 con 0x7f14c00a62c0 2020-01-26T15:32:17.844 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:17.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.844 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 >> 172.21.15.170:6800/11008 conn(0x7f14a0006fc0 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-01-26T15:32:17.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.844 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 >> 172.21.15.170:6791/0 conn(0x7f14c00a62c0 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-01-26T15:32:17.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.844 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 shutdown_connections 2020-01-26T15:32:17.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.844 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 shutdown_connections 2020-01-26T15:32:17.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.844 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 wait complete. 2020-01-26T15:32:17.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.844 7f14c7b6f700 1 -- 172.21.15.170:0/1872217575 >> 172.21.15.170:0/1872217575 conn(0x7f14c00993d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:17.855 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:32:17.952 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f8636afd700 1 Processor -- start 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f8636afd700 1 -- - start start 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f8636afd700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863014bba0 con 0 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f8636afd700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863014bf40 con 0 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f8634b23700 1 -- 172.21.15.170:0/1171827695 learned_addr learned my addr 172.21.15.170:0/1171827695 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f86280039b0 con 0x7f8630148110 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4154664901 0 0) 0x7f8628003d30 con 0x7f8630148110 2020-01-26T15:32:17.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8610002a20 con 0 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f86180022a0 con 0x7f863014b410 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2337649886 0 0) 0x7f86180025a0 con 0x7f863014b410 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f86100046c0 con 0 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4033226155 0 0) 0x7f8628004300 con 0x7f8630148110 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 >> 172.21.15.170:6791/0 conn(0x7f863014b410 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863007a8b0 con 0 2020-01-26T15:32:17.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8628000f70 con 0x7f8630148110 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f862f7fe700 1 -- 172.21.15.170:0/1171827695 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f86280013d0 con 0x7f8630148110 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.944 7f8636afd700 1 -- 172.21.15.170:0/1171827695 >> 172.21.15.170:6789/0 conn(0x7f8630148110 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- 172.21.15.170:0/1171827695 shutdown_connections 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- 172.21.15.170:0/1171827695 shutdown_connections 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- 172.21.15.170:0/1171827695 wait complete. 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- 172.21.15.170:0/1171827695 >> 172.21.15.170:0/1171827695 conn(0x7f8630144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 Processor -- start 2020-01-26T15:32:17.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- - start start 2020-01-26T15:32:17.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300a3fb0 con 0 2020-01-26T15:32:17.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8636afd700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300a4210 con 0 2020-01-26T15:32:17.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f8634b23700 1 -- 172.21.15.170:0/3754447540 learned_addr learned my addr 172.21.15.170:0/3754447540 2020-01-26T15:32:17.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f86280011d0 con 0x7f86300a37a0 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3355466513 0 0) 0x7f8628003700 con 0x7f86300a37a0 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.948 7f862dffb700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8614002960 con 0 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8618002ae0 con 0x7f86300a6720 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3716779041 0 0) 0x7f86180020e0 con 0x7f86300a6720 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8614004620 con 0 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3160460796 0 0) 0x7f8628003b50 con 0x7f86300a37a0 2020-01-26T15:32:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8614002ee0 con 0 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3977713169 0 0) 0x7f8628001b90 con 0x7f86300a37a0 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 >> 172.21.15.170:6790/0 conn(0x7f86300a6720 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863007ab10 con 0 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f8636afd700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300711a0 con 0 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f8636afd700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f863018b880 con 0 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f86300ea030 con 0x7f86300a37a0 2020-01-26T15:32:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8628001e00 con 0x7f86300a37a0 2020-01-26T15:32:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f8628004b00 con 0x7f86300a37a0 2020-01-26T15:32:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.952 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f8628004de0 con 0x7f86300a37a0 2020-01-26T15:32:17.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.960 7f8636afd700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863007ae90 con 0 2020-01-26T15:32:17.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:17.964 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f863007ae90 con 0x7f86300a37a0 2020-01-26T15:32:18.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.056 7f8636afd700 1 -- 172.21.15.170:0/3754447540 --> 172.21.15.170:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f8630070bc0 con 0 2020-01-26T15:32:18.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.056 7f862dffb700 1 -- 172.21.15.170:0/3754447540 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7f86280047f0 con 0x7f86300a37a0 2020-01-26T15:32:18.059 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:18.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.056 7f8636afd700 1 -- 172.21.15.170:0/3754447540 >> 172.21.15.170:6800/11008 conn(0x7f8614006650 :-1 s=STATE_OPEN pgs=41 cs=1 l=1).mark_down 2020-01-26T15:32:18.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.056 7f8636afd700 1 -- 172.21.15.170:0/3754447540 >> 172.21.15.170:6791/0 conn(0x7f86300a37a0 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-01-26T15:32:18.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.060 7f8636afd700 1 -- 172.21.15.170:0/3754447540 shutdown_connections 2020-01-26T15:32:18.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.060 7f8636afd700 1 -- 172.21.15.170:0/3754447540 shutdown_connections 2020-01-26T15:32:18.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.060 7f8636afd700 1 -- 172.21.15.170:0/3754447540 wait complete. 2020-01-26T15:32:18.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.060 7f8636afd700 1 -- 172.21.15.170:0/3754447540 >> 172.21.15.170:0/3754447540 conn(0x7f86300997b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.074 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:32:18.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f6152d00700 1 Processor -- start 2020-01-26T15:32:18.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f6152d00700 1 -- - start start 2020-01-26T15:32:18.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f6152d00700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c14bb50 con 0 2020-01-26T15:32:18.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f6152d00700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c14bef0 con 0 2020-01-26T15:32:18.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f6150d26700 1 -- 172.21.15.170:0/1467139018 learned_addr learned my addr 172.21.15.170:0/1467139018 2020-01-26T15:32:18.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f61440039b0 con 0x7f614c148110 2020-01-26T15:32:18.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1441535141 0 0) 0x7f6144003d30 con 0x7f614c148110 2020-01-26T15:32:18.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6134002a20 con 0 2020-01-26T15:32:18.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f61380022a0 con 0x7f614c14b410 2020-01-26T15:32:18.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1125552997 0 0) 0x7f61380025a0 con 0x7f614c14b410 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f61340046c0 con 0 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2376372523 0 0) 0x7f6144004230 con 0x7f614c148110 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 >> 172.21.15.170:6790/0 conn(0x7f614c14b410 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c07a8b0 con 0 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6144000f70 con 0x7f614c148110 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f614b7fe700 1 -- 172.21.15.170:0/1467139018 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6144001390 con 0x7f614c148110 2020-01-26T15:32:18.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.160 7f6152d00700 1 -- 172.21.15.170:0/1467139018 >> 172.21.15.170:6789/0 conn(0x7f614c148110 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- 172.21.15.170:0/1467139018 shutdown_connections 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- 172.21.15.170:0/1467139018 shutdown_connections 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- 172.21.15.170:0/1467139018 wait complete. 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- 172.21.15.170:0/1467139018 >> 172.21.15.170:0/1467139018 conn(0x7f614c144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 Processor -- start 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- - start start 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0a3ea0 con 0 2020-01-26T15:32:18.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c092b70 con 0 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6150d26700 1 -- 172.21.15.170:0/143268995 learned_addr learned my addr 172.21.15.170:0/143268995 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6138002ae0 con 0x7f614c0a5260 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (887448573 0 0) 0x7f61380020e0 con 0x7f614c0a5260 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6128002960 con 0 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f61440011d0 con 0x7f614c0a34b0 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1010224279 0 0) 0x7f61440018b0 con 0x7f614c0a34b0 2020-01-26T15:32:18.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6128004620 con 0 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2216487936 0 0) 0x7f6138002530 con 0x7f614c0a5260 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6128002ee0 con 0 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2572220332 0 0) 0x7f6144001c30 con 0x7f614c0a34b0 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6128003540 con 0 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3611074123 0 0) 0x7f6144003700 con 0x7f614c0a34b0 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 >> 172.21.15.170:6789/0 conn(0x7f614c0a5260 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-01-26T15:32:18.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6149ffb700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c07ab10 con 0 2020-01-26T15:32:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c0b2810 con 0 2020-01-26T15:32:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.164 7f6152d00700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c0a6d80 con 0 2020-01-26T15:32:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.168 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f614c0ea030 con 0x7f614c0a34b0 2020-01-26T15:32:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.168 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6144003b30 con 0x7f614c0a34b0 2020-01-26T15:32:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.168 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f6144003d70 con 0x7f614c0a34b0 2020-01-26T15:32:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.168 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f6144005f10 con 0x7f614c0a34b0 2020-01-26T15:32:18.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.176 7f6152d00700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c002070 con 0 2020-01-26T15:32:18.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.180 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f61440043f0 con 0x7f614c0a34b0 2020-01-26T15:32:18.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f612c0012a0 con 0 2020-01-26T15:32:18.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6149ffb700 1 -- 172.21.15.170:0/143268995 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7f61440061b0 con 0x7f614c0a34b0 2020-01-26T15:32:18.274 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 >> 172.21.15.170:6800/11008 conn(0x7f6128006e70 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-01-26T15:32:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 >> 172.21.15.170:6790/0 conn(0x7f614c0a34b0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:32:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 shutdown_connections 2020-01-26T15:32:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 shutdown_connections 2020-01-26T15:32:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 wait complete. 2020-01-26T15:32:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.272 7f6152d00700 1 -- 172.21.15.170:0/143268995 >> 172.21.15.170:0/143268995 conn(0x7f614c0995c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.285 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-26T15:32:18.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-26T15:32:18.286 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-26T15:32:18.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.372 7fd53ba36700 1 Processor -- start 2020-01-26T15:32:18.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.372 7fd53ba36700 1 -- - start start 2020-01-26T15:32:18.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53414bb10 con 0 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53414beb0 con 0 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53925b700 1 -- 172.21.15.170:0/3390556338 learned_addr learned my addr 172.21.15.170:0/3390556338 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd530002620 con 0x7fd5341480d0 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd524003630 con 0x7fd53414b3d0 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2028183964 0 0) 0x7fd5300029a0 con 0x7fd5341480d0 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd518002ea0 con 0 2020-01-26T15:32:18.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2682393002 0 0) 0x7fd5240039b0 con 0x7fd53414b3d0 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd5180046b0 con 0 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1665927188 0 0) 0x7fd530002e90 con 0x7fd5341480d0 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 >> 172.21.15.170:6791/0 conn(0x7fd53414b3d0 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=47 cs=1 l=1).mark_down 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53407a930 con 0 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd5340e9ff0 con 0x7fd5341480d0 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd538a5a700 1 -- 172.21.15.170:0/3390556338 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd530001390 con 0x7fd5341480d0 2020-01-26T15:32:18.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- 172.21.15.170:0/3390556338 >> 172.21.15.170:6790/0 conn(0x7fd5341480d0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:32:18.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- 172.21.15.170:0/3390556338 shutdown_connections 2020-01-26T15:32:18.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- 172.21.15.170:0/3390556338 shutdown_connections 2020-01-26T15:32:18.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- 172.21.15.170:0/3390556338 wait complete. 2020-01-26T15:32:18.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.376 7fd53ba36700 1 -- 172.21.15.170:0/3390556338 >> 172.21.15.170:0/3390556338 conn(0x7fd534144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd53ba36700 1 Processor -- start 2020-01-26T15:32:18.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd53ba36700 1 -- - start start 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd53ba36700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340a3b80 con 0 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd53ba36700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340a67f0 con 0 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd539a5c700 1 -- 172.21.15.170:0/1420066628 learned_addr learned my addr 172.21.15.170:0/1420066628 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd530001390 con 0x7fd5340a3190 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (481262934 0 0) 0x7fd5300023d0 con 0x7fd5340a3190 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd51c002960 con 0 2020-01-26T15:32:18.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd524003ef0 con 0x7fd5340a61a0 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1198739667 0 0) 0x7fd524003410 con 0x7fd5340a61a0 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd51c004620 con 0 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1235838521 0 0) 0x7fd524003870 con 0x7fd5340a61a0 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd51c002ee0 con 0 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2776028135 0 0) 0x7fd530002950 con 0x7fd5340a3190 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd51c003540 con 0 2020-01-26T15:32:18.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1960713767 0 0) 0x7fd5240010f0 con 0x7fd5340a61a0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 >> 172.21.15.170:6791/0 conn(0x7fd5340a3190 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=48 cs=1 l=1).mark_down 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53407ab90 con 0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340b2780 con 0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53418af20 con 0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd534116e80 con 0x7fd5340a61a0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd524001520 con 0x7fd5340a61a0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fd524004130 con 0x7fd5340a61a0 2020-01-26T15:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.380 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7fd524005cc0 con 0x7fd5340a61a0 2020-01-26T15:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.388 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53407af30 con 0 2020-01-26T15:32:18.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.392 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd53407af30 con 0x7fd5340a61a0 2020-01-26T15:32:18.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd534070d10 con 0 2020-01-26T15:32:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd52affd700 1 -- 172.21.15.170:0/1420066628 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+1889 (3797009233 0 2147512942) 0x7fd524001af0 con 0x7fd5340a61a0 2020-01-26T15:32:18.490 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 >> 172.21.15.170:6800/11008 conn(0x7fd51c006ee0 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:32:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 >> 172.21.15.170:6789/0 conn(0x7fd5340a61a0 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-01-26T15:32:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 shutdown_connections 2020-01-26T15:32:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 shutdown_connections 2020-01-26T15:32:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 wait complete. 2020-01-26T15:32:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.488 7fd53ba36700 1 -- 172.21.15.170:0/1420066628 >> 172.21.15.170:0/1420066628 conn(0x7fd534099340 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.501 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":4,"active_gid":4111,"active_name":"x","active_addr":"172.21.15.170:6800/11008","available":true,"standbys":[{"gid":4108,"name":"y","available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"crash","can_run":true,"error_string":""},{"name":"dashboard","can_run":true,"error_string":""},{"name":"hello","can_run":true,"error_string":""},{"name":"influx","can_run":false,"error_string":"influxdb python module not found"},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"crash","can_run":true,"error_string":""},{"name":"dashboard","can_run":true,"error_string":""},{"name":"hello","can_run":true,"error_string":""},{"name":"influx","can_run":false,"error_string":"influxdb python module not found"},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}],"services":{}} 2020-01-26T15:32:18.502 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-26T15:32:18.502 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:32:18.502 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb1615d9700 1 Processor -- start 2020-01-26T15:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb1615d9700 1 -- - start start 2020-01-26T15:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb1615d9700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c14bb10 con 0 2020-01-26T15:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb1615d9700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c14beb0 con 0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15b572700 1 -- 172.21.15.170:0/915643251 learned_addr learned my addr 172.21.15.170:0/915643251 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb14c0039b0 con 0x7fb15c1480d0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2207163128 0 0) 0x7fb14c003d30 con 0x7fb15c1480d0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb148002a20 con 0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb1500022a0 con 0x7fb15c14b3d0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1661472275 0 0) 0x7fb1500025a0 con 0x7fb15c14b3d0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb1480046c0 con 0 2020-01-26T15:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2735286338 0 0) 0x7fb150002a40 con 0x7fb15c14b3d0 2020-01-26T15:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 >> 172.21.15.170:6791/0 conn(0x7fb15c1480d0 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.588 7fb15a570700 1 -- 172.21.15.170:0/915643251 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c07a930 con 0 2020-01-26T15:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb15c116e80 con 0x7fb15c14b3d0 2020-01-26T15:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb15a570700 1 -- 172.21.15.170:0/915643251 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb150000e50 con 0x7fb15c14b3d0 2020-01-26T15:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb1615d9700 1 -- 172.21.15.170:0/915643251 >> 172.21.15.170:6789/0 conn(0x7fb15c14b3d0 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb1615d9700 1 -- 172.21.15.170:0/915643251 shutdown_connections 2020-01-26T15:32:18.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb1615d9700 1 -- 172.21.15.170:0/915643251 shutdown_connections 2020-01-26T15:32:18.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb1615d9700 1 -- 172.21.15.170:0/915643251 wait complete. 2020-01-26T15:32:18.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.592 7fb1615d9700 1 -- 172.21.15.170:0/915643251 >> 172.21.15.170:0/915643251 conn(0x7fb15c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb1615d9700 1 Processor -- start 2020-01-26T15:32:18.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb1615d9700 1 -- - start start 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb1615d9700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c0a3e00 con 0 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb1615d9700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c0a6bd0 con 0 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb15ad71700 1 -- 172.21.15.170:0/2526196774 learned_addr learned my addr 172.21.15.170:0/2526196774 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb14c0037f0 con 0x7fb15c0a3410 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1362520744 0 0) 0x7fb14c003a70 con 0x7fb15c0a3410 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb13c002960 con 0 2020-01-26T15:32:18.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb150002c00 con 0x7fb15c0a6420 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (773739110 0 0) 0x7fb150002080 con 0x7fb15c0a6420 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb13c004620 con 0 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1346825898 0 0) 0x7fb14c0011d0 con 0x7fb15c0a3410 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb13c002ee0 con 0 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2399252802 0 0) 0x7fb150002520 con 0x7fb15c0a6420 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb13c003540 con 0 2020-01-26T15:32:18.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1306802233 0 0) 0x7fb14c0016e0 con 0x7fb15c0a3410 2020-01-26T15:32:18.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 >> 172.21.15.170:6791/0 conn(0x7fb15c0a6420 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:32:18.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c07ab90 con 0 2020-01-26T15:32:18.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15c0b2940 con 0 2020-01-26T15:32:18.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c18b1e0 con 0 2020-01-26T15:32:18.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb15c0e9ff0 con 0x7fb15c0a3410 2020-01-26T15:32:18.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb14c001b10 con 0x7fb15c0a3410 2020-01-26T15:32:18.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fb14c001d50 con 0x7fb15c0a3410 2020-01-26T15:32:18.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.596 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7fb14c0045e0 con 0x7fb15c0a3410 2020-01-26T15:32:18.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.600 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c07af30 con 0 2020-01-26T15:32:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.604 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb15c07af30 con 0x7fb15c0a3410 2020-01-26T15:32:18.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.696 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb15c073330 con 0 2020-01-26T15:32:18.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.696 7fb158d6d700 1 -- 172.21.15.170:0/2526196774 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 1605628788) 0x7fb14c005030 con 0x7fb15c0a3410 2020-01-26T15:32:18.700 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:18.700 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":16,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:17.386083","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:18.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.700 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 >> 172.21.15.170:6800/11008 conn(0x7fb13c006ed0 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-01-26T15:32:18.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.700 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 >> 172.21.15.170:6790/0 conn(0x7fb15c0a3410 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:32:18.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.700 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 shutdown_connections 2020-01-26T15:32:18.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.700 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 shutdown_connections 2020-01-26T15:32:18.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.700 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 wait complete. 2020-01-26T15:32:18.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.700 7fb1615d9700 1 -- 172.21.15.170:0/2526196774 >> 172.21.15.170:0/2526196774 conn(0x7fb15c099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.718 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:32:18.718 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:18.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b998bd700 1 Processor -- start 2020-01-26T15:32:18.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b998bd700 1 -- - start start 2020-01-26T15:32:18.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b998bd700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9414bb10 con 0 2020-01-26T15:32:18.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b998bd700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9414beb0 con 0 2020-01-26T15:32:18.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b92ffd700 1 -- 172.21.15.170:0/2122785637 learned_addr learned my addr 172.21.15.170:0/2122785637 2020-01-26T15:32:18.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2b7c003630 con 0x7f2b9414b3d0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2b8c002620 con 0x7f2b941480d0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3307579946 0 0) 0x7f2b7c0039b0 con 0x7f2b9414b3d0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2b74002ea0 con 0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1653780714 0 0) 0x7f2b8c0029a0 con 0x7f2b941480d0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2b740046a0 con 0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2635353156 0 0) 0x7f2b7c003ea0 con 0x7f2b9414b3d0 2020-01-26T15:32:18.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 >> 172.21.15.170:6790/0 conn(0x7f2b941480d0 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:32:18.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9407a930 con 0 2020-01-26T15:32:18.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2b7c000bf0 con 0x7f2b9414b3d0 2020-01-26T15:32:18.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b927fc700 1 -- 172.21.15.170:0/2122785637 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2b7c001010 con 0x7f2b9414b3d0 2020-01-26T15:32:18.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.812 7f2b998bd700 1 -- 172.21.15.170:0/2122785637 >> 172.21.15.170:6789/0 conn(0x7f2b9414b3d0 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:32:18.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- 172.21.15.170:0/2122785637 shutdown_connections 2020-01-26T15:32:18.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- 172.21.15.170:0/2122785637 shutdown_connections 2020-01-26T15:32:18.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- 172.21.15.170:0/2122785637 wait complete. 2020-01-26T15:32:18.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- 172.21.15.170:0/2122785637 >> 172.21.15.170:0/2122785637 conn(0x7f2b94144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 Processor -- start 2020-01-26T15:32:18.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- - start start 2020-01-26T15:32:18.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9409fc50 con 0 2020-01-26T15:32:18.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b940a2a20 con 0 2020-01-26T15:32:18.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b937fe700 1 -- 172.21.15.170:0/3618860429 learned_addr learned my addr 172.21.15.170:0/3618860429 2020-01-26T15:32:18.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2b8c002620 con 0x7f2b9409f260 2020-01-26T15:32:18.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2348016112 0 0) 0x7f2b8c002d20 con 0x7f2b9409f260 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2b78002960 con 0 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2b7c003ea0 con 0x7f2b940a2270 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2653460226 0 0) 0x7f2b7c000e50 con 0x7f2b940a2270 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2b78004620 con 0 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1136186595 0 0) 0x7f2b8c0011d0 con 0x7f2b9409f260 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b78002ee0 con 0 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3079208777 0 0) 0x7f2b7c0033e0 con 0x7f2b940a2270 2020-01-26T15:32:18.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b78003540 con 0 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1974127984 0 0) 0x7f2b8c001860 con 0x7f2b9409f260 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 >> 172.21.15.170:6790/0 conn(0x7f2b940a2270 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9407ab90 con 0 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b940713d0 con 0 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.816 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9418b470 con 0 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.820 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2b940e9ff0 con 0x7f2b9409f260 2020-01-26T15:32:18.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.820 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2b8c001c90 con 0x7f2b9409f260 2020-01-26T15:32:18.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.820 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2b8c001ed0 con 0x7f2b9409f260 2020-01-26T15:32:18.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.820 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f2b8c006010 con 0x7f2b9409f260 2020-01-26T15:32:18.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.824 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c002070 con 0 2020-01-26T15:32:18.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.832 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2b8c004310 con 0x7f2b9409f260 2020-01-26T15:32:18.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.920 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b6c001220 con 0 2020-01-26T15:32:18.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b90ff9700 1 -- 172.21.15.170:0/3618860429 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 1605628788) 0x7f2b8c0045d0 con 0x7f2b9409f260 2020-01-26T15:32:18.926 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:18.926 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":16,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:17.386083","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:18.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 >> 172.21.15.170:6800/11008 conn(0x7f2b78006ed0 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-01-26T15:32:18.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 >> 172.21.15.170:6789/0 conn(0x7f2b9409f260 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:32:18.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 shutdown_connections 2020-01-26T15:32:18.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 shutdown_connections 2020-01-26T15:32:18.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 wait complete. 2020-01-26T15:32:18.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:18.924 7f2b998bd700 1 -- 172.21.15.170:0/3618860429 >> 172.21.15.170:0/3618860429 conn(0x7f2b94178130 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:18.941 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-26T15:32:19.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f37737b2700 1 Processor -- start 2020-01-26T15:32:19.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f37737b2700 1 -- - start start 2020-01-26T15:32:19.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f37737b2700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c14bb30 con 0 2020-01-26T15:32:19.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f37737b2700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c14bed0 con 0 2020-01-26T15:32:19.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f37717d8700 1 -- 172.21.15.170:0/2926596325 learned_addr learned my addr 172.21.15.170:0/2926596325 2020-01-26T15:32:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37600039b0 con 0x7f376c1480f0 2020-01-26T15:32:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2860895897 0 0) 0x7f3760003d30 con 0x7f376c1480f0 2020-01-26T15:32:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3750002a20 con 0 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37580022a0 con 0x7f376c14b3f0 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4224103357 0 0) 0x7f3758002620 con 0x7f376c14b3f0 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37500046c0 con 0 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2607128263 0 0) 0x7f3760004300 con 0x7f376c1480f0 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 >> 172.21.15.170:6789/0 conn(0x7f376c14b3f0 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c07a890 con 0 2020-01-26T15:32:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f376c0ea010 con 0x7f376c1480f0 2020-01-26T15:32:19.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.028 7f376bfff700 1 -- 172.21.15.170:0/2926596325 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37600013d0 con 0x7f376c1480f0 2020-01-26T15:32:19.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.032 7f37737b2700 1 -- 172.21.15.170:0/2926596325 >> 172.21.15.170:6790/0 conn(0x7f376c1480f0 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:32:19.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.032 7f37737b2700 1 -- 172.21.15.170:0/2926596325 shutdown_connections 2020-01-26T15:32:19.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.032 7f37737b2700 1 -- 172.21.15.170:0/2926596325 shutdown_connections 2020-01-26T15:32:19.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.032 7f37737b2700 1 -- 172.21.15.170:0/2926596325 wait complete. 2020-01-26T15:32:19.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.032 7f37737b2700 1 -- 172.21.15.170:0/2926596325 >> 172.21.15.170:0/2926596325 conn(0x7f376c144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37737b2700 1 Processor -- start 2020-01-26T15:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37737b2700 1 -- - start start 2020-01-26T15:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37737b2700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0a3e50 con 0 2020-01-26T15:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37737b2700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0a5370 con 0 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37717d8700 1 -- 172.21.15.170:0/3859431674 learned_addr learned my addr 172.21.15.170:0/3859431674 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37600011d0 con 0x7f376c095ca0 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3273111259 0 0) 0x7f37600018f0 con 0x7f376c095ca0 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3754002960 con 0 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3758002b60 con 0x7f376c0a3460 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3634896375 0 0) 0x7f37580020e0 con 0x7f376c0a3460 2020-01-26T15:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3754004620 con 0 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4430367 0 0) 0x7f3758002540 con 0x7f376c0a3460 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3754002ee0 con 0 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1293083623 0 0) 0x7f3760001d40 con 0x7f376c095ca0 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3754003540 con 0 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (777630916 0 0) 0x7f37580010f0 con 0x7f376c0a3460 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 >> 172.21.15.170:6789/0 conn(0x7f376c095ca0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c07aaf0 con 0 2020-01-26T15:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37737b2700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0b2840 con 0 2020-01-26T15:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f37737b2700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c0a6ca0 con 0 2020-01-26T15:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f376c116ea0 con 0x7f376c0a3460 2020-01-26T15:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3758001520 con 0x7f376c0a3460 2020-01-26T15:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f3758002ed0 con 0x7f376c0a3460 2020-01-26T15:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.036 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f3758001760 con 0x7f376c0a3460 2020-01-26T15:32:19.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.040 7f37737b2700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6801/11354 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f376c148880 con 0 2020-01-26T15:32:19.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.040 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== osd.0 172.21.15.170:6801/11354 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f3764000bf0 con 0x7f376c033d50 2020-01-26T15:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.052 7f37737b2700 1 -- 172.21.15.170:0/3859431674 --> 172.21.15.170:6801/11354 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f376c074240 con 0 2020-01-26T15:32:19.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.052 7f376a7fc700 1 -- 172.21.15.170:0/3859431674 <== osd.0 172.21.15.170:6801/11354 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f376c148880 con 0x7f376c033d50 2020-01-26T15:32:19.056 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:19.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.052 7f37737b2700 1 -- 172.21.15.170:0/3859431674 >> 172.21.15.170:6801/11354 conn(0x7f376c033d50 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:32:19.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.056 7f37737b2700 1 -- 172.21.15.170:0/3859431674 >> 172.21.15.170:6800/11008 conn(0x7f3754006e70 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:32:19.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.056 7f37737b2700 1 -- 172.21.15.170:0/3859431674 >> 172.21.15.170:6791/0 conn(0x7f376c0a3460 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.056 7f37737b2700 1 -- 172.21.15.170:0/3859431674 shutdown_connections 2020-01-26T15:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.056 7f37737b2700 1 -- 172.21.15.170:0/3859431674 shutdown_connections 2020-01-26T15:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.056 7f37737b2700 1 -- 172.21.15.170:0/3859431674 wait complete. 2020-01-26T15:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.056 7f37737b2700 1 -- 172.21.15.170:0/3859431674 >> 172.21.15.170:0/3859431674 conn(0x7f376c0995f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.068 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-26T15:32:19.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.160 7f849ec83700 1 Processor -- start 2020-01-26T15:32:19.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.160 7f849ec83700 1 -- - start start 2020-01-26T15:32:19.166 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849814bb30 con 0 2020-01-26T15:32:19.166 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849814bed0 con 0 2020-01-26T15:32:19.166 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f8497fff700 1 -- 172.21.15.170:0/1441001376 learned_addr learned my addr 172.21.15.170:0/1441001376 2020-01-26T15:32:19.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8488002620 con 0x7f84981480f0 2020-01-26T15:32:19.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8480003630 con 0x7f849814b3f0 2020-01-26T15:32:19.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1703664735 0 0) 0x7f84880029a0 con 0x7f84981480f0 2020-01-26T15:32:19.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8478002ea0 con 0 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1610075079 0 0) 0x7f84800039b0 con 0x7f849814b3f0 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f84780046b0 con 0 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3692908672 0 0) 0x7f8488002e90 con 0x7f84981480f0 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 >> 172.21.15.170:6789/0 conn(0x7f849814b3f0 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=54 cs=1 l=1).mark_down 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849807a890 con 0 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f84980ea010 con 0x7f84981480f0 2020-01-26T15:32:19.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f84977fe700 1 -- 172.21.15.170:0/1441001376 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8488001390 con 0x7f84981480f0 2020-01-26T15:32:19.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- 172.21.15.170:0/1441001376 >> 172.21.15.170:6790/0 conn(0x7f84981480f0 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:32:19.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- 172.21.15.170:0/1441001376 shutdown_connections 2020-01-26T15:32:19.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- 172.21.15.170:0/1441001376 shutdown_connections 2020-01-26T15:32:19.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- 172.21.15.170:0/1441001376 wait complete. 2020-01-26T15:32:19.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.164 7f849ec83700 1 -- 172.21.15.170:0/1441001376 >> 172.21.15.170:0/1441001376 conn(0x7f8498144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f849ec83700 1 Processor -- start 2020-01-26T15:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f849ec83700 1 -- - start start 2020-01-26T15:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f849ec83700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980a3b20 con 0 2020-01-26T15:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f849ec83700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980a68f0 con 0 2020-01-26T15:32:19.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8497fff700 1 -- 172.21.15.170:0/419872411 learned_addr learned my addr 172.21.15.170:0/419872411 2020-01-26T15:32:19.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8480003fe0 con 0x7f84980a6140 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2381070053 0 0) 0x7f8480003510 con 0x7f84980a6140 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f847c002960 con 0 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f84880011d0 con 0x7f84980a3130 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3790979162 0 0) 0x7f84880023d0 con 0x7f84980a3130 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f847c004620 con 0 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4294650313 0 0) 0x7f8480000e50 con 0x7f84980a6140 2020-01-26T15:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f847c002ee0 con 0 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3612660838 0 0) 0x7f8488002880 con 0x7f84980a3130 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f847c003540 con 0 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (110051268 0 0) 0x7f8480001420 con 0x7f84980a6140 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 >> 172.21.15.170:6791/0 conn(0x7f84980a3130 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f8495ffb700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849807aaf0 con 0 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.168 7f849ec83700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84980b2810 con 0 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.172 7f849ec83700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f849818b080 con 0 2020-01-26T15:32:19.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.172 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8480000bf0 con 0x7f84980a6140 2020-01-26T15:32:19.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.172 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8480001850 con 0x7f84980a6140 2020-01-26T15:32:19.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.172 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f8480001a90 con 0x7f84980a6140 2020-01-26T15:32:19.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.172 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f8480005f60 con 0x7f84980a6140 2020-01-26T15:32:19.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.176 7f849ec83700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6809/11357 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8470004d60 con 0 2020-01-26T15:32:19.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.176 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== osd.1 172.21.15.170:6809/11357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f84980bd1d0 con 0x7f8470001600 2020-01-26T15:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.188 7f849ec83700 1 -- 172.21.15.170:0/419872411 --> 172.21.15.170:6809/11357 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f84700053b0 con 0 2020-01-26T15:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.188 7f8495ffb700 1 -- 172.21.15.170:0/419872411 <== osd.1 172.21.15.170:6809/11357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f8470004d60 con 0x7f8470001600 2020-01-26T15:32:19.192 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 >> 172.21.15.170:6809/11357 conn(0x7f8470001600 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-01-26T15:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 >> 172.21.15.170:6800/11008 conn(0x7f847c006e90 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 >> 172.21.15.170:6790/0 conn(0x7f84980a6140 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:32:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 shutdown_connections 2020-01-26T15:32:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 shutdown_connections 2020-01-26T15:32:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 wait complete. 2020-01-26T15:32:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.192 7f849ec83700 1 -- 172.21.15.170:0/419872411 >> 172.21.15.170:0/419872411 conn(0x7f8498099390 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.209 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-26T15:32:19.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 Processor -- start 2020-01-26T15:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- - start start 2020-01-26T15:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec14bb30 con 0 2020-01-26T15:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec14bed0 con 0 2020-01-26T15:32:19.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf1cd0700 1 -- 172.21.15.170:0/2533358506 learned_addr learned my addr 172.21.15.170:0/2533358506 2020-01-26T15:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7faddc003630 con 0x7fadec14b3f0 2020-01-26T15:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2580283738 0 0) 0x7faddc0039b0 con 0x7fadec14b3f0 2020-01-26T15:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fadd4002a20 con 0 2020-01-26T15:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fade80022a0 con 0x7fadec1480f0 2020-01-26T15:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1893796711 0 0) 0x7fade8002620 con 0x7fadec1480f0 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fadd40046c0 con 0 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2284789155 0 0) 0x7faddc003f80 con 0x7fadec14b3f0 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 >> 172.21.15.170:6789/0 conn(0x7fadec1480f0 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec07a890 con 0 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fadec116ea0 con 0x7fadec14b3f0 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf14cf700 1 -- 172.21.15.170:0/2533358506 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7faddc001050 con 0x7fadec14b3f0 2020-01-26T15:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- 172.21.15.170:0/2533358506 >> 172.21.15.170:6790/0 conn(0x7fadec14b3f0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:32:19.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- 172.21.15.170:0/2533358506 shutdown_connections 2020-01-26T15:32:19.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- 172.21.15.170:0/2533358506 shutdown_connections 2020-01-26T15:32:19.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- 172.21.15.170:0/2533358506 wait complete. 2020-01-26T15:32:19.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.304 7fadf44ab700 1 -- 172.21.15.170:0/2533358506 >> 172.21.15.170:0/2533358506 conn(0x7fadec144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7fadf44ab700 1 Processor -- start 2020-01-26T15:32:19.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7fadf44ab700 1 -- - start start 2020-01-26T15:32:19.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7fadf44ab700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0a3cb0 con 0 2020-01-26T15:32:19.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7fadf44ab700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0a6a80 con 0 2020-01-26T15:32:19.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7fadf24d1700 1 -- 172.21.15.170:0/1777210627 learned_addr learned my addr 172.21.15.170:0/1777210627 2020-01-26T15:32:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fade80020e0 con 0x7fadec0a32c0 2020-01-26T15:32:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3821365055 0 0) 0x7fade80023e0 con 0x7fadec0a32c0 2020-01-26T15:32:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fadcc002960 con 0 2020-01-26T15:32:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7faddc000e50 con 0x7fadec0a62d0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1982800330 0 0) 0x7faddc001570 con 0x7fadec0a62d0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fadcc004620 con 0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (176583586 0 0) 0x7fade8000e50 con 0x7fadec0a32c0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fadcc002ee0 con 0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2919044333 0 0) 0x7faddc0018f0 con 0x7fadec0a62d0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fadcc003540 con 0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3285048529 0 0) 0x7fade80014b0 con 0x7fadec0a32c0 2020-01-26T15:32:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.308 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 >> 172.21.15.170:6791/0 conn(0x7fadec0a62d0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec07aaf0 con 0 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec0b2780 con 0 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec18b220 con 0 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fade8000bf0 con 0x7fadec0a32c0 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fade80018e0 con 0x7fadec0a32c0 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fade8001b20 con 0x7fadec0a32c0 2020-01-26T15:32:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.312 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7fade8005ce0 con 0x7fadec0a32c0 2020-01-26T15:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.316 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6805/11355 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadc8004d60 con 0 2020-01-26T15:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.316 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== osd.2 172.21.15.170:6805/11355 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7fade4000f70 con 0x7fadc8001600 2020-01-26T15:32:19.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.324 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 --> 172.21.15.170:6805/11355 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fadc80053f0 con 0 2020-01-26T15:32:19.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7faddb7fe700 1 -- 172.21.15.170:0/1777210627 <== osd.2 172.21.15.170:6805/11355 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7fadc8004d60 con 0x7fadc8001600 2020-01-26T15:32:19.330 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:19.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 >> 172.21.15.170:6805/11355 conn(0x7fadc8001600 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:32:19.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 >> 172.21.15.170:6800/11008 conn(0x7fadcc006ed0 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:32:19.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 >> 172.21.15.170:6789/0 conn(0x7fadec0a32c0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:32:19.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 shutdown_connections 2020-01-26T15:32:19.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 shutdown_connections 2020-01-26T15:32:19.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 wait complete. 2020-01-26T15:32:19.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.328 7fadf44ab700 1 -- 172.21.15.170:0/1777210627 >> 172.21.15.170:0/1777210627 conn(0x7fadec099540 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.344 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-26T15:32:19.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.436 7f8f5da01700 1 Processor -- start 2020-01-26T15:32:19.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.436 7f8f5da01700 1 -- - start start 2020-01-26T15:32:19.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.436 7f8f5da01700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5814bb30 con 0 2020-01-26T15:32:19.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.436 7f8f5da01700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5814bed0 con 0 2020-01-26T15:32:19.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.436 7f8f577fe700 1 -- 172.21.15.170:0/780702450 learned_addr learned my addr 172.21.15.170:0/780702450 2020-01-26T15:32:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8f480022a0 con 0x7f8f5814b3f0 2020-01-26T15:32:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8f500039b0 con 0x7f8f581480f0 2020-01-26T15:32:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1134806522 0 0) 0x7f8f48002620 con 0x7f8f5814b3f0 2020-01-26T15:32:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8f38002ea0 con 0 2020-01-26T15:32:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3467506651 0 0) 0x7f8f50003d30 con 0x7f8f581480f0 2020-01-26T15:32:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8f380046b0 con 0 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2217077294 0 0) 0x7f8f48002b10 con 0x7f8f5814b3f0 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 >> 172.21.15.170:6789/0 conn(0x7f8f581480f0 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5807a890 con 0 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8f58116ea0 con 0x7f8f5814b3f0 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f567fc700 1 -- 172.21.15.170:0/780702450 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8f48001010 con 0x7f8f5814b3f0 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/780702450 >> 172.21.15.170:6791/0 conn(0x7f8f5814b3f0 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/780702450 shutdown_connections 2020-01-26T15:32:19.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/780702450 shutdown_connections 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/780702450 wait complete. 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/780702450 >> 172.21.15.170:0/780702450 conn(0x7f8f58144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 Processor -- start 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- - start start 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580a3c10 con 0 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580a69e0 con 0 2020-01-26T15:32:19.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f577fe700 1 -- 172.21.15.170:0/4158864048 learned_addr learned my addr 172.21.15.170:0/4158864048 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8f50004360 con 0x7f8f580a3250 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1728990166 0 0) 0x7f8f50003850 con 0x7f8f580a3250 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8f3c002960 con 0 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8f48000e50 con 0x7f8f580a6230 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3332130147 0 0) 0x7f8f48002050 con 0x7f8f580a6230 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8f3c004620 con 0 2020-01-26T15:32:19.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2646584802 0 0) 0x7f8f500011d0 con 0x7f8f580a3250 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8f3c002ee0 con 0 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2461461099 0 0) 0x7f8f480023d0 con 0x7f8f580a6230 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8f3c003540 con 0 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (298590226 0 0) 0x7f8f50001740 con 0x7f8f580a3250 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 >> 172.21.15.170:6789/0 conn(0x7f8f580a6230 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5807aaf0 con 0 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580b25f0 con 0 2020-01-26T15:32:19.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.440 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5818b190 con 0 2020-01-26T15:32:19.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.444 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8f580ea010 con 0x7f8f580a3250 2020-01-26T15:32:19.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.444 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8f50001b70 con 0x7f8f580a3250 2020-01-26T15:32:19.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.444 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f8f50001db0 con 0x7f8f580a3250 2020-01-26T15:32:19.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.444 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f8f50006290 con 0x7f8f580a3250 2020-01-26T15:32:19.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.444 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6813/11358 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f30004d60 con 0 2020-01-26T15:32:19.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.444 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== osd.3 172.21.15.170:6813/11358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f8f40000bf0 con 0x7f8f30001600 2020-01-26T15:32:19.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 --> 172.21.15.170:6813/11358 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f300053e0 con 0 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f54ff9700 1 -- 172.21.15.170:0/4158864048 <== osd.3 172.21.15.170:6813/11358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f8f30004d60 con 0x7f8f30001600 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 >> 172.21.15.170:6813/11358 conn(0x7f8f30001600 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 >> 172.21.15.170:6800/11008 conn(0x7f8f3c006e70 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 >> 172.21.15.170:6791/0 conn(0x7f8f580a3250 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 shutdown_connections 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 shutdown_connections 2020-01-26T15:32:19.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 wait complete. 2020-01-26T15:32:19.459 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.452 7f8f5da01700 1 -- 172.21.15.170:0/4158864048 >> 172.21.15.170:0/4158864048 conn(0x7f8f58099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.459 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:19.466 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fbef05700 1 Processor -- start 2020-01-26T15:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fbef05700 1 -- - start start 2020-01-26T15:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fbef05700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb814bb30 con 0 2020-01-26T15:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fbef05700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb814bed0 con 0 2020-01-26T15:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fbcf2b700 1 -- 172.21.15.170:0/1008595820 learned_addr learned my addr 172.21.15.170:0/1008595820 2020-01-26T15:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0fa8003630 con 0x7f0fb81480f0 2020-01-26T15:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3270834890 0 0) 0x7f0fa80039b0 con 0x7f0fb81480f0 2020-01-26T15:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0fa4002a20 con 0 2020-01-26T15:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0fac0022a0 con 0x7f0fb814b3f0 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1312037798 0 0) 0x7f0fac0025a0 con 0x7f0fb814b3f0 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0fa40046c0 con 0 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3013852740 0 0) 0x7f0fa8003f80 con 0x7f0fb81480f0 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 >> 172.21.15.170:6789/0 conn(0x7f0fb814b3f0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb807a890 con 0 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0fb80ea010 con 0x7f0fb81480f0 2020-01-26T15:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fb77fe700 1 -- 172.21.15.170:0/1008595820 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0fa8001050 con 0x7f0fb81480f0 2020-01-26T15:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.556 7f0fbef05700 1 -- 172.21.15.170:0/1008595820 >> 172.21.15.170:6791/0 conn(0x7f0fb81480f0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- 172.21.15.170:0/1008595820 shutdown_connections 2020-01-26T15:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- 172.21.15.170:0/1008595820 shutdown_connections 2020-01-26T15:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- 172.21.15.170:0/1008595820 wait complete. 2020-01-26T15:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- 172.21.15.170:0/1008595820 >> 172.21.15.170:0/1008595820 conn(0x7f0fb8144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 Processor -- start 2020-01-26T15:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- - start start 2020-01-26T15:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb80a3b30 con 0 2020-01-26T15:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbef05700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb80a67a0 con 0 2020-01-26T15:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fbcf2b700 1 -- 172.21.15.170:0/4203031875 learned_addr learned my addr 172.21.15.170:0/4203031875 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0fa8000e50 con 0x7f0fb80a3140 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1875843601 0 0) 0x7f0fa8003380 con 0x7f0fb80a3140 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0f98002960 con 0 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0fac002ae0 con 0x7f0fb80a6150 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (873780883 0 0) 0x7f0fac0020e0 con 0x7f0fb80a6150 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.560 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0f98004620 con 0 2020-01-26T15:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3243047824 0 0) 0x7f0fa80037d0 con 0x7f0fb80a3140 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0f98002ee0 con 0 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3717242048 0 0) 0x7f0fac002350 con 0x7f0fb80a6150 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0f98003540 con 0 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2664513065 0 0) 0x7f0fa8001810 con 0x7f0fb80a3140 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 >> 172.21.15.170:6791/0 conn(0x7f0fb80a6150 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb807aaf0 con 0 2020-01-26T15:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb80b25b0 con 0 2020-01-26T15:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb818afb0 con 0 2020-01-26T15:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0fa8001360 con 0x7f0fb80a3140 2020-01-26T15:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0fa8001c40 con 0x7f0fb80a3140 2020-01-26T15:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f0fa8004990 con 0x7f0fb80a3140 2020-01-26T15:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.564 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f0fa8004e50 con 0x7f0fb80a3140 2020-01-26T15:32:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.572 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb807ae70 con 0 2020-01-26T15:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.576 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0fb807ae70 con 0x7f0fb80a3140 2020-01-26T15:32:19.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.668 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fb8073160 con 0 2020-01-26T15:32:19.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.668 7f0fb5ffb700 1 -- 172.21.15.170:0/4203031875 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (574334944 0 2374206864) 0x7f0fa8004470 con 0x7f0fb80a3140 2020-01-26T15:32:19.672 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:19.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.668 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 >> 172.21.15.170:6800/11008 conn(0x7f0f98006ed0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:32:19.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.668 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 >> 172.21.15.170:6790/0 conn(0x7f0fb80a3140 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:32:19.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.672 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 shutdown_connections 2020-01-26T15:32:19.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.672 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 shutdown_connections 2020-01-26T15:32:19.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.672 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 wait complete. 2020-01-26T15:32:19.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.672 7f0fbef05700 1 -- 172.21.15.170:0/4203031875 >> 172.21.15.170:0/4203031875 conn(0x7f0fb8099250 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2020-01-26T15:32:19.687 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:32:19.778 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f3752d99700 1 Processor -- start 2020-01-26T15:32:19.778 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f3752d99700 1 -- - start start 2020-01-26T15:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f3752d99700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c14bb30 con 0 2020-01-26T15:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f3752d99700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c14bed0 con 0 2020-01-26T15:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f3743fff700 1 -- 172.21.15.170:0/1390091788 learned_addr learned my addr 172.21.15.170:0/1390091788 2020-01-26T15:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f373c003630 con 0x7f374c14b3f0 2020-01-26T15:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3606771728 0 0) 0x7f373c0039b0 con 0x7f374c14b3f0 2020-01-26T15:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3738002a20 con 0 2020-01-26T15:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37480022a0 con 0x7f374c1480f0 2020-01-26T15:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2142997725 0 0) 0x7f37480025a0 con 0x7f374c1480f0 2020-01-26T15:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37380046c0 con 0 2020-01-26T15:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3663088487 0 0) 0x7f373c003f80 con 0x7f374c14b3f0 2020-01-26T15:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 >> 172.21.15.170:6789/0 conn(0x7f374c1480f0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c07a890 con 0 2020-01-26T15:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f374c116ea0 con 0x7f374c14b3f0 2020-01-26T15:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f37437fe700 1 -- 172.21.15.170:0/1390091788 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f373c001050 con 0x7f374c14b3f0 2020-01-26T15:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.776 7f3752d99700 1 -- 172.21.15.170:0/1390091788 >> 172.21.15.170:6791/0 conn(0x7f374c14b3f0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:32:19.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- 172.21.15.170:0/1390091788 shutdown_connections 2020-01-26T15:32:19.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- 172.21.15.170:0/1390091788 shutdown_connections 2020-01-26T15:32:19.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- 172.21.15.170:0/1390091788 wait complete. 2020-01-26T15:32:19.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- 172.21.15.170:0/1390091788 >> 172.21.15.170:0/1390091788 conn(0x7f374c144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 Processor -- start 2020-01-26T15:32:19.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- - start start 2020-01-26T15:32:19.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0a3c10 con 0 2020-01-26T15:32:19.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3752d99700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0a69e0 con 0 2020-01-26T15:32:19.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3743fff700 1 -- 172.21.15.170:0/3857646441 learned_addr learned my addr 172.21.15.170:0/3857646441 2020-01-26T15:32:19.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.780 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3748002ae0 con 0x7f374c0a3250 2020-01-26T15:32:19.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (19514902 0 0) 0x7f37480020b0 con 0x7f374c0a3250 2020-01-26T15:32:19.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f372c002960 con 0 2020-01-26T15:32:19.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f373c000e50 con 0x7f374c0a6230 2020-01-26T15:32:19.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3218429723 0 0) 0x7f373c001570 con 0x7f374c0a6230 2020-01-26T15:32:19.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f372c004620 con 0 2020-01-26T15:32:19.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3955797838 0 0) 0x7f37480025f0 con 0x7f374c0a3250 2020-01-26T15:32:19.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f372c002ee0 con 0 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3177580373 0 0) 0x7f373c0018f0 con 0x7f374c0a6230 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f372c003540 con 0 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3976582698 0 0) 0x7f37480010f0 con 0x7f374c0a3250 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 >> 172.21.15.170:6789/0 conn(0x7f374c0a6230 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c07aaf0 con 0 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3752d99700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c0b25f0 con 0 2020-01-26T15:32:19.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3752d99700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c18b190 con 0 2020-01-26T15:32:19.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f374c0ea010 con 0x7f374c0a3250 2020-01-26T15:32:19.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3748001560 con 0x7f374c0a3250 2020-01-26T15:32:19.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f3748002ed0 con 0x7f374c0a3250 2020-01-26T15:32:19.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.784 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f3748004be0 con 0x7f374c0a3250 2020-01-26T15:32:19.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.788 7f3752d99700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3728002070 con 0 2020-01-26T15:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.792 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f3748001a50 con 0x7f374c0a3250 2020-01-26T15:32:19.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3728001220 con 0 2020-01-26T15:32:19.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3741ffb700 1 -- 172.21.15.170:0/3857646441 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (832126871 0 2792639521) 0x7f3748003690 con 0x7f374c0a3250 2020-01-26T15:32:19.887 INFO:teuthology.orchestra.run.smithi170.stdout:38654705669 2020-01-26T15:32:19.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 >> 172.21.15.170:6800/11008 conn(0x7f372c006ed0 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:32:19.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 >> 172.21.15.170:6791/0 conn(0x7f374c0a3250 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:32:19.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 shutdown_connections 2020-01-26T15:32:19.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 shutdown_connections 2020-01-26T15:32:19.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 wait complete. 2020-01-26T15:32:19.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:19.884 7f3752d99700 1 -- 172.21.15.170:0/3857646441 >> 172.21.15.170:0/3857646441 conn(0x7f374c099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:19.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2020-01-26T15:32:20.899 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:32:21.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:20.996 7fea43888700 1 Processor -- start 2020-01-26T15:32:21.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:20.996 7fea43888700 1 -- - start start 2020-01-26T15:32:21.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c14bb30 con 0 2020-01-26T15:32:21.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c14bed0 con 0 2020-01-26T15:32:21.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea418ae700 1 -- 172.21.15.170:0/696216728 learned_addr learned my addr 172.21.15.170:0/696216728 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fea340039b0 con 0x7fea3c1480f0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1562246890 0 0) 0x7fea34003d30 con 0x7fea3c1480f0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea28002a20 con 0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fea300022a0 con 0x7fea3c14b3f0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3289651091 0 0) 0x7fea30002620 con 0x7fea3c14b3f0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea280046c0 con 0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1823610375 0 0) 0x7fea34004300 con 0x7fea3c1480f0 2020-01-26T15:32:21.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 >> 172.21.15.170:6791/0 conn(0x7fea3c14b3f0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c07a890 con 0 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fea3c0ea010 con 0x7fea3c1480f0 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea408ac700 1 -- 172.21.15.170:0/696216728 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fea340013d0 con 0x7fea3c1480f0 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- 172.21.15.170:0/696216728 >> 172.21.15.170:6790/0 conn(0x7fea3c1480f0 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- 172.21.15.170:0/696216728 shutdown_connections 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- 172.21.15.170:0/696216728 shutdown_connections 2020-01-26T15:32:21.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- 172.21.15.170:0/696216728 wait complete. 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.000 7fea43888700 1 -- 172.21.15.170:0/696216728 >> 172.21.15.170:0/696216728 conn(0x7fea3c144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea43888700 1 Processor -- start 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea43888700 1 -- - start start 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea43888700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0a3c30 con 0 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea43888700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0a68a0 con 0 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea418ae700 1 -- 172.21.15.170:0/1217196239 learned_addr learned my addr 172.21.15.170:0/1217196239 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fea340011d0 con 0x7fea3c0a3240 2020-01-26T15:32:21.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3774381625 0 0) 0x7fea340018f0 con 0x7fea3c0a3240 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea3affd700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea1c002960 con 0 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fea30002b60 con 0x7fea3c0a6250 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1950800321 0 0) 0x7fea300020e0 con 0x7fea3c0a6250 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.004 7fea3affd700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fea1c004620 con 0 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4220368652 0 0) 0x7fea34001d40 con 0x7fea3c0a3240 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea1c002ee0 con 0 2020-01-26T15:32:21.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2284304995 0 0) 0x7fea30002470 con 0x7fea3c0a6250 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea1c003540 con 0 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1466621196 0 0) 0x7fea340039a0 con 0x7fea3c0a3240 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 >> 172.21.15.170:6791/0 conn(0x7fea3c0a6250 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c07aaf0 con 0 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea43888700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c0b25f0 con 0 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea43888700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c18b0b0 con 0 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fea34000f70 con 0x7fea3c0a3240 2020-01-26T15:32:21.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fea34003dd0 con 0x7fea3c0a3240 2020-01-26T15:32:21.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fea34004b00 con 0x7fea3c0a3240 2020-01-26T15:32:21.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.008 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7fea34006480 con 0x7fea3c0a3240 2020-01-26T15:32:21.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.012 7fea43888700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c07ae70 con 0 2020-01-26T15:32:21.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.016 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fea3c07ae70 con 0x7fea3c0a3240 2020-01-26T15:32:21.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.108 7fea43888700 1 -- 172.21.15.170:0/1217196239 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea3c073160 con 0 2020-01-26T15:32:21.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.108 7fea3affd700 1 -- 172.21.15.170:0/1217196239 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (832126871 0 2792639521) 0x7fea340045e0 con 0x7fea3c0a3240 2020-01-26T15:32:21.114 INFO:teuthology.orchestra.run.smithi170.stdout:38654705669 2020-01-26T15:32:21.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.112 7fea43888700 1 -- 172.21.15.170:0/1217196239 >> 172.21.15.170:6800/11008 conn(0x7fea1c006ed0 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:32:21.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.112 7fea43888700 1 -- 172.21.15.170:0/1217196239 >> 172.21.15.170:6790/0 conn(0x7fea3c0a3240 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:32:21.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.112 7fea43888700 1 -- 172.21.15.170:0/1217196239 shutdown_connections 2020-01-26T15:32:21.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.112 7fea43888700 1 -- 172.21.15.170:0/1217196239 shutdown_connections 2020-01-26T15:32:21.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.112 7fea43888700 1 -- 172.21.15.170:0/1217196239 wait complete. 2020-01-26T15:32:21.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:21.112 7fea43888700 1 -- 172.21.15.170:0/1217196239 >> 172.21.15.170:0/1217196239 conn(0x7fea3c099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:21.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2020-01-26T15:32:22.125 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:32:22.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa9a0e3a700 1 Processor -- start 2020-01-26T15:32:22.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa9a0e3a700 1 -- - start start 2020-01-26T15:32:22.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa9a0e3a700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c14bb30 con 0 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa9a0e3a700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c14bed0 con 0 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa99a570700 1 -- 172.21.15.170:0/1518398021 learned_addr learned my addr 172.21.15.170:0/1518398021 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa994002620 con 0x7fa99c1480f0 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa984003630 con 0x7fa99c14b3f0 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2333492257 0 0) 0x7fa9940029a0 con 0x7fa99c1480f0 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa97c002ea0 con 0 2020-01-26T15:32:22.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1857095158 0 0) 0x7fa9840039b0 con 0x7fa99c14b3f0 2020-01-26T15:32:22.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa97c0046b0 con 0 2020-01-26T15:32:22.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4105671090 0 0) 0x7fa994002e90 con 0x7fa99c1480f0 2020-01-26T15:32:22.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 >> 172.21.15.170:6789/0 conn(0x7fa99c14b3f0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:32:22.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c07a890 con 0 2020-01-26T15:32:22.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa99c0ea010 con 0x7fa99c1480f0 2020-01-26T15:32:22.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa999d6f700 1 -- 172.21.15.170:0/1518398021 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa994001390 con 0x7fa99c1480f0 2020-01-26T15:32:22.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.220 7fa9a0e3a700 1 -- 172.21.15.170:0/1518398021 >> 172.21.15.170:6791/0 conn(0x7fa99c1480f0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:32:22.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- 172.21.15.170:0/1518398021 shutdown_connections 2020-01-26T15:32:22.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- 172.21.15.170:0/1518398021 shutdown_connections 2020-01-26T15:32:22.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- 172.21.15.170:0/1518398021 wait complete. 2020-01-26T15:32:22.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- 172.21.15.170:0/1518398021 >> 172.21.15.170:0/1518398021 conn(0x7fa99c144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 Processor -- start 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- - start start 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0a3d00 con 0 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c095d70 con 0 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa99ad71700 1 -- 172.21.15.170:0/2935170308 learned_addr learned my addr 172.21.15.170:0/2935170308 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa994001390 con 0x7fa99c0a3310 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (288271494 0 0) 0x7fa9940023d0 con 0x7fa99c0a3310 2020-01-26T15:32:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa980002960 con 0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa984003470 con 0x7fa99c0a50c0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1366944825 0 0) 0x7fa984003d30 con 0x7fa99c0a50c0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa980004620 con 0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (304225740 0 0) 0x7fa994002950 con 0x7fa99c0a3310 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa980002ee0 con 0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3183005057 0 0) 0x7fa984003fa0 con 0x7fa99c0a50c0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa980003540 con 0 2020-01-26T15:32:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (453843003 0 0) 0x7fa994001d00 con 0x7fa99c0a3310 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 >> 172.21.15.170:6791/0 conn(0x7fa99c0a50c0 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa993fff700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c07aaf0 con 0 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.224 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c0b27e0 con 0 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.228 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c0a6b00 con 0 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.228 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa994000f70 con 0x7fa99c0a3310 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.228 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa994003250 con 0x7fa99c0a3310 2020-01-26T15:32:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.228 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fa9940039b0 con 0x7fa99c0a3310 2020-01-26T15:32:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.228 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7fa9940066f0 con 0x7fa99c0a3310 2020-01-26T15:32:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.236 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa974002070 con 0 2020-01-26T15:32:22.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.240 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa994003490 con 0x7fa99c0a3310 2020-01-26T15:32:22.338 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa974001220 con 0 2020-01-26T15:32:22.338 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa993fff700 1 -- 172.21.15.170:0/2935170308 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (832126871 0 2374206864) 0x7fa994006370 con 0x7fa99c0a3310 2020-01-26T15:32:22.339 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:22.340 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 >> 172.21.15.170:6800/11008 conn(0x7fa9800064e0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:32:22.340 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 >> 172.21.15.170:6789/0 conn(0x7fa99c0a3310 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:32:22.340 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 shutdown_connections 2020-01-26T15:32:22.341 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 shutdown_connections 2020-01-26T15:32:22.341 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 wait complete. 2020-01-26T15:32:22.341 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.336 7fa9a0e3a700 1 -- 172.21.15.170:0/2935170308 >> 172.21.15.170:0/2935170308 conn(0x7fa99c0995f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2020-01-26T15:32:22.350 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-26T15:32:22.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 Processor -- start 2020-01-26T15:32:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- - start start 2020-01-26T15:32:22.436 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65414bb30 con 0 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65414bed0 con 0 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65a3c8700 1 -- 172.21.15.170:0/1966875027 learned_addr learned my addr 172.21.15.170:0/1966875027 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6440022a0 con 0x7ff65414b3f0 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (610209201 0 0) 0x7ff644002620 con 0x7ff65414b3f0 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff63c002a20 con 0 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff650003630 con 0x7ff6541480f0 2020-01-26T15:32:22.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1488748385 0 0) 0x7ff650003930 con 0x7ff6541480f0 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff63c0046c0 con 0 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3369714174 0 0) 0x7ff644002bf0 con 0x7ff65414b3f0 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 >> 172.21.15.170:6790/0 conn(0x7ff6541480f0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65407a890 con 0 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff654116ea0 con 0x7ff65414b3f0 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff6593c6700 1 -- 172.21.15.170:0/1966875027 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff644001050 con 0x7ff65414b3f0 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- 172.21.15.170:0/1966875027 >> 172.21.15.170:6791/0 conn(0x7ff65414b3f0 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:32:22.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- 172.21.15.170:0/1966875027 shutdown_connections 2020-01-26T15:32:22.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- 172.21.15.170:0/1966875027 shutdown_connections 2020-01-26T15:32:22.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- 172.21.15.170:0/1966875027 wait complete. 2020-01-26T15:32:22.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.432 7ff65c3a2700 1 -- 172.21.15.170:0/1966875027 >> 172.21.15.170:0/1966875027 conn(0x7ff654144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65c3a2700 1 Processor -- start 2020-01-26T15:32:22.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65c3a2700 1 -- - start start 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65c3a2700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6540a3d60 con 0 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65c3a2700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff654095d90 con 0 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65a3c8700 1 -- 172.21.15.170:0/3588081160 learned_addr learned my addr 172.21.15.170:0/3588081160 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff644000e50 con 0x7ff6540a5120 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1366426819 0 0) 0x7ff644001ff0 con 0x7ff6540a5120 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff634002960 con 0 2020-01-26T15:32:22.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff650003f60 con 0x7ff6540a3370 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2799179766 0 0) 0x7ff650003470 con 0x7ff6540a3370 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff634004620 con 0 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2166728652 0 0) 0x7ff644002440 con 0x7ff6540a5120 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff634002ee0 con 0 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2075478327 0 0) 0x7ff650003830 con 0x7ff6540a3370 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff634003540 con 0 2020-01-26T15:32:22.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1863693405 0 0) 0x7ff644001810 con 0x7ff6540a5120 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 >> 172.21.15.170:6789/0 conn(0x7ff6540a3370 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65407aaf0 con 0 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6540711a0 con 0 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff644000bf0 con 0x7ff6540a5120 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff644001c40 con 0x7ff6540a5120 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6540a6b40 con 0 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7ff644003600 con 0x7ff6540a5120 2020-01-26T15:32:22.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.436 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7ff6440030e0 con 0x7ff6540a5120 2020-01-26T15:32:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.440 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65407ae70 con 0 2020-01-26T15:32:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.440 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff65407ae70 con 0x7ff6540a5120 2020-01-26T15:32:22.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.524 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff6540ba2f0 con 0 2020-01-26T15:32:22.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.524 7ff6437fe700 1 -- 172.21.15.170:0/3588081160 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (92182286 0 2374206864) 0x7ff6440039d0 con 0x7ff6540a5120 2020-01-26T15:32:22.528 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:22.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.528 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 >> 172.21.15.170:6800/11008 conn(0x7ff634006e70 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:32:22.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.528 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 >> 172.21.15.170:6790/0 conn(0x7ff6540a5120 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:32:22.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.528 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 shutdown_connections 2020-01-26T15:32:22.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.528 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 shutdown_connections 2020-01-26T15:32:22.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.528 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 wait complete. 2020-01-26T15:32:22.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.528 7ff65c3a2700 1 -- 172.21.15.170:0/3588081160 >> 172.21.15.170:0/3588081160 conn(0x7ff654099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2020-01-26T15:32:22.539 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-26T15:32:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 Processor -- start 2020-01-26T15:32:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- - start start 2020-01-26T15:32:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd014bb30 con 0 2020-01-26T15:32:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd014bed0 con 0 2020-01-26T15:32:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cced71700 1 -- 172.21.15.170:0/8190746 learned_addr learned my addr 172.21.15.170:0/8190746 2020-01-26T15:32:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8cc00022a0 con 0x7f8cd01480f0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1019233351 0 0) 0x7f8cc0002620 con 0x7f8cd01480f0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8cbc002a20 con 0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8cc40035d0 con 0x7f8cd014b3f0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4095340201 0 0) 0x7f8cc40038d0 con 0x7f8cd014b3f0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8cbc0046c0 con 0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2701007716 0 0) 0x7f8cc0002bf0 con 0x7f8cd01480f0 2020-01-26T15:32:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 >> 172.21.15.170:6791/0 conn(0x7f8cd014b3f0 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd007a890 con 0 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8cd00ea010 con 0x7f8cd01480f0 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cce570700 1 -- 172.21.15.170:0/8190746 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8cc0001050 con 0x7f8cd01480f0 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- 172.21.15.170:0/8190746 >> 172.21.15.170:6789/0 conn(0x7f8cd01480f0 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- 172.21.15.170:0/8190746 shutdown_connections 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- 172.21.15.170:0/8190746 shutdown_connections 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- 172.21.15.170:0/8190746 wait complete. 2020-01-26T15:32:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.624 7f8cd5764700 1 -- 172.21.15.170:0/8190746 >> 172.21.15.170:0/8190746 conn(0x7f8cd0144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cd5764700 1 Processor -- start 2020-01-26T15:32:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cd5764700 1 -- - start start 2020-01-26T15:32:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cd5764700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00a3c50 con 0 2020-01-26T15:32:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cd5764700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00a6a20 con 0 2020-01-26T15:32:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8ccf572700 1 -- 172.21.15.170:0/3777718020 learned_addr learned my addr 172.21.15.170:0/3777718020 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8cc0001010 con 0x7f8cd00a3260 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8cc4003e10 con 0x7f8cd00a6270 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1358261362 0 0) 0x7f8cc0001ff0 con 0x7f8cd00a3260 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8cb0002df0 con 0 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1821877775 0 0) 0x7f8cc4003410 con 0x7f8cd00a6270 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8cb0004610 con 0 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3092878445 0 0) 0x7f8cc0002490 con 0x7f8cd00a3260 2020-01-26T15:32:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8cb0004dd0 con 0 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1606409779 0 0) 0x7f8cc40037a0 con 0x7f8cd00a6270 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8cb0006650 con 0 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (760526894 0 0) 0x7f8cc0001810 con 0x7f8cd00a3260 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 >> 172.21.15.170:6789/0 conn(0x7f8cd00a6270 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd007aaf0 con 0 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd00b25f0 con 0 2020-01-26T15:32:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd018b1c0 con 0 2020-01-26T15:32:22.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8cc0000bf0 con 0x7f8cd00a3260 2020-01-26T15:32:22.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8cc0001a80 con 0x7f8cd00a3260 2020-01-26T15:32:22.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f8cc00033c0 con 0x7f8cd00a3260 2020-01-26T15:32:22.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.628 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f8cc0005f30 con 0x7f8cd00a3260 2020-01-26T15:32:22.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.636 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac002070 con 0 2020-01-26T15:32:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.644 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8cc0002ea0 con 0x7f8cd00a3260 2020-01-26T15:32:22.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.732 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8cac001220 con 0 2020-01-26T15:32:22.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.732 7f8cccd6d700 1 -- 172.21.15.170:0/3777718020 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (383520633 0 2374206864) 0x7f8cc00061d0 con 0x7f8cd00a3260 2020-01-26T15:32:22.737 INFO:teuthology.orchestra.run.smithi170.stdout:38654705670 2020-01-26T15:32:22.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.736 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 >> 172.21.15.170:6800/11008 conn(0x7f8cb00072a0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:32:22.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.736 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 >> 172.21.15.170:6791/0 conn(0x7f8cd00a3260 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:32:22.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.736 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 shutdown_connections 2020-01-26T15:32:22.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.736 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 shutdown_connections 2020-01-26T15:32:22.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.736 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 wait complete. 2020-01-26T15:32:22.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.736 7f8cd5764700 1 -- 172.21.15.170:0/3777718020 >> 172.21.15.170:0/3777718020 conn(0x7f8cd0099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2020-01-26T15:32:22.748 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-26T15:32:22.748 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:32:22.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 Processor -- start 2020-01-26T15:32:22.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- - start start 2020-01-26T15:32:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429814bb10 con 0 2020-01-26T15:32:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429814beb0 con 0 2020-01-26T15:32:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429cbac700 1 -- 172.21.15.170:0/2262422901 learned_addr learned my addr 172.21.15.170:0/2262422901 2020-01-26T15:32:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f42800022a0 con 0x7f429814b3d0 2020-01-26T15:32:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (698466955 0 0) 0x7f4280002620 con 0x7f429814b3d0 2020-01-26T15:32:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4278002a20 con 0 2020-01-26T15:32:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f42880039b0 con 0x7f42981480d0 2020-01-26T15:32:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1937326374 0 0) 0x7f4288003d30 con 0x7f42981480d0 2020-01-26T15:32:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f42780046c0 con 0 2020-01-26T15:32:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (788034959 0 0) 0x7f42880041e0 con 0x7f42981480d0 2020-01-26T15:32:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 >> 172.21.15.170:6790/0 conn(0x7f429814b3d0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:32:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429807a930 con 0 2020-01-26T15:32:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f42980e9ff0 con 0x7f42981480d0 2020-01-26T15:32:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f42977fe700 1 -- 172.21.15.170:0/2262422901 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4288001390 con 0x7f42981480d0 2020-01-26T15:32:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- 172.21.15.170:0/2262422901 >> 172.21.15.170:6791/0 conn(0x7f42981480d0 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:32:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- 172.21.15.170:0/2262422901 shutdown_connections 2020-01-26T15:32:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- 172.21.15.170:0/2262422901 shutdown_connections 2020-01-26T15:32:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- 172.21.15.170:0/2262422901 wait complete. 2020-01-26T15:32:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.840 7f429eb86700 1 -- 172.21.15.170:0/2262422901 >> 172.21.15.170:0/2262422901 conn(0x7f4298144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f429eb86700 1 Processor -- start 2020-01-26T15:32:22.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f429eb86700 1 -- - start start 2020-01-26T15:32:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f429eb86700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980a3dd0 con 0 2020-01-26T15:32:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f429eb86700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980a6b10 con 0 2020-01-26T15:32:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f429cbac700 1 -- 172.21.15.170:0/3307803680 learned_addr learned my addr 172.21.15.170:0/3307803680 2020-01-26T15:32:22.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f42800020b0 con 0x7f42980a6360 2020-01-26T15:32:22.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4288003c50 con 0x7f42980a33e0 2020-01-26T15:32:22.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1649339747 0 0) 0x7f4280002370 con 0x7f42980a6360 2020-01-26T15:32:22.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f427c002df0 con 0 2020-01-26T15:32:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (960307463 0 0) 0x7f42880011d0 con 0x7f42980a33e0 2020-01-26T15:32:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f427c004620 con 0 2020-01-26T15:32:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3729496154 0 0) 0x7f4280000e50 con 0x7f42980a6360 2020-01-26T15:32:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f427c004df0 con 0 2020-01-26T15:32:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2006040600 0 0) 0x7f4288003790 con 0x7f42980a33e0 2020-01-26T15:32:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.844 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f427c006570 con 0 2020-01-26T15:32:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1846711049 0 0) 0x7f4280001360 con 0x7f42980a6360 2020-01-26T15:32:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 >> 172.21.15.170:6790/0 conn(0x7f42980a33e0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:32:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429807ab90 con 0 2020-01-26T15:32:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f429eb86700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980b2780 con 0 2020-01-26T15:32:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f429eb86700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f429818b1e0 con 0 2020-01-26T15:32:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4298116e80 con 0x7f42980a6360 2020-01-26T15:32:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4280001790 con 0x7f42980a6360 2020-01-26T15:32:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f42800019d0 con 0x7f42980a6360 2020-01-26T15:32:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.848 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f4280004980 con 0x7f42980a6360 2020-01-26T15:32:22.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.852 7f429eb86700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429807af30 con 0 2020-01-26T15:32:22.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.860 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f429807af30 con 0x7f42980a6360 2020-01-26T15:32:22.952 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.948 7f429eb86700 1 -- 172.21.15.170:0/3307803680 --> 172.21.15.170:6800/11008 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f4298148860 con 0 2020-01-26T15:32:22.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.952 7f4295ffb700 1 -- 172.21.15.170:0/3307803680 <== mgr.4111 172.21.15.170:6800/11008 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+60003 (2965378022 0 2222196521) 0x7f4288000f70 con 0x7f427c0072a0 2020-01-26T15:32:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2020-01-26T15:32:22.961 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.960 7f429eb86700 1 -- 172.21.15.170:0/3307803680 >> 172.21.15.170:6800/11008 conn(0x7f427c0072a0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:32:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.960 7f429eb86700 1 -- 172.21.15.170:0/3307803680 >> 172.21.15.170:6791/0 conn(0x7f42980a6360 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:32:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.960 7f429eb86700 1 -- 172.21.15.170:0/3307803680 shutdown_connections 2020-01-26T15:32:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.960 7f429eb86700 1 -- 172.21.15.170:0/3307803680 shutdown_connections 2020-01-26T15:32:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.960 7f429eb86700 1 -- 172.21.15.170:0/3307803680 wait complete. 2020-01-26T15:32:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:22.960 7f429eb86700 1 -- 172.21.15.170:0/3307803680 >> 172.21.15.170:0/3307803680 conn(0x7f4298099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:22.975 INFO:teuthology.orchestra.run.smithi170.stdout:{"version":24,"stamp":"2020-01-26 15:32:21.112297","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3516,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":64,"ondisk_log_size":64,"up":48,"acting":48},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"kb":377487360,"kb_used":4196736,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290624,"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5.000000,"apply_latency_ms":5.000000,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.089157","last_change":"2020-01-26 15:32:15.388125","last_active":"2020-01-26 15:32:17.089157","last_peered":"2020-01-26 15:32:17.089157","last_clean":"2020-01-26 15:32:17.089157","last_became_active":"2020-01-26 15:32:15.387793","last_became_peered":"2020-01-26 15:32:15.387793","last_unstale":"2020-01-26 15:32:17.089157","last_undegraded":"2020-01-26 15:32:17.089157","last_fullsized":"2020-01-26 15:32:17.089157","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.385754","last_change":"2020-01-26 15:32:13.141863","last_active":"2020-01-26 15:32:16.385754","last_peered":"2020-01-26 15:32:16.385754","last_clean":"2020-01-26 15:32:16.385754","last_became_active":"2020-01-26 15:32:13.141432","last_became_peered":"2020-01-26 15:32:13.141432","last_unstale":"2020-01-26 15:32:16.385754","last_undegraded":"2020-01-26 15:32:16.385754","last_fullsized":"2020-01-26 15:32:16.385754","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'3","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:18.415352","last_change":"2020-01-26 15:32:15.160060","last_active":"2020-01-26 15:32:18.415352","last_peered":"2020-01-26 15:32:18.415352","last_clean":"2020-01-26 15:32:18.415352","last_became_active":"2020-01-26 15:32:15.159093","last_became_peered":"2020-01-26 15:32:15.159093","last_unstale":"2020-01-26 15:32:18.415352","last_undegraded":"2020-01-26 15:32:18.415352","last_fullsized":"2020-01-26 15:32:18.415352","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.396022","last_change":"2020-01-26 15:32:16.391402","last_active":"2020-01-26 15:32:16.396022","last_peered":"2020-01-26 15:32:16.396022","last_clean":"2020-01-26 15:32:16.396022","last_became_active":"2020-01-26 15:32:16.390999","last_became_peered":"2020-01-26 15:32:16.390999","last_unstale":"2020-01-26 15:32:16.396022","last_undegraded":"2020-01-26 15:32:16.396022","last_fullsized":"2020-01-26 15:32:16.396022","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.088990","last_change":"2020-01-26 15:32:13.147209","last_active":"2020-01-26 15:32:17.088990","last_peered":"2020-01-26 15:32:17.088990","last_clean":"2020-01-26 15:32:17.088990","last_became_active":"2020-01-26 15:32:13.146844","last_became_peered":"2020-01-26 15:32:13.146844","last_unstale":"2020-01-26 15:32:17.088990","last_undegraded":"2020-01-26 15:32:17.088990","last_fullsized":"2020-01-26 15:32:17.088990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"16'12","reported_seq":"23","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.423964","last_change":"2020-01-26 15:32:15.160486","last_active":"2020-01-26 15:32:19.423964","last_peered":"2020-01-26 15:32:19.423964","last_clean":"2020-01-26 15:32:19.423964","last_became_active":"2020-01-26 15:32:15.160031","last_became_peered":"2020-01-26 15:32:15.160031","last_unstale":"2020-01-26 15:32:19.423964","last_undegraded":"2020-01-26 15:32:19.423964","last_fullsized":"2020-01-26 15:32:19.423964","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":656,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.393527","last_change":"2020-01-26 15:32:16.389450","last_active":"2020-01-26 15:32:16.393527","last_peered":"2020-01-26 15:32:16.393527","last_clean":"2020-01-26 15:32:16.393527","last_became_active":"2020-01-26 15:32:16.389078","last_became_peered":"2020-01-26 15:32:16.389078","last_unstale":"2020-01-26 15:32:16.393527","last_undegraded":"2020-01-26 15:32:16.393527","last_fullsized":"2020-01-26 15:32:16.393527","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386255","last_change":"2020-01-26 15:32:13.141343","last_active":"2020-01-26 15:32:16.386255","last_peered":"2020-01-26 15:32:16.386255","last_clean":"2020-01-26 15:32:16.386255","last_became_active":"2020-01-26 15:32:13.140946","last_became_peered":"2020-01-26 15:32:13.140946","last_unstale":"2020-01-26 15:32:16.386255","last_undegraded":"2020-01-26 15:32:16.386255","last_fullsized":"2020-01-26 15:32:16.386255","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'14","reported_seq":"25","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.430772","last_change":"2020-01-26 15:32:15.158464","last_active":"2020-01-26 15:32:19.430772","last_peered":"2020-01-26 15:32:19.430772","last_clean":"2020-01-26 15:32:19.430772","last_became_active":"2020-01-26 15:32:15.158051","last_became_peered":"2020-01-26 15:32:15.158051","last_unstale":"2020-01-26 15:32:19.430772","last_undegraded":"2020-01-26 15:32:19.430772","last_fullsized":"2020-01-26 15:32:19.430772","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386144","last_change":"2020-01-26 15:32:15.387895","last_active":"2020-01-26 15:32:16.386144","last_peered":"2020-01-26 15:32:16.386144","last_clean":"2020-01-26 15:32:16.386144","last_became_active":"2020-01-26 15:32:15.387508","last_became_peered":"2020-01-26 15:32:15.387508","last_unstale":"2020-01-26 15:32:16.386144","last_undegraded":"2020-01-26 15:32:16.386144","last_fullsized":"2020-01-26 15:32:16.386144","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.387057","last_change":"2020-01-26 15:32:13.146813","last_active":"2020-01-26 15:32:16.387057","last_peered":"2020-01-26 15:32:16.387057","last_clean":"2020-01-26 15:32:16.387057","last_became_active":"2020-01-26 15:32:13.146287","last_became_peered":"2020-01-26 15:32:13.146287","last_unstale":"2020-01-26 15:32:16.387057","last_undegraded":"2020-01-26 15:32:16.387057","last_fullsized":"2020-01-26 15:32:16.387057","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.385557","last_change":"2020-01-26 15:32:15.156510","last_active":"2020-01-26 15:32:16.385557","last_peered":"2020-01-26 15:32:16.385557","last_clean":"2020-01-26 15:32:16.385557","last_became_active":"2020-01-26 15:32:15.156120","last_became_peered":"2020-01-26 15:32:15.156120","last_unstale":"2020-01-26 15:32:16.385557","last_undegraded":"2020-01-26 15:32:16.385557","last_fullsized":"2020-01-26 15:32:16.385557","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.089040","last_change":"2020-01-26 15:32:15.387494","last_active":"2020-01-26 15:32:17.089040","last_peered":"2020-01-26 15:32:17.089040","last_clean":"2020-01-26 15:32:17.089040","last_became_active":"2020-01-26 15:32:15.387118","last_became_peered":"2020-01-26 15:32:15.387118","last_unstale":"2020-01-26 15:32:17.089040","last_undegraded":"2020-01-26 15:32:17.089040","last_fullsized":"2020-01-26 15:32:17.089040","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386138","last_change":"2020-01-26 15:32:13.142443","last_active":"2020-01-26 15:32:16.386138","last_peered":"2020-01-26 15:32:16.386138","last_clean":"2020-01-26 15:32:16.386138","last_became_active":"2020-01-26 15:32:13.141994","last_became_peered":"2020-01-26 15:32:13.141994","last_unstale":"2020-01-26 15:32:16.386138","last_undegraded":"2020-01-26 15:32:16.386138","last_fullsized":"2020-01-26 15:32:16.386138","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'15","reported_seq":"26","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.430472","last_change":"2020-01-26 15:32:15.157741","last_active":"2020-01-26 15:32:19.430472","last_peered":"2020-01-26 15:32:19.430472","last_clean":"2020-01-26 15:32:19.430472","last_became_active":"2020-01-26 15:32:15.157363","last_became_peered":"2020-01-26 15:32:15.157363","last_unstale":"2020-01-26 15:32:19.430472","last_undegraded":"2020-01-26 15:32:19.430472","last_fullsized":"2020-01-26 15:32:19.430472","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.393510","last_change":"2020-01-26 15:32:16.389403","last_active":"2020-01-26 15:32:16.393510","last_peered":"2020-01-26 15:32:16.393510","last_clean":"2020-01-26 15:32:16.393510","last_became_active":"2020-01-26 15:32:16.389018","last_became_peered":"2020-01-26 15:32:16.389018","last_unstale":"2020-01-26 15:32:16.393510","last_undegraded":"2020-01-26 15:32:16.393510","last_fullsized":"2020-01-26 15:32:16.393510","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.088960","last_change":"2020-01-26 15:32:13.147557","last_active":"2020-01-26 15:32:17.088960","last_peered":"2020-01-26 15:32:17.088960","last_clean":"2020-01-26 15:32:17.088960","last_became_active":"2020-01-26 15:32:13.147173","last_became_peered":"2020-01-26 15:32:13.147173","last_unstale":"2020-01-26 15:32:17.088960","last_undegraded":"2020-01-26 15:32:17.088960","last_fullsized":"2020-01-26 15:32:17.088960","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'4","reported_seq":"15","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.430715","last_change":"2020-01-26 15:32:15.158957","last_active":"2020-01-26 15:32:19.430715","last_peered":"2020-01-26 15:32:19.430715","last_clean":"2020-01-26 15:32:19.430715","last_became_active":"2020-01-26 15:32:15.158522","last_became_peered":"2020-01-26 15:32:15.158522","last_unstale":"2020-01-26 15:32:19.430715","last_undegraded":"2020-01-26 15:32:19.430715","last_fullsized":"2020-01-26 15:32:19.430715","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386248","last_change":"2020-01-26 15:32:15.388882","last_active":"2020-01-26 15:32:16.386248","last_peered":"2020-01-26 15:32:16.386248","last_clean":"2020-01-26 15:32:16.386248","last_became_active":"2020-01-26 15:32:15.388539","last_became_peered":"2020-01-26 15:32:15.388539","last_unstale":"2020-01-26 15:32:16.386248","last_undegraded":"2020-01-26 15:32:16.386248","last_fullsized":"2020-01-26 15:32:16.386248","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.089289","last_change":"2020-01-26 15:32:13.147923","last_active":"2020-01-26 15:32:17.089289","last_peered":"2020-01-26 15:32:17.089289","last_clean":"2020-01-26 15:32:17.089289","last_became_active":"2020-01-26 15:32:13.147051","last_became_peered":"2020-01-26 15:32:13.147051","last_unstale":"2020-01-26 15:32:17.089289","last_undegraded":"2020-01-26 15:32:17.089289","last_fullsized":"2020-01-26 15:32:17.089289","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.424054","last_change":"2020-01-26 15:32:15.159142","last_active":"2020-01-26 15:32:19.424054","last_peered":"2020-01-26 15:32:19.424054","last_clean":"2020-01-26 15:32:19.424054","last_became_active":"2020-01-26 15:32:15.158804","last_became_peered":"2020-01-26 15:32:15.158804","last_unstale":"2020-01-26 15:32:19.424054","last_undegraded":"2020-01-26 15:32:19.424054","last_fullsized":"2020-01-26 15:32:19.424054","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.385641","last_change":"2020-01-26 15:32:15.388612","last_active":"2020-01-26 15:32:16.385641","last_peered":"2020-01-26 15:32:16.385641","last_clean":"2020-01-26 15:32:16.385641","last_became_active":"2020-01-26 15:32:15.388267","last_became_peered":"2020-01-26 15:32:15.388267","last_unstale":"2020-01-26 15:32:16.385641","last_undegraded":"2020-01-26 15:32:16.385641","last_fullsized":"2020-01-26 15:32:16.385641","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386535","last_change":"2020-01-26 15:32:13.142563","last_active":"2020-01-26 15:32:16.386535","last_peered":"2020-01-26 15:32:16.386535","last_clean":"2020-01-26 15:32:16.386535","last_became_active":"2020-01-26 15:32:13.142168","last_became_peered":"2020-01-26 15:32:13.142168","last_unstale":"2020-01-26 15:32:16.386535","last_undegraded":"2020-01-26 15:32:16.386535","last_fullsized":"2020-01-26 15:32:16.386535","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,3],"acting":[1,3],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:18.415759","last_change":"2020-01-26 15:32:15.159708","last_active":"2020-01-26 15:32:18.415759","last_peered":"2020-01-26 15:32:18.415759","last_clean":"2020-01-26 15:32:18.415759","last_became_active":"2020-01-26 15:32:15.159343","last_became_peered":"2020-01-26 15:32:15.159343","last_unstale":"2020-01-26 15:32:18.415759","last_undegraded":"2020-01-26 15:32:18.415759","last_fullsized":"2020-01-26 15:32:18.415759","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":3516,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":64,"ondisk_log_size":64,"up":16,"acting":16}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":14,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2.000000,"apply_latency_ms":2.000000,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.332}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.658}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.580}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":10,"kb":94371840,"kb_used":1049136,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322704,"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.689}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.508}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.604}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":12,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1.000000,"apply_latency_ms":1.000000,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.345}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.588}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.620}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":12,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2.000000,"apply_latency_ms":2.000000,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.579}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.552}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.405}]}]}]} 2020-01-26T15:32:22.981 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:32:23.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.072 7f2d132d6700 1 Processor -- start 2020-01-26T15:32:23.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.072 7f2d132d6700 1 -- - start start 2020-01-26T15:32:23.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.072 7f2d132d6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c14bb60 con 0 2020-01-26T15:32:23.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.072 7f2d132d6700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c14bf00 con 0 2020-01-26T15:32:23.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d112fc700 1 -- 172.21.15.170:0/1312058124 learned_addr learned my addr 172.21.15.170:0/1312058124 2020-01-26T15:32:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2d000022a0 con 0x7f2d0c14b3d0 2020-01-26T15:32:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2d040039b0 con 0x7f2d0c1480d0 2020-01-26T15:32:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (107374248 0 0) 0x7f2d00002620 con 0x7f2d0c14b3d0 2020-01-26T15:32:23.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2cf8002ea0 con 0 2020-01-26T15:32:23.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (375111383 0 0) 0x7f2d04003d30 con 0x7f2d0c1480d0 2020-01-26T15:32:23.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2cf80046b0 con 0 2020-01-26T15:32:23.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4123825631 0 0) 0x7f2d040041d0 con 0x7f2d0c1480d0 2020-01-26T15:32:23.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 >> 172.21.15.170:6789/0 conn(0x7f2d0c14b3d0 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:32:23.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c07a930 con 0 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2d0c0e9ff0 con 0x7f2d0c1480d0 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d0bfff700 1 -- 172.21.15.170:0/1312058124 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2d04001390 con 0x7f2d0c1480d0 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d132d6700 1 -- 172.21.15.170:0/1312058124 >> 172.21.15.170:6790/0 conn(0x7f2d0c1480d0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d132d6700 1 -- 172.21.15.170:0/1312058124 shutdown_connections 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d132d6700 1 -- 172.21.15.170:0/1312058124 shutdown_connections 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d132d6700 1 -- 172.21.15.170:0/1312058124 wait complete. 2020-01-26T15:32:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.076 7f2d132d6700 1 -- 172.21.15.170:0/1312058124 >> 172.21.15.170:0/1312058124 conn(0x7f2d0c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d132d6700 1 Processor -- start 2020-01-26T15:32:23.084 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d132d6700 1 -- - start start 2020-01-26T15:32:23.084 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d132d6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0a3e40 con 0 2020-01-26T15:32:23.084 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d132d6700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0a6b30 con 0 2020-01-26T15:32:23.084 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d112fc700 1 -- 172.21.15.170:0/683549859 learned_addr learned my addr 172.21.15.170:0/683549859 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2d040011d0 con 0x7f2d0c0a3400 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2958860473 0 0) 0x7f2d040037c0 con 0x7f2d0c0a3400 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2cec002960 con 0 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2d00002bb0 con 0x7f2d0c0a6380 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3172802312 0 0) 0x7f2d00002070 con 0x7f2d0c0a6380 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2cec004620 con 0 2020-01-26T15:32:23.085 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2056575828 0 0) 0x7f2d04003c10 con 0x7f2d0c0a3400 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2cec002ee0 con 0 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1544052300 0 0) 0x7f2d00002510 con 0x7f2d0c0a6380 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2cec003540 con 0 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2605498441 0 0) 0x7f2d04001b50 con 0x7f2d0c0a3400 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 >> 172.21.15.170:6791/0 conn(0x7f2d0c0a6380 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c07ab90 con 0 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d132d6700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c0b2780 con 0 2020-01-26T15:32:23.086 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d132d6700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c18b3f0 con 0 2020-01-26T15:32:23.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2d04000f70 con 0x7f2d0c0a3400 2020-01-26T15:32:23.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2d04001f80 con 0x7f2d0c0a3400 2020-01-26T15:32:23.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2d04004b00 con 0x7f2d0c0a3400 2020-01-26T15:32:23.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.080 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f2d04004e30 con 0x7f2d0c0a3400 2020-01-26T15:32:23.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.088 7f2d132d6700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce8002070 con 0 2020-01-26T15:32:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.092 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2d040047f0 con 0x7f2d0c0a3400 2020-01-26T15:32:23.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.184 7f2d132d6700 1 -- 172.21.15.170:0/683549859 --> 172.21.15.170:6800/11008 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f2ce8000f90 con 0 2020-01-26T15:32:23.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d0a7fc700 1 -- 172.21.15.170:0/683549859 <== mgr.4111 172.21.15.170:6800/11008 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+60012 (2965378022 0 1406243854) 0x7f2d00000bf0 con 0x7f2cec006ed0 2020-01-26T15:32:23.191 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:23.191 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2020-01-26T15:32:23.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d132d6700 1 -- 172.21.15.170:0/683549859 >> 172.21.15.170:6800/11008 conn(0x7f2cec006ed0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:32:23.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d132d6700 1 -- 172.21.15.170:0/683549859 >> 172.21.15.170:6789/0 conn(0x7f2d0c0a3400 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:32:23.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d132d6700 1 -- 172.21.15.170:0/683549859 shutdown_connections 2020-01-26T15:32:23.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d132d6700 1 -- 172.21.15.170:0/683549859 shutdown_connections 2020-01-26T15:32:23.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d132d6700 1 -- 172.21.15.170:0/683549859 wait complete. 2020-01-26T15:32:23.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.188 7f2d132d6700 1 -- 172.21.15.170:0/683549859 >> 172.21.15.170:0/683549859 conn(0x7f2d0c099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.207 INFO:teuthology.orchestra.run.smithi170.stdout:{"version":25,"stamp":"2020-01-26 15:32:23.131439","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":74,"ondisk_log_size":74,"up":48,"acting":48},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"kb":377487360,"kb_used":4196928,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290432,"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5.000000,"apply_latency_ms":5.000000,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"stamp_delta":"2.019142"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.089157","last_change":"2020-01-26 15:32:15.388125","last_active":"2020-01-26 15:32:17.089157","last_peered":"2020-01-26 15:32:17.089157","last_clean":"2020-01-26 15:32:17.089157","last_became_active":"2020-01-26 15:32:15.387793","last_became_peered":"2020-01-26 15:32:15.387793","last_unstale":"2020-01-26 15:32:17.089157","last_undegraded":"2020-01-26 15:32:17.089157","last_fullsized":"2020-01-26 15:32:17.089157","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.385754","last_change":"2020-01-26 15:32:13.141863","last_active":"2020-01-26 15:32:16.385754","last_peered":"2020-01-26 15:32:16.385754","last_clean":"2020-01-26 15:32:16.385754","last_became_active":"2020-01-26 15:32:13.141432","last_became_peered":"2020-01-26 15:32:13.141432","last_unstale":"2020-01-26 15:32:16.385754","last_undegraded":"2020-01-26 15:32:16.385754","last_fullsized":"2020-01-26 15:32:16.385754","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'6","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.423819","last_change":"2020-01-26 15:32:15.160060","last_active":"2020-01-26 15:32:19.423819","last_peered":"2020-01-26 15:32:19.423819","last_clean":"2020-01-26 15:32:19.423819","last_became_active":"2020-01-26 15:32:15.159093","last_became_peered":"2020-01-26 15:32:15.159093","last_unstale":"2020-01-26 15:32:19.423819","last_undegraded":"2020-01-26 15:32:19.423819","last_fullsized":"2020-01-26 15:32:19.423819","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.396022","last_change":"2020-01-26 15:32:16.391402","last_active":"2020-01-26 15:32:16.396022","last_peered":"2020-01-26 15:32:16.396022","last_clean":"2020-01-26 15:32:16.396022","last_became_active":"2020-01-26 15:32:16.390999","last_became_peered":"2020-01-26 15:32:16.390999","last_unstale":"2020-01-26 15:32:16.396022","last_undegraded":"2020-01-26 15:32:16.396022","last_fullsized":"2020-01-26 15:32:16.396022","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.088990","last_change":"2020-01-26 15:32:13.147209","last_active":"2020-01-26 15:32:17.088990","last_peered":"2020-01-26 15:32:17.088990","last_clean":"2020-01-26 15:32:17.088990","last_became_active":"2020-01-26 15:32:13.146844","last_became_peered":"2020-01-26 15:32:13.146844","last_unstale":"2020-01-26 15:32:17.088990","last_undegraded":"2020-01-26 15:32:17.088990","last_fullsized":"2020-01-26 15:32:17.088990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"16'12","reported_seq":"23","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.423964","last_change":"2020-01-26 15:32:15.160486","last_active":"2020-01-26 15:32:19.423964","last_peered":"2020-01-26 15:32:19.423964","last_clean":"2020-01-26 15:32:19.423964","last_became_active":"2020-01-26 15:32:15.160031","last_became_peered":"2020-01-26 15:32:15.160031","last_unstale":"2020-01-26 15:32:19.423964","last_undegraded":"2020-01-26 15:32:19.423964","last_fullsized":"2020-01-26 15:32:19.423964","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":656,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.393527","last_change":"2020-01-26 15:32:16.389450","last_active":"2020-01-26 15:32:16.393527","last_peered":"2020-01-26 15:32:16.393527","last_clean":"2020-01-26 15:32:16.393527","last_became_active":"2020-01-26 15:32:16.389078","last_became_peered":"2020-01-26 15:32:16.389078","last_unstale":"2020-01-26 15:32:16.393527","last_undegraded":"2020-01-26 15:32:16.393527","last_fullsized":"2020-01-26 15:32:16.393527","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386255","last_change":"2020-01-26 15:32:13.141343","last_active":"2020-01-26 15:32:16.386255","last_peered":"2020-01-26 15:32:16.386255","last_clean":"2020-01-26 15:32:16.386255","last_became_active":"2020-01-26 15:32:13.140946","last_became_peered":"2020-01-26 15:32:13.140946","last_unstale":"2020-01-26 15:32:16.386255","last_undegraded":"2020-01-26 15:32:16.386255","last_fullsized":"2020-01-26 15:32:16.386255","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'14","reported_seq":"25","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.430772","last_change":"2020-01-26 15:32:15.158464","last_active":"2020-01-26 15:32:19.430772","last_peered":"2020-01-26 15:32:19.430772","last_clean":"2020-01-26 15:32:19.430772","last_became_active":"2020-01-26 15:32:15.158051","last_became_peered":"2020-01-26 15:32:15.158051","last_unstale":"2020-01-26 15:32:19.430772","last_undegraded":"2020-01-26 15:32:19.430772","last_fullsized":"2020-01-26 15:32:19.430772","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386144","last_change":"2020-01-26 15:32:15.387895","last_active":"2020-01-26 15:32:16.386144","last_peered":"2020-01-26 15:32:16.386144","last_clean":"2020-01-26 15:32:16.386144","last_became_active":"2020-01-26 15:32:15.387508","last_became_peered":"2020-01-26 15:32:15.387508","last_unstale":"2020-01-26 15:32:16.386144","last_undegraded":"2020-01-26 15:32:16.386144","last_fullsized":"2020-01-26 15:32:16.386144","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.387057","last_change":"2020-01-26 15:32:13.146813","last_active":"2020-01-26 15:32:16.387057","last_peered":"2020-01-26 15:32:16.387057","last_clean":"2020-01-26 15:32:16.387057","last_became_active":"2020-01-26 15:32:13.146287","last_became_peered":"2020-01-26 15:32:13.146287","last_unstale":"2020-01-26 15:32:16.387057","last_undegraded":"2020-01-26 15:32:16.387057","last_fullsized":"2020-01-26 15:32:16.387057","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'4","reported_seq":"15","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.425268","last_change":"2020-01-26 15:32:15.156510","last_active":"2020-01-26 15:32:19.425268","last_peered":"2020-01-26 15:32:19.425268","last_clean":"2020-01-26 15:32:19.425268","last_became_active":"2020-01-26 15:32:15.156120","last_became_peered":"2020-01-26 15:32:15.156120","last_unstale":"2020-01-26 15:32:19.425268","last_undegraded":"2020-01-26 15:32:19.425268","last_fullsized":"2020-01-26 15:32:19.425268","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.089040","last_change":"2020-01-26 15:32:15.387494","last_active":"2020-01-26 15:32:17.089040","last_peered":"2020-01-26 15:32:17.089040","last_clean":"2020-01-26 15:32:17.089040","last_became_active":"2020-01-26 15:32:15.387118","last_became_peered":"2020-01-26 15:32:15.387118","last_unstale":"2020-01-26 15:32:17.089040","last_undegraded":"2020-01-26 15:32:17.089040","last_fullsized":"2020-01-26 15:32:17.089040","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386138","last_change":"2020-01-26 15:32:13.142443","last_active":"2020-01-26 15:32:16.386138","last_peered":"2020-01-26 15:32:16.386138","last_clean":"2020-01-26 15:32:16.386138","last_became_active":"2020-01-26 15:32:13.141994","last_became_peered":"2020-01-26 15:32:13.141994","last_unstale":"2020-01-26 15:32:16.386138","last_undegraded":"2020-01-26 15:32:16.386138","last_fullsized":"2020-01-26 15:32:16.386138","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'15","reported_seq":"26","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.430472","last_change":"2020-01-26 15:32:15.157741","last_active":"2020-01-26 15:32:19.430472","last_peered":"2020-01-26 15:32:19.430472","last_clean":"2020-01-26 15:32:19.430472","last_became_active":"2020-01-26 15:32:15.157363","last_became_peered":"2020-01-26 15:32:15.157363","last_unstale":"2020-01-26 15:32:19.430472","last_undegraded":"2020-01-26 15:32:19.430472","last_fullsized":"2020-01-26 15:32:19.430472","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.393510","last_change":"2020-01-26 15:32:16.389403","last_active":"2020-01-26 15:32:16.393510","last_peered":"2020-01-26 15:32:16.393510","last_clean":"2020-01-26 15:32:16.393510","last_became_active":"2020-01-26 15:32:16.389018","last_became_peered":"2020-01-26 15:32:16.389018","last_unstale":"2020-01-26 15:32:16.393510","last_undegraded":"2020-01-26 15:32:16.393510","last_fullsized":"2020-01-26 15:32:16.393510","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.088960","last_change":"2020-01-26 15:32:13.147557","last_active":"2020-01-26 15:32:17.088960","last_peered":"2020-01-26 15:32:17.088960","last_clean":"2020-01-26 15:32:17.088960","last_became_active":"2020-01-26 15:32:13.147173","last_became_peered":"2020-01-26 15:32:13.147173","last_unstale":"2020-01-26 15:32:17.088960","last_undegraded":"2020-01-26 15:32:17.088960","last_fullsized":"2020-01-26 15:32:17.088960","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'5","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.430860","last_change":"2020-01-26 15:32:15.158957","last_active":"2020-01-26 15:32:19.430860","last_peered":"2020-01-26 15:32:19.430860","last_clean":"2020-01-26 15:32:19.430860","last_became_active":"2020-01-26 15:32:15.158522","last_became_peered":"2020-01-26 15:32:15.158522","last_unstale":"2020-01-26 15:32:19.430860","last_undegraded":"2020-01-26 15:32:19.430860","last_fullsized":"2020-01-26 15:32:19.430860","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386248","last_change":"2020-01-26 15:32:15.388882","last_active":"2020-01-26 15:32:16.386248","last_peered":"2020-01-26 15:32:16.386248","last_clean":"2020-01-26 15:32:16.386248","last_became_active":"2020-01-26 15:32:15.388539","last_became_peered":"2020-01-26 15:32:15.388539","last_unstale":"2020-01-26 15:32:16.386248","last_undegraded":"2020-01-26 15:32:16.386248","last_fullsized":"2020-01-26 15:32:16.386248","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:17.089289","last_change":"2020-01-26 15:32:13.147923","last_active":"2020-01-26 15:32:17.089289","last_peered":"2020-01-26 15:32:17.089289","last_clean":"2020-01-26 15:32:17.089289","last_became_active":"2020-01-26 15:32:13.147051","last_became_peered":"2020-01-26 15:32:13.147051","last_unstale":"2020-01-26 15:32:17.089289","last_undegraded":"2020-01-26 15:32:17.089289","last_fullsized":"2020-01-26 15:32:17.089289","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'8","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.424054","last_change":"2020-01-26 15:32:15.159142","last_active":"2020-01-26 15:32:19.424054","last_peered":"2020-01-26 15:32:19.424054","last_clean":"2020-01-26 15:32:19.424054","last_became_active":"2020-01-26 15:32:15.158804","last_became_peered":"2020-01-26 15:32:15.158804","last_unstale":"2020-01-26 15:32:19.424054","last_undegraded":"2020-01-26 15:32:19.424054","last_fullsized":"2020-01-26 15:32:19.424054","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.385641","last_change":"2020-01-26 15:32:15.388612","last_active":"2020-01-26 15:32:16.385641","last_peered":"2020-01-26 15:32:16.385641","last_clean":"2020-01-26 15:32:16.385641","last_became_active":"2020-01-26 15:32:15.388267","last_became_peered":"2020-01-26 15:32:15.388267","last_unstale":"2020-01-26 15:32:16.385641","last_undegraded":"2020-01-26 15:32:16.385641","last_fullsized":"2020-01-26 15:32:16.385641","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:15.146049","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:15.146049","last_clean_scrub_stamp":"2020-01-26 15:32:15.146049","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:32:16.386535","last_change":"2020-01-26 15:32:13.142563","last_active":"2020-01-26 15:32:16.386535","last_peered":"2020-01-26 15:32:16.386535","last_clean":"2020-01-26 15:32:16.386535","last_became_active":"2020-01-26 15:32:13.142168","last_became_peered":"2020-01-26 15:32:13.142168","last_unstale":"2020-01-26 15:32:16.386535","last_undegraded":"2020-01-26 15:32:16.386535","last_fullsized":"2020-01-26 15:32:16.386535","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:12.123576","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:12.123576","last_clean_scrub_stamp":"2020-01-26 15:32:12.123576","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,3],"acting":[1,3],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"16'10","reported_seq":"21","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26 15:32:19.425590","last_change":"2020-01-26 15:32:15.159708","last_active":"2020-01-26 15:32:19.425590","last_peered":"2020-01-26 15:32:19.425590","last_clean":"2020-01-26 15:32:19.425590","last_became_active":"2020-01-26 15:32:15.159343","last_became_peered":"2020-01-26 15:32:15.159343","last_unstale":"2020-01-26 15:32:19.425590","last_undegraded":"2020-01-26 15:32:19.425590","last_fullsized":"2020-01-26 15:32:19.425590","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:32:14.140184","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:32:14.140184","last_clean_scrub_stamp":"2020-01-26 15:32:14.140184","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":74,"ondisk_log_size":74,"up":16,"acting":16}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":14,"kb":94371840,"kb_used":1049296,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322544,"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.686}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.603}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.745}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":10,"kb":94371840,"kb_used":1049184,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322656,"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2.000000,"apply_latency_ms":2.000000,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.369}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.491}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.417}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":12,"kb":94371840,"kb_used":1049280,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322560,"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1.000000,"apply_latency_ms":1.000000,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.390}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.561}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.618}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":12,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2.000000,"apply_latency_ms":2.000000,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.579}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.552}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.405}]}]}]} 2020-01-26T15:32:23.214 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-26T15:32:23.214 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-26T15:32:23.214 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-26T15:32:23.215 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:32:23.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fd2ae3700 1 Processor -- start 2020-01-26T15:32:23.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fd2ae3700 1 -- - start start 2020-01-26T15:32:23.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fd2ae3700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc14bb00 con 0 2020-01-26T15:32:23.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fd2ae3700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc14bea0 con 0 2020-01-26T15:32:23.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fd0b09700 1 -- 172.21.15.170:0/1495063714 learned_addr learned my addr 172.21.15.170:0/1495063714 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7fbc003630 con 0x7f7fcc1480c0 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2166121519 0 0) 0x7f7fbc0039b0 con 0x7f7fcc1480c0 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7fb8002a20 con 0 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7fc00022a0 con 0x7f7fcc14b3c0 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2465448572 0 0) 0x7f7fc0002620 con 0x7f7fcc14b3c0 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7fb80046c0 con 0 2020-01-26T15:32:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2703224133 0 0) 0x7f7fbc003f80 con 0x7f7fcc1480c0 2020-01-26T15:32:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 >> 172.21.15.170:6789/0 conn(0x7f7fcc14b3c0 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:32:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc07a920 con 0 2020-01-26T15:32:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7fcc0e9fe0 con 0x7f7fcc1480c0 2020-01-26T15:32:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fcb7fe700 1 -- 172.21.15.170:0/1495063714 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7fbc001050 con 0x7f7fcc1480c0 2020-01-26T15:32:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.296 7f7fd2ae3700 1 -- 172.21.15.170:0/1495063714 >> 172.21.15.170:6791/0 conn(0x7f7fcc1480c0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:32:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.300 7f7fd2ae3700 1 -- 172.21.15.170:0/1495063714 shutdown_connections 2020-01-26T15:32:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.300 7f7fd2ae3700 1 -- 172.21.15.170:0/1495063714 shutdown_connections 2020-01-26T15:32:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.300 7f7fd2ae3700 1 -- 172.21.15.170:0/1495063714 wait complete. 2020-01-26T15:32:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.300 7f7fd2ae3700 1 -- 172.21.15.170:0/1495063714 >> 172.21.15.170:0/1495063714 conn(0x7f7fcc143ff0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.300 7f7fd2ae3700 1 Processor -- start 2020-01-26T15:32:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.300 7f7fd2ae3700 1 -- - start start 2020-01-26T15:32:23.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fd2ae3700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0a3ce0 con 0 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fd2ae3700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0a6ab0 con 0 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fcbfff700 1 -- 172.21.15.170:0/2259704802 learned_addr learned my addr 172.21.15.170:0/2259704802 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7fc00022a0 con 0x7f7fcc0a6300 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (637415483 0 0) 0x7f7fc00029b0 con 0x7f7fcc0a6300 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7fac002960 con 0 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7fbc000e50 con 0x7f7fcc0a32f0 2020-01-26T15:32:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (257231510 0 0) 0x7f7fbc001570 con 0x7f7fcc0a32f0 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7fac004620 con 0 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3141836818 0 0) 0x7f7fc0000e50 con 0x7f7fcc0a6300 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7fac002ee0 con 0 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (715233472 0 0) 0x7f7fbc0018f0 con 0x7f7fcc0a32f0 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7fac003540 con 0 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (967969523 0 0) 0x7f7fc0001570 con 0x7f7fcc0a6300 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 >> 172.21.15.170:6789/0 conn(0x7f7fcc0a32f0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:32:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc07ab80 con 0 2020-01-26T15:32:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc0b2900 con 0 2020-01-26T15:32:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc18b160 con 0 2020-01-26T15:32:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7fc0000bf0 con 0x7f7fcc0a6300 2020-01-26T15:32:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7fc00019a0 con 0x7f7fcc0a6300 2020-01-26T15:32:23.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f7fc00044b0 con 0x7f7fcc0a6300 2020-01-26T15:32:23.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.304 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f7fc0005f20 con 0x7f7fcc0a6300 2020-01-26T15:32:23.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.308 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc07af20 con 0 2020-01-26T15:32:23.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.312 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f7fcc07af20 con 0x7f7fcc0a6300 2020-01-26T15:32:23.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.400 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7fcc073320 con 0 2020-01-26T15:32:23.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.400 7f7fc9ffb700 1 -- 172.21.15.170:0/2259704802 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+65 (3730786198 0 590078407) 0x7f7fc0004ae0 con 0x7f7fcc0a6300 2020-01-26T15:32:23.404 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:23.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.404 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 >> 172.21.15.170:6800/11008 conn(0x7f7fac006ed0 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:32:23.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.404 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 >> 172.21.15.170:6791/0 conn(0x7f7fcc0a6300 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:32:23.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.404 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 shutdown_connections 2020-01-26T15:32:23.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.404 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 shutdown_connections 2020-01-26T15:32:23.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.404 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 wait complete. 2020-01-26T15:32:23.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.404 7f7fd2ae3700 1 -- 172.21.15.170:0/2259704802 >> 172.21.15.170:0/2259704802 conn(0x7f7fcc099440 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.415 INFO:teuthology.orchestra.run.smithi170.stdout:{"checks":{},"status":"HEALTH_OK","overall_status":"HEALTH_WARN"} 2020-01-26T15:32:23.415 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-01-26T15:32:23.416 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:23.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6e6047700 1 Processor -- start 2020-01-26T15:32:23.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6e6047700 1 -- - start start 2020-01-26T15:32:23.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6e6047700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e014bb10 con 0 2020-01-26T15:32:23.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6e6047700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e014beb0 con 0 2020-01-26T15:32:23.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6dffff700 1 -- 172.21.15.170:0/3111682756 learned_addr learned my addr 172.21.15.170:0/3111682756 2020-01-26T15:32:23.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6c80022a0 con 0x7fa6e014b3d0 2020-01-26T15:32:23.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2217347910 0 0) 0x7fa6c8002620 con 0x7fa6e014b3d0 2020-01-26T15:32:23.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa6c0002a20 con 0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6d0003630 con 0x7fa6e01480d0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (282538116 0 0) 0x7fa6d00039b0 con 0x7fa6e01480d0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa6c00046c0 con 0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3975317856 0 0) 0x7fa6c8002bf0 con 0x7fa6e014b3d0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 >> 172.21.15.170:6791/0 conn(0x7fa6e01480d0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e007a930 con 0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa6e0116e80 con 0x7fa6e014b3d0 2020-01-26T15:32:23.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.504 7fa6df7fe700 1 -- 172.21.15.170:0/3111682756 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6c8001050 con 0x7fa6e014b3d0 2020-01-26T15:32:23.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 -- 172.21.15.170:0/3111682756 >> 172.21.15.170:6789/0 conn(0x7fa6e014b3d0 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:32:23.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 -- 172.21.15.170:0/3111682756 shutdown_connections 2020-01-26T15:32:23.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 -- 172.21.15.170:0/3111682756 shutdown_connections 2020-01-26T15:32:23.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 -- 172.21.15.170:0/3111682756 wait complete. 2020-01-26T15:32:23.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 -- 172.21.15.170:0/3111682756 >> 172.21.15.170:0/3111682756 conn(0x7fa6e0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 Processor -- start 2020-01-26T15:32:23.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.508 7fa6e6047700 1 -- - start start 2020-01-26T15:32:23.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6e6047700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00a3db0 con 0 2020-01-26T15:32:23.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6e6047700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00a6af0 con 0 2020-01-26T15:32:23.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6dffff700 1 -- 172.21.15.170:0/2371789225 learned_addr learned my addr 172.21.15.170:0/2371789225 2020-01-26T15:32:23.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6d0003440 con 0x7fa6e00a33c0 2020-01-26T15:32:23.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2949886036 0 0) 0x7fa6d0003d40 con 0x7fa6e00a33c0 2020-01-26T15:32:23.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa6c4002960 con 0 2020-01-26T15:32:23.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6c8000e50 con 0x7fa6e00a6340 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (321869998 0 0) 0x7fa6c8001ff0 con 0x7fa6e00a6340 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa6c4004620 con 0 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2617746752 0 0) 0x7fa6d0000e50 con 0x7fa6e00a33c0 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6c4002ee0 con 0 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (231293272 0 0) 0x7fa6c8002370 con 0x7fa6e00a6340 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6c4003540 con 0 2020-01-26T15:32:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3564333233 0 0) 0x7fa6d00013f0 con 0x7fa6e00a33c0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 >> 172.21.15.170:6790/0 conn(0x7fa6e00a6340 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e007ab90 con 0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e00b2780 con 0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e018b1c0 con 0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa6e00e9ff0 con 0x7fa6e00a33c0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6d0001820 con 0x7fa6e00a33c0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fa6d0001a60 con 0x7fa6e00a33c0 2020-01-26T15:32:23.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.512 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7fa6d0005ec0 con 0x7fa6e00a33c0 2020-01-26T15:32:23.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.516 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b8002070 con 0 2020-01-26T15:32:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.520 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa6d0004200 con 0x7fa6e00a33c0 2020-01-26T15:32:23.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.608 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6b80011f0 con 0 2020-01-26T15:32:23.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.608 7fa6ddffb700 1 -- 172.21.15.170:0/2371789225 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 1605628788) 0x7fa6d00044f0 con 0x7fa6e00a33c0 2020-01-26T15:32:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.612 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 >> 172.21.15.170:6800/11008 conn(0x7fa6c4006ed0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:32:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.612 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 >> 172.21.15.170:6791/0 conn(0x7fa6e00a33c0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:32:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.612 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 shutdown_connections 2020-01-26T15:32:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.612 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 shutdown_connections 2020-01-26T15:32:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.612 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 wait complete. 2020-01-26T15:32:23.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.612 7fa6e6047700 1 -- 172.21.15.170:0/2371789225 >> 172.21.15.170:0/2371789225 conn(0x7fa6e0099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.621 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:23.622 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":16,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:17.386083","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:23.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:11.534039', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.037219', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.435582', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:32:23.631 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:32:23.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.720 7f7140002700 1 Processor -- start 2020-01-26T15:32:23.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.720 7f7140002700 1 -- - start start 2020-01-26T15:32:23.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.720 7f7140002700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713814bb50 con 0 2020-01-26T15:32:23.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.720 7f7140002700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713814bef0 con 0 2020-01-26T15:32:23.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.720 7f713e028700 1 -- 172.21.15.170:0/1715114820 learned_addr learned my addr 172.21.15.170:0/1715114820 2020-01-26T15:32:23.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f71280022a0 con 0x7f713814b410 2020-01-26T15:32:23.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2913185431 0 0) 0x7f7128002620 con 0x7f713814b410 2020-01-26T15:32:23.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7120002a20 con 0 2020-01-26T15:32:23.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7134003630 con 0x7f7138148110 2020-01-26T15:32:23.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1711379355 0 0) 0x7f71340039b0 con 0x7f7138148110 2020-01-26T15:32:23.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f71200046c0 con 0 2020-01-26T15:32:23.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (341149938 0 0) 0x7f7128002bf0 con 0x7f713814b410 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 >> 172.21.15.170:6791/0 conn(0x7f7138148110 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713807a8b0 con 0 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7138116ec0 con 0x7f713814b410 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f713d026700 1 -- 172.21.15.170:0/1715114820 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7128001050 con 0x7f713814b410 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- 172.21.15.170:0/1715114820 >> 172.21.15.170:6789/0 conn(0x7f713814b410 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- 172.21.15.170:0/1715114820 shutdown_connections 2020-01-26T15:32:23.728 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- 172.21.15.170:0/1715114820 shutdown_connections 2020-01-26T15:32:23.729 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- 172.21.15.170:0/1715114820 wait complete. 2020-01-26T15:32:23.729 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- 172.21.15.170:0/1715114820 >> 172.21.15.170:0/1715114820 conn(0x7f7138144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 Processor -- start 2020-01-26T15:32:23.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- - start start 2020-01-26T15:32:23.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380a3d30 con 0 2020-01-26T15:32:23.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.724 7f7140002700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380a6910 con 0 2020-01-26T15:32:23.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f713e028700 1 -- 172.21.15.170:0/1838069648 learned_addr learned my addr 172.21.15.170:0/1838069648 2020-01-26T15:32:23.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7128000e50 con 0x7f71380a62c0 2020-01-26T15:32:23.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7134003fe0 con 0x7f71380a3340 2020-01-26T15:32:23.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3248434180 0 0) 0x7f7128001ff0 con 0x7f71380a62c0 2020-01-26T15:32:23.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7118002df0 con 0 2020-01-26T15:32:23.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (942522351 0 0) 0x7f71340034f0 con 0x7f71380a3340 2020-01-26T15:32:23.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f7118004620 con 0 2020-01-26T15:32:23.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (750293941 0 0) 0x7f71280023c0 con 0x7f71380a62c0 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7118004df0 con 0 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1180180033 0 0) 0x7f7134003910 con 0x7f71380a3340 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7118006570 con 0 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1013297214 0 0) 0x7f7128001810 con 0x7f71380a62c0 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 >> 172.21.15.170:6791/0 conn(0x7f71380a3340 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713807ab10 con 0 2020-01-26T15:32:23.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f7140002700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71380b2710 con 0 2020-01-26T15:32:23.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f7140002700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f713818b220 con 0 2020-01-26T15:32:23.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f7128000bf0 con 0x7f71380a62c0 2020-01-26T15:32:23.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f7128001a80 con 0x7f71380a62c0 2020-01-26T15:32:23.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f71280033f0 con 0x7f71380a62c0 2020-01-26T15:32:23.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.728 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f7128004be0 con 0x7f71380a62c0 2020-01-26T15:32:23.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.736 7f7140002700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7114002070 con 0 2020-01-26T15:32:23.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.740 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f7128002ed0 con 0x7f71380a62c0 2020-01-26T15:32:23.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.832 7f7140002700 1 -- 172.21.15.170:0/1838069648 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f71140012a0 con 0 2020-01-26T15:32:23.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.832 7f71277fe700 1 -- 172.21.15.170:0/1838069648 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (3245944037 0 265718887) 0x7f7128003180 con 0x7f71380a62c0 2020-01-26T15:32:23.836 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:23.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.836 7f7140002700 1 -- 172.21.15.170:0/1838069648 >> 172.21.15.170:6800/11008 conn(0x7f71180072a0 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:32:23.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.836 7f7140002700 1 -- 172.21.15.170:0/1838069648 >> 172.21.15.170:6790/0 conn(0x7f71380a62c0 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:32:23.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.836 7f7140002700 1 -- 172.21.15.170:0/1838069648 shutdown_connections 2020-01-26T15:32:23.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.836 7f7140002700 1 -- 172.21.15.170:0/1838069648 shutdown_connections 2020-01-26T15:32:23.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.836 7f7140002700 1 -- 172.21.15.170:0/1838069648 wait complete. 2020-01-26T15:32:23.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.836 7f7140002700 1 -- 172.21.15.170:0/1838069648 >> 172.21.15.170:0/1838069648 conn(0x7f71380993d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.847 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:32:23.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.940 7ff6f4cc5700 1 Processor -- start 2020-01-26T15:32:23.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.940 7ff6f4cc5700 1 -- - start start 2020-01-26T15:32:23.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f014bb50 con 0 2020-01-26T15:32:23.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f014bef0 con 0 2020-01-26T15:32:23.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eea68700 1 -- 172.21.15.170:0/2895182994 learned_addr learned my addr 172.21.15.170:0/2895182994 2020-01-26T15:32:23.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6e40022a0 con 0x7ff6f014b410 2020-01-26T15:32:23.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3105442817 0 0) 0x7ff6e4002620 con 0x7ff6f014b410 2020-01-26T15:32:23.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff6d4002a20 con 0 2020-01-26T15:32:23.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6e00035b0 con 0x7ff6f0148110 2020-01-26T15:32:23.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3144069284 0 0) 0x7ff6e00038b0 con 0x7ff6f0148110 2020-01-26T15:32:23.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff6d40046c0 con 0 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1881450722 0 0) 0x7ff6e4002bf0 con 0x7ff6f014b410 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 >> 172.21.15.170:6790/0 conn(0x7ff6f0148110 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f007a8b0 con 0 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff6f0116ec0 con 0x7ff6f014b410 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- 172.21.15.170:0/2895182994 >> 172.21.15.170:6789/0 conn(0x7ff6f014b410 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6eda66700 1 -- 172.21.15.170:0/2895182994 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6e4001050 con 0x7ff6f014b410 2020-01-26T15:32:23.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- 172.21.15.170:0/2895182994 shutdown_connections 2020-01-26T15:32:23.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- 172.21.15.170:0/2895182994 shutdown_connections 2020-01-26T15:32:23.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- 172.21.15.170:0/2895182994 wait complete. 2020-01-26T15:32:23.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.944 7ff6f4cc5700 1 -- 172.21.15.170:0/2895182994 >> 172.21.15.170:0/2895182994 conn(0x7ff6f0144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:23.952 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6f4cc5700 1 Processor -- start 2020-01-26T15:32:23.952 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6f4cc5700 1 -- - start start 2020-01-26T15:32:23.952 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6f4cc5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f00a3cd0 con 0 2020-01-26T15:32:23.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6f4cc5700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f00a6aa0 con 0 2020-01-26T15:32:23.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6eea68700 1 -- 172.21.15.170:0/3614842919 learned_addr learned my addr 172.21.15.170:0/3614842919 2020-01-26T15:32:23.953 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6e0003850 con 0x7ff6f00a3310 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4202617916 0 0) 0x7ff6e0003bd0 con 0x7ff6f00a3310 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff6cc002960 con 0 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6e4000e50 con 0x7ff6f00a62f0 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (894802588 0 0) 0x7ff6e4001ff0 con 0x7ff6f00a62f0 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff6cc004620 con 0 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (263482729 0 0) 0x7ff6e0000e50 con 0x7ff6f00a3310 2020-01-26T15:32:23.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6cc002ee0 con 0 2020-01-26T15:32:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1043289149 0 0) 0x7ff6e4002260 con 0x7ff6f00a62f0 2020-01-26T15:32:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6cc003540 con 0 2020-01-26T15:32:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4241689830 0 0) 0x7ff6e0001360 con 0x7ff6f00a3310 2020-01-26T15:32:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 >> 172.21.15.170:6791/0 conn(0x7ff6f00a62f0 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:32:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f007ab10 con 0 2020-01-26T15:32:23.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f00b28a0 con 0 2020-01-26T15:32:23.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f018b1b0 con 0 2020-01-26T15:32:23.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff6e0000bf0 con 0x7ff6f00a3310 2020-01-26T15:32:23.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff6e00017e0 con 0x7ff6f00a3310 2020-01-26T15:32:23.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7ff6e0001a20 con 0x7ff6f00a3310 2020-01-26T15:32:23.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.948 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7ff6e0006000 con 0x7ff6f00a3310 2020-01-26T15:32:23.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.956 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f007ae90 con 0 2020-01-26T15:32:23.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:23.960 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff6f007ae90 con 0x7ff6f00a3310 2020-01-26T15:32:24.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.048 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ff6f0073260 con 0 2020-01-26T15:32:24.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.048 7ff6dffff700 1 -- 172.21.15.170:0/3614842919 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7ff6e0004260 con 0x7ff6f00a3310 2020-01-26T15:32:24.053 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:24.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.052 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 >> 172.21.15.170:6800/11008 conn(0x7ff6cc006ed0 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:32:24.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.052 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 >> 172.21.15.170:6790/0 conn(0x7ff6f00a3310 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:32:24.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.052 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 shutdown_connections 2020-01-26T15:32:24.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.052 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 shutdown_connections 2020-01-26T15:32:24.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.052 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 wait complete. 2020-01-26T15:32:24.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.052 7ff6f4cc5700 1 -- 172.21.15.170:0/3614842919 >> 172.21.15.170:0/3614842919 conn(0x7ff6f0099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:24.064 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:32:24.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 Processor -- start 2020-01-26T15:32:24.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- - start start 2020-01-26T15:32:24.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc014bb50 con 0 2020-01-26T15:32:24.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc014bef0 con 0 2020-01-26T15:32:24.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbe267700 1 -- 172.21.15.170:0/2204871846 learned_addr learned my addr 172.21.15.170:0/2204871846 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8db8002620 con 0x7f8dc0148110 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2921682649 0 0) 0x7f8db80029a0 con 0x7f8dc0148110 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8da4002a20 con 0 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8db4003630 con 0x7f8dc014b410 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3262384810 0 0) 0x7f8db4003930 con 0x7f8dc014b410 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8da40046c0 con 0 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (473641986 0 0) 0x7f8db8002f70 con 0x7f8dc0148110 2020-01-26T15:32:24.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 >> 172.21.15.170:6791/0 conn(0x7f8dc014b410 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc007a8b0 con 0 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8db8000f70 con 0x7f8dc0148110 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dbda66700 1 -- 172.21.15.170:0/2204871846 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8db80013d0 con 0x7f8dc0148110 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- 172.21.15.170:0/2204871846 >> 172.21.15.170:6789/0 conn(0x7f8dc0148110 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- 172.21.15.170:0/2204871846 shutdown_connections 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- 172.21.15.170:0/2204871846 shutdown_connections 2020-01-26T15:32:24.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- 172.21.15.170:0/2204871846 wait complete. 2020-01-26T15:32:24.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.168 7f8dc4b29700 1 -- 172.21.15.170:0/2204871846 >> 172.21.15.170:0/2204871846 conn(0x7f8dc0144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:24.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dc4b29700 1 Processor -- start 2020-01-26T15:32:24.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dc4b29700 1 -- - start start 2020-01-26T15:32:24.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dc4b29700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc00a3f60 con 0 2020-01-26T15:32:24.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dc4b29700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc00a6ca0 con 0 2020-01-26T15:32:24.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dbe267700 1 -- 172.21.15.170:0/2328681962 learned_addr learned my addr 172.21.15.170:0/2328681962 2020-01-26T15:32:24.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8db8002f70 con 0x7f8dc00a3570 2020-01-26T15:32:24.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8db4003f60 con 0x7f8dc00a64f0 2020-01-26T15:32:24.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3195330123 0 0) 0x7f8db8001250 con 0x7f8dc00a3570 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8d9c002df0 con 0 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1745996387 0 0) 0x7f8db4003470 con 0x7f8dc00a64f0 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8d9c004620 con 0 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3737304698 0 0) 0x7f8db8002490 con 0x7f8dc00a3570 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d9c004df0 con 0 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2643721562 0 0) 0x7f8db4003800 con 0x7f8dc00a64f0 2020-01-26T15:32:24.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d9c0034b0 con 0 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2573384425 0 0) 0x7f8db80018f0 con 0x7f8dc00a3570 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 >> 172.21.15.170:6791/0 conn(0x7f8dc00a64f0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc007ab10 con 0 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc00b2870 con 0 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc00a5580 con 0 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8db80016e0 con 0x7f8dc00a3570 2020-01-26T15:32:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.172 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8db8001b60 con 0x7f8dc00a3570 2020-01-26T15:32:24.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.176 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f8db8003740 con 0x7f8dc00a3570 2020-01-26T15:32:24.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.176 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f8db8004ee0 con 0x7f8dc00a3570 2020-01-26T15:32:24.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.180 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc007ae90 con 0 2020-01-26T15:32:24.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.184 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8dc007ae90 con 0x7f8dc00a3570 2020-01-26T15:32:24.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.276 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f8dc0073260 con 0 2020-01-26T15:32:24.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8daffff700 1 -- 172.21.15.170:0/2328681962 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7f8db8003c00 con 0x7f8dc00a3570 2020-01-26T15:32:24.281 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:24.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 >> 172.21.15.170:6800/11008 conn(0x7f8d9c0072a0 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:32:24.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 >> 172.21.15.170:6790/0 conn(0x7f8dc00a3570 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:32:24.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 shutdown_connections 2020-01-26T15:32:24.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 shutdown_connections 2020-01-26T15:32:24.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 wait complete. 2020-01-26T15:32:24.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.280 7f8dc4b29700 1 -- 172.21.15.170:0/2328681962 >> 172.21.15.170:0/2328681962 conn(0x7f8dc00995c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:24.293 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:24.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.380 7ff09cf6b700 1 Processor -- start 2020-01-26T15:32:24.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.380 7ff09cf6b700 1 -- - start start 2020-01-26T15:32:24.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09814bb10 con 0 2020-01-26T15:32:24.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09814beb0 con 0 2020-01-26T15:32:24.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff096d71700 1 -- 172.21.15.170:0/481070198 learned_addr learned my addr 172.21.15.170:0/481070198 2020-01-26T15:32:24.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff0880039b0 con 0x7ff0981480d0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1280170978 0 0) 0x7ff088003d30 con 0x7ff0981480d0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff07c002a20 con 0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff08c0022a0 con 0x7ff09814b3d0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2818383903 0 0) 0x7ff08c002620 con 0x7ff09814b3d0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff07c0046c0 con 0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4093690945 0 0) 0x7ff088004300 con 0x7ff0981480d0 2020-01-26T15:32:24.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 >> 172.21.15.170:6791/0 conn(0x7ff09814b3d0 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:32:24.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09807a930 con 0 2020-01-26T15:32:24.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff0980e9ff0 con 0x7ff0981480d0 2020-01-26T15:32:24.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff095d6f700 1 -- 172.21.15.170:0/481070198 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff0880013d0 con 0x7ff0981480d0 2020-01-26T15:32:24.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- 172.21.15.170:0/481070198 >> 172.21.15.170:6789/0 conn(0x7ff0981480d0 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:32:24.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- 172.21.15.170:0/481070198 shutdown_connections 2020-01-26T15:32:24.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- 172.21.15.170:0/481070198 shutdown_connections 2020-01-26T15:32:24.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- 172.21.15.170:0/481070198 wait complete. 2020-01-26T15:32:24.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.384 7ff09cf6b700 1 -- 172.21.15.170:0/481070198 >> 172.21.15.170:0/481070198 conn(0x7ff098144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:24.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff09cf6b700 1 Processor -- start 2020-01-26T15:32:24.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff09cf6b700 1 -- - start start 2020-01-26T15:32:24.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff09cf6b700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0980a3cf0 con 0 2020-01-26T15:32:24.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff09cf6b700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0980a6ac0 con 0 2020-01-26T15:32:24.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff096d71700 1 -- 172.21.15.170:0/414854822 learned_addr learned my addr 172.21.15.170:0/414854822 2020-01-26T15:32:24.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff0880011d0 con 0x7ff0980a3300 2020-01-26T15:32:24.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff08c0020e0 con 0x7ff0980a6310 2020-01-26T15:32:24.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (770236396 0 0) 0x7ff0880018f0 con 0x7ff0980a3300 2020-01-26T15:32:24.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff074002df0 con 0 2020-01-26T15:32:24.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1833857280 0 0) 0x7ff08c0029b0 con 0x7ff0980a6310 2020-01-26T15:32:24.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff074004620 con 0 2020-01-26T15:32:24.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2962576478 0 0) 0x7ff088001c70 con 0x7ff0980a3300 2020-01-26T15:32:24.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff074004df0 con 0 2020-01-26T15:32:24.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (403913402 0 0) 0x7ff08c002c20 con 0x7ff0980a6310 2020-01-26T15:32:24.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.388 7ff087fff700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0740034b0 con 0 2020-01-26T15:32:24.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (358401169 0 0) 0x7ff0880039a0 con 0x7ff0980a3300 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 >> 172.21.15.170:6790/0 conn(0x7ff0980a6310 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09807ab90 con 0 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0980b29a0 con 0 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09818b170 con 0 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff088000f70 con 0x7ff0980a3300 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff088003c10 con 0x7ff0980a3300 2020-01-26T15:32:24.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7ff088004ad0 con 0x7ff0980a3300 2020-01-26T15:32:24.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.392 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7ff088006400 con 0x7ff0980a3300 2020-01-26T15:32:24.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.396 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff078002070 con 0 2020-01-26T15:32:24.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.400 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff0880045b0 con 0x7ff0980a3300 2020-01-26T15:32:24.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.492 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0780011d0 con 0 2020-01-26T15:32:24.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.492 7ff087fff700 1 -- 172.21.15.170:0/414854822 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2262 (882253904 0 1822045022) 0x7ff0880066a0 con 0x7ff0980a3300 2020-01-26T15:32:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:24.496 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:20.414222","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:24.496 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 9 2020-01-26T15:32:24.497 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.496 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 >> 172.21.15.170:6800/11008 conn(0x7ff0740072a0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:32:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.496 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 >> 172.21.15.170:6791/0 conn(0x7ff0980a3300 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:32:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.496 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 shutdown_connections 2020-01-26T15:32:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.496 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 shutdown_connections 2020-01-26T15:32:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.496 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 wait complete. 2020-01-26T15:32:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:24.496 7ff09cf6b700 1 -- 172.21.15.170:0/414854822 >> 172.21.15.170:0/414854822 conn(0x7ff0980994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:24.815 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 9, u'flags': 18, u'max_mds': 2, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:20.414222', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:24.815 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-01-26T15:32:24.815 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-01-26T15:32:24.902 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 1, 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4203, 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 5.491515, 2020-01-26T15:32:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 9, 2020-01-26T15:32:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 16, 2020-01-26T15:32:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:32:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 7.386706 2020-01-26T15:32:24.904 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:24.909 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 1, "id": 4203, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.491515, "mdsmap_epoch": 9, "osdmap_epoch": 16, "osdmap_epoch_barrier": 16, "uptime": 7.386706 } 2020-01-26T15:32:24.909 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:32:24.997 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:24.998 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:24.998 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2020-01-26T15:32:24.998 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4225, 2020-01-26T15:32:24.998 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:24.998 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:24.998 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 6.596245, 2020-01-26T15:32:24.999 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 9, 2020-01-26T15:32:24.999 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 16, 2020-01-26T15:32:24.999 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:32:25.000 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 7.496087 2020-01-26T15:32:25.000 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:25.004 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 0, "id": 4225, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.596245, "mdsmap_epoch": 9, "osdmap_epoch": 16, "osdmap_epoch_barrier": 16, "uptime": 7.496087 } 2020-01-26T15:32:25.004 INFO:teuthology.run_tasks:Running task exec... 2020-01-26T15:32:25.017 INFO:teuthology.task.exec:Executing custom commands... 2020-01-26T15:32:25.017 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:32:25.018 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client mimic' 2020-01-26T15:32:25.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.108 7f9792c3c700 1 Processor -- start 2020-01-26T15:32:25.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.108 7f9792c3c700 1 -- - start start 2020-01-26T15:32:25.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.108 7f9792c3c700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c14bc10 con 0 2020-01-26T15:32:25.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.108 7f9792c3c700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c14bfb0 con 0 2020-01-26T15:32:25.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.108 7f9790c62700 1 -- 172.21.15.170:0/1439105543 learned_addr learned my addr 172.21.15.170:0/1439105543 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f977c0039b0 con 0x7f978c1481d0 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (720414636 0 0) 0x7f977c003d30 con 0x7f978c1481d0 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f976c002a20 con 0 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f97740022a0 con 0x7f978c14b4d0 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (792515950 0 0) 0x7f9774002620 con 0x7f978c14b4d0 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f976c0046c0 con 0 2020-01-26T15:32:25.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3910184460 0 0) 0x7f977c004300 con 0x7f978c1481d0 2020-01-26T15:32:25.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 >> 172.21.15.170:6790/0 conn(0x7f978c14b4d0 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:32:25.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c07aae0 con 0 2020-01-26T15:32:25.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f978c0ea0f0 con 0x7f978c1481d0 2020-01-26T15:32:25.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f978b7fe700 1 -- 172.21.15.170:0/1439105543 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f977c0013d0 con 0x7f978c1481d0 2020-01-26T15:32:25.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f9792c3c700 1 -- 172.21.15.170:0/1439105543 >> 172.21.15.170:6789/0 conn(0x7f978c1481d0 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:32:25.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f9792c3c700 1 -- 172.21.15.170:0/1439105543 shutdown_connections 2020-01-26T15:32:25.117 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f9792c3c700 1 -- 172.21.15.170:0/1439105543 shutdown_connections 2020-01-26T15:32:25.117 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f9792c3c700 1 -- 172.21.15.170:0/1439105543 wait complete. 2020-01-26T15:32:25.117 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.112 7f9792c3c700 1 -- 172.21.15.170:0/1439105543 >> 172.21.15.170:0/1439105543 conn(0x7f978c144100 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:25.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9792c3c700 1 Processor -- start 2020-01-26T15:32:25.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9792c3c700 1 -- - start start 2020-01-26T15:32:25.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9792c3c700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c0a3e60 con 0 2020-01-26T15:32:25.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9792c3c700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c0a6c30 con 0 2020-01-26T15:32:25.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9790c62700 1 -- 172.21.15.170:0/1960005612 learned_addr learned my addr 172.21.15.170:0/1960005612 2020-01-26T15:32:25.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f977c0011d0 con 0x7f978c0a3470 2020-01-26T15:32:25.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2464004510 0 0) 0x7f977c0018f0 con 0x7f978c0a3470 2020-01-26T15:32:25.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9770002960 con 0 2020-01-26T15:32:25.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f9774002b60 con 0x7f978c0a6480 2020-01-26T15:32:25.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3005179735 0 0) 0x7f97740020e0 con 0x7f978c0a6480 2020-01-26T15:32:25.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9770004620 con 0 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3323584053 0 0) 0x7f977c001d40 con 0x7f978c0a3470 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9770002ee0 con 0 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1033944960 0 0) 0x7f9774002470 con 0x7f978c0a6480 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9770003540 con 0 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1087960758 0 0) 0x7f977c0039a0 con 0x7f978c0a3470 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 >> 172.21.15.170:6791/0 conn(0x7f978c0a6480 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:32:25.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c07ad40 con 0 2020-01-26T15:32:25.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.116 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0b2b10 con 0 2020-01-26T15:32:25.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.120 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c18b270 con 0 2020-01-26T15:32:25.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.120 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f977c0016e0 con 0x7f978c0a3470 2020-01-26T15:32:25.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.120 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f977c0045e0 con 0x7f978c0a3470 2020-01-26T15:32:25.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.120 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f977c004d40 con 0x7f978c0a3470 2020-01-26T15:32:25.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.120 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2187154358 0 0) 0x7f977c0050c0 con 0x7f978c0a3470 2020-01-26T15:32:25.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.120 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c07b0a0 con 0 2020-01-26T15:32:25.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.124 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f978c07b0a0 con 0x7f978c0a3470 2020-01-26T15:32:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.220 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "mimic"} v 0) v1 -- 0x7f978c073440 con 0 2020-01-26T15:32:25.430 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.428 7f9789ffb700 1 -- 172.21.15.170:0/1960005612 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "mimic"}]=0 set require_min_compat_client to mimic v17) v1 ==== 139+0+0 (4159765547 0 0) 0x7f977c004820 con 0x7f978c0a3470 2020-01-26T15:32:25.437 INFO:teuthology.orchestra.run.smithi170.stderr:set require_min_compat_client to mimic 2020-01-26T15:32:25.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.436 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 >> 172.21.15.170:6800/11008 conn(0x7f9770006ed0 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:32:25.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.436 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 >> 172.21.15.170:6789/0 conn(0x7f978c0a3470 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:32:25.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.436 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 shutdown_connections 2020-01-26T15:32:25.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.436 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 shutdown_connections 2020-01-26T15:32:25.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.436 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 wait complete. 2020-01-26T15:32:25.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.436 7f9792c3c700 1 -- 172.21.15.170:0/1960005612 >> 172.21.15.170:0/1960005612 conn(0x7f978c099580 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:25.450 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:32:25.463 INFO:teuthology.task.print:**** done ceph 2020-01-26T15:32:25.463 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-01-26T15:32:25.485 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-01-26T15:32:25.485 INFO:tasks.ceph_fuse:config is None 2020-01-26T15:32:25.486 INFO:tasks.ceph_fuse:new config is {'client.1': None, 'client.0': None} 2020-01-26T15:32:25.486 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-01-26T15:32:25.486 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:25.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.584 7f9601255700 1 Processor -- start 2020-01-26T15:32:25.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.584 7f9601255700 1 -- - start start 2020-01-26T15:32:25.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.584 7f9601255700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc14bb10 con 0 2020-01-26T15:32:25.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f9601255700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc14beb0 con 0 2020-01-26T15:32:25.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fb269700 1 -- 172.21.15.170:0/3991182539 learned_addr learned my addr 172.21.15.170:0/3991182539 2020-01-26T15:32:25.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ec003630 con 0x7f95fc1480d0 2020-01-26T15:32:25.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1810639110 0 0) 0x7f95ec0039b0 con 0x7f95fc1480d0 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95e8002a20 con 0 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95f00022a0 con 0x7f95fc14b3d0 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (632537632 0 0) 0x7f95f00025a0 con 0x7f95fc14b3d0 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95e80046c0 con 0 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2177632685 0 0) 0x7f95ec003f80 con 0x7f95fc1480d0 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 >> 172.21.15.170:6791/0 conn(0x7f95fc14b3d0 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-01-26T15:32:25.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc07a930 con 0 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f95fc0e9ff0 con 0x7f95fc1480d0 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f95fa267700 1 -- 172.21.15.170:0/3991182539 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ec001050 con 0x7f95fc1480d0 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f9601255700 1 -- 172.21.15.170:0/3991182539 >> 172.21.15.170:6789/0 conn(0x7f95fc1480d0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f9601255700 1 -- 172.21.15.170:0/3991182539 shutdown_connections 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f9601255700 1 -- 172.21.15.170:0/3991182539 shutdown_connections 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f9601255700 1 -- 172.21.15.170:0/3991182539 wait complete. 2020-01-26T15:32:25.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.588 7f9601255700 1 -- 172.21.15.170:0/3991182539 >> 172.21.15.170:0/3991182539 conn(0x7f95fc144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:25.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f9601255700 1 Processor -- start 2020-01-26T15:32:25.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f9601255700 1 -- - start start 2020-01-26T15:32:25.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f9601255700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0a3d40 con 0 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f9601255700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0a6b10 con 0 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95fb269700 1 -- 172.21.15.170:0/2262309187 learned_addr learned my addr 172.21.15.170:0/2262309187 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ec000e50 con 0x7f95fc0a3350 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95f0002ae0 con 0x7f95fc0a6360 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1822074977 0 0) 0x7f95ec003380 con 0x7f95fc0a3350 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95dc002df0 con 0 2020-01-26T15:32:25.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3992390151 0 0) 0x7f95f00020e0 con 0x7f95fc0a6360 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95dc004620 con 0 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2688035077 0 0) 0x7f95ec003750 con 0x7f95fc0a3350 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f95dc004df0 con 0 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (433743889 0 0) 0x7f95f0002470 con 0x7f95fc0a6360 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.592 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f95dc0034b0 con 0 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2017464186 0 0) 0x7f95ec001810 con 0x7f95fc0a3350 2020-01-26T15:32:25.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 >> 172.21.15.170:6789/0 conn(0x7f95fc0a6360 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc07ab90 con 0 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f9601255700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0712f0 con 0 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f9601255700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc18b200 con 0 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f95ec000bf0 con 0x7f95fc0a3350 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ec001c40 con 0x7f95fc0a3350 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f95ec004750 con 0x7f95fc0a3350 2020-01-26T15:32:25.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.596 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f95ec006080 con 0x7f95fc0a3350 2020-01-26T15:32:25.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.600 7f9601255700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d8002070 con 0 2020-01-26T15:32:25.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.604 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f95ec004230 con 0x7f95fc0a3350 2020-01-26T15:32:25.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.700 7f9601255700 1 -- 172.21.15.170:0/2262309187 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95d8001220 con 0 2020-01-26T15:32:25.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.700 7f95f8a64700 1 -- 172.21.15.170:0/2262309187 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+6330 (3225238715 0 1927210921) 0x7f95ec006320 con 0x7f95fc0a3350 2020-01-26T15:32:25.704 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:25.704 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:25.428987","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:25.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.704 7f9601255700 1 -- 172.21.15.170:0/2262309187 >> 172.21.15.170:6800/11008 conn(0x7f95dc0072a0 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:32:25.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.704 7f9601255700 1 -- 172.21.15.170:0/2262309187 >> 172.21.15.170:6791/0 conn(0x7f95fc0a3350 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:32:25.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.704 7f9601255700 1 -- 172.21.15.170:0/2262309187 shutdown_connections 2020-01-26T15:32:25.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.704 7f9601255700 1 -- 172.21.15.170:0/2262309187 shutdown_connections 2020-01-26T15:32:25.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.704 7f9601255700 1 -- 172.21.15.170:0/2262309187 wait complete. 2020-01-26T15:32:25.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.704 7f9601255700 1 -- 172.21.15.170:0/2262309187 >> 172.21.15.170:0/2262309187 conn(0x7f95fc099710 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:25.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:11.534039', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.037219', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.435582', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:32:25.717 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:32:25.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 Processor -- start 2020-01-26T15:32:25.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- - start start 2020-01-26T15:32:25.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030414bb50 con 0 2020-01-26T15:32:25.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030414bef0 con 0 2020-01-26T15:32:25.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f03037fe700 1 -- 172.21.15.170:0/4117654032 learned_addr learned my addr 172.21.15.170:0/4117654032 2020-01-26T15:32:25.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f02f4003630 con 0x7f0304148110 2020-01-26T15:32:25.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4010984939 0 0) 0x7f02f40039b0 con 0x7f0304148110 2020-01-26T15:32:25.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e4002a20 con 0 2020-01-26T15:32:25.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f02ec0022a0 con 0x7f030414b410 2020-01-26T15:32:25.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1270985767 0 0) 0x7f02ec0025a0 con 0x7f030414b410 2020-01-26T15:32:25.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e40046c0 con 0 2020-01-26T15:32:25.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (402798158 0 0) 0x7f02f4003f80 con 0x7f0304148110 2020-01-26T15:32:25.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 >> 172.21.15.170:6789/0 conn(0x7f030414b410 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:32:25.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030407a8b0 con 0 2020-01-26T15:32:25.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f03040ea030 con 0x7f0304148110 2020-01-26T15:32:25.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- 172.21.15.170:0/4117654032 >> 172.21.15.170:6790/0 conn(0x7f0304148110 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-01-26T15:32:25.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0302ffd700 1 -- 172.21.15.170:0/4117654032 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f02f4001050 con 0x7f0304148110 2020-01-26T15:32:25.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- 172.21.15.170:0/4117654032 shutdown_connections 2020-01-26T15:32:25.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- 172.21.15.170:0/4117654032 shutdown_connections 2020-01-26T15:32:25.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- 172.21.15.170:0/4117654032 wait complete. 2020-01-26T15:32:25.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.812 7f0309cf2700 1 -- 172.21.15.170:0/4117654032 >> 172.21.15.170:0/4117654032 conn(0x7f0304144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:25.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f0309cf2700 1 Processor -- start 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f0309cf2700 1 -- - start start 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f0309cf2700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040a3c50 con 0 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f0309cf2700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040a6a20 con 0 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03037fe700 1 -- 172.21.15.170:0/2583332269 learned_addr learned my addr 172.21.15.170:0/2583332269 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f02ec002ae0 con 0x7f03040a6270 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (306194462 0 0) 0x7f02ec0020b0 con 0x7f03040a6270 2020-01-26T15:32:25.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e8002960 con 0 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f02f4000e50 con 0x7f03040a3260 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2267188197 0 0) 0x7f02f4001570 con 0x7f03040a3260 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e8004620 con 0 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (100083804 0 0) 0x7f02f40018f0 con 0x7f03040a3260 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02e8002ee0 con 0 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1852981304 0 0) 0x7f02ec000e50 con 0x7f03040a6270 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02e8003540 con 0 2020-01-26T15:32:25.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2870505063 0 0) 0x7f02f4003380 con 0x7f03040a3260 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 >> 172.21.15.170:6791/0 conn(0x7f03040a6270 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030407ab10 con 0 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040b28d0 con 0 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f030418b1b0 con 0 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f02f4000bf0 con 0x7f03040a3260 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f02f40037b0 con 0x7f03040a3260 2020-01-26T15:32:25.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f02f40039f0 con 0x7f03040a3260 2020-01-26T15:32:25.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.816 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f02f4005da0 con 0x7f03040a3260 2020-01-26T15:32:25.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.824 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc002070 con 0 2020-01-26T15:32:25.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.828 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f02f40044e0 con 0x7f03040a3260 2020-01-26T15:32:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.920 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f02dc001270 con 0 2020-01-26T15:32:25.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.920 7f03017fa700 1 -- 172.21.15.170:0/2583332269 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v17) v1 ==== 92+0+10 (4061927567 0 265718887) 0x7f02f40048b0 con 0x7f03040a3260 2020-01-26T15:32:25.925 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:25.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.924 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 >> 172.21.15.170:6800/11008 conn(0x7f02e8006ed0 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:32:25.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.924 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 >> 172.21.15.170:6790/0 conn(0x7f03040a3260 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:32:25.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.924 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 shutdown_connections 2020-01-26T15:32:25.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.924 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 shutdown_connections 2020-01-26T15:32:25.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.924 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 wait complete. 2020-01-26T15:32:25.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:25.924 7f0309cf2700 1 -- 172.21.15.170:0/2583332269 >> 172.21.15.170:0/2583332269 conn(0x7f0304099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:25.936 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:32:26.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 Processor -- start 2020-01-26T15:32:26.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- - start start 2020-01-26T15:32:26.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320814bb40 con 0 2020-01-26T15:32:26.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320814bee0 con 0 2020-01-26T15:32:26.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3207fff700 1 -- 172.21.15.170:0/3831730025 learned_addr learned my addr 172.21.15.170:0/3831730025 2020-01-26T15:32:26.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31f0002220 con 0x7f320814b400 2020-01-26T15:32:26.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3666346960 0 0) 0x7f31f00025a0 con 0x7f320814b400 2020-01-26T15:32:26.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31e8002a20 con 0 2020-01-26T15:32:26.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32000039b0 con 0x7f3208148100 2020-01-26T15:32:26.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3123067676 0 0) 0x7f3200003cb0 con 0x7f3208148100 2020-01-26T15:32:26.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31e80046c0 con 0 2020-01-26T15:32:26.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (208213417 0 0) 0x7f31f0002b20 con 0x7f320814b400 2020-01-26T15:32:26.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 >> 172.21.15.170:6791/0 conn(0x7f3208148100 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:32:26.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320807a8a0 con 0 2020-01-26T15:32:26.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f31f0000bf0 con 0x7f320814b400 2020-01-26T15:32:26.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- 172.21.15.170:0/3831730025 >> 172.21.15.170:6790/0 conn(0x7f320814b400 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:32:26.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f3206ffd700 1 -- 172.21.15.170:0/3831730025 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31f0001010 con 0x7f320814b400 2020-01-26T15:32:26.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- 172.21.15.170:0/3831730025 shutdown_connections 2020-01-26T15:32:26.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- 172.21.15.170:0/3831730025 shutdown_connections 2020-01-26T15:32:26.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- 172.21.15.170:0/3831730025 wait complete. 2020-01-26T15:32:26.036 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.028 7f320e1f3700 1 -- 172.21.15.170:0/3831730025 >> 172.21.15.170:0/3831730025 conn(0x7f3208144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:26.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f320e1f3700 1 Processor -- start 2020-01-26T15:32:26.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f320e1f3700 1 -- - start start 2020-01-26T15:32:26.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f320e1f3700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080a3e20 con 0 2020-01-26T15:32:26.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f320e1f3700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080a3590 con 0 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f3207fff700 1 -- 172.21.15.170:0/862314536 learned_addr learned my addr 172.21.15.170:0/862314536 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f32000042e0 con 0x7f3208095cf0 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1710471543 0 0) 0x7f3200003840 con 0x7f3208095cf0 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f32057fa700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31ec002960 con 0 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f31f0000e50 con 0x7f32080a51e0 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2266690272 0 0) 0x7f31f0001530 con 0x7f32080a51e0 2020-01-26T15:32:26.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.032 7f32057fa700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31ec004620 con 0 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (125507277 0 0) 0x7f32000011d0 con 0x7f3208095cf0 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31ec002ee0 con 0 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1525760600 0 0) 0x7f31f0001900 con 0x7f32080a51e0 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31ec003540 con 0 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2514615557 0 0) 0x7f3200001770 con 0x7f3208095cf0 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 >> 172.21.15.170:6789/0 conn(0x7f32080a51e0 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:32:26.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320807ab00 con 0 2020-01-26T15:32:26.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f320e1f3700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3208071190 con 0 2020-01-26T15:32:26.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3200000f70 con 0x7f3208095cf0 2020-01-26T15:32:26.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f320e1f3700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f32080a6bd0 con 0 2020-01-26T15:32:26.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f3200001ba0 con 0x7f3208095cf0 2020-01-26T15:32:26.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f3200004b00 con 0x7f3208095cf0 2020-01-26T15:32:26.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.036 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f32000045e0 con 0x7f3208095cf0 2020-01-26T15:32:26.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.040 7f320e1f3700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320807ae80 con 0 2020-01-26T15:32:26.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.044 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f320807ae80 con 0x7f3208095cf0 2020-01-26T15:32:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.132 7f320e1f3700 1 -- 172.21.15.170:0/862314536 --> 172.21.15.170:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f3208073250 con 0 2020-01-26T15:32:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f32057fa700 1 -- 172.21.15.170:0/862314536 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v17) v1 ==== 104+0+10 (1945638983 0 265718887) 0x7f3200004de0 con 0x7f3208095cf0 2020-01-26T15:32:26.138 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:26.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f320e1f3700 1 -- 172.21.15.170:0/862314536 >> 172.21.15.170:6800/11008 conn(0x7f31ec006ed0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:32:26.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f320e1f3700 1 -- 172.21.15.170:0/862314536 >> 172.21.15.170:6791/0 conn(0x7f3208095cf0 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:32:26.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f320e1f3700 1 -- 172.21.15.170:0/862314536 shutdown_connections 2020-01-26T15:32:26.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f320e1f3700 1 -- 172.21.15.170:0/862314536 shutdown_connections 2020-01-26T15:32:26.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f320e1f3700 1 -- 172.21.15.170:0/862314536 wait complete. 2020-01-26T15:32:26.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.136 7f320e1f3700 1 -- 172.21.15.170:0/862314536 >> 172.21.15.170:0/862314536 conn(0x7f3208099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:26.153 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:32:26.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.240 7f0481c28700 1 Processor -- start 2020-01-26T15:32:26.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.240 7f0481c28700 1 -- - start start 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c14bb50 con 0 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c14bef0 con 0 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047b7fe700 1 -- 172.21.15.170:0/1444628582 learned_addr learned my addr 172.21.15.170:0/1444628582 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f046c0039b0 con 0x7f047c148110 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (920765941 0 0) 0x7f046c003d30 con 0x7f047c148110 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0468002a20 con 0 2020-01-26T15:32:26.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f04700022a0 con 0x7f047c14b410 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1362753540 0 0) 0x7f0470002620 con 0x7f047c14b410 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f04680046c0 con 0 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2645721944 0 0) 0x7f046c004300 con 0x7f047c148110 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 >> 172.21.15.170:6790/0 conn(0x7f047c14b410 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c07a8b0 con 0 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f047c0ea030 con 0x7f047c148110 2020-01-26T15:32:26.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f047a7fc700 1 -- 172.21.15.170:0/1444628582 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f046c0013d0 con 0x7f047c148110 2020-01-26T15:32:26.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- 172.21.15.170:0/1444628582 >> 172.21.15.170:6789/0 conn(0x7f047c148110 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-01-26T15:32:26.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- 172.21.15.170:0/1444628582 shutdown_connections 2020-01-26T15:32:26.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- 172.21.15.170:0/1444628582 shutdown_connections 2020-01-26T15:32:26.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- 172.21.15.170:0/1444628582 wait complete. 2020-01-26T15:32:26.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.244 7f0481c28700 1 -- 172.21.15.170:0/1444628582 >> 172.21.15.170:0/1444628582 conn(0x7f047c144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:26.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0481c28700 1 Processor -- start 2020-01-26T15:32:26.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0481c28700 1 -- - start start 2020-01-26T15:32:26.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0481c28700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c0a3d30 con 0 2020-01-26T15:32:26.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0481c28700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c095d60 con 0 2020-01-26T15:32:26.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f047affd700 1 -- 172.21.15.170:0/1284647831 learned_addr learned my addr 172.21.15.170:0/1284647831 2020-01-26T15:32:26.255 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f04700020e0 con 0x7f047c0a50f0 2020-01-26T15:32:26.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (543141885 0 0) 0x7f04700023e0 con 0x7f047c0a50f0 2020-01-26T15:32:26.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f045c002960 con 0 2020-01-26T15:32:26.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f046c0011d0 con 0x7f047c0a3340 2020-01-26T15:32:26.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3867048975 0 0) 0x7f046c0018f0 con 0x7f047c0a3340 2020-01-26T15:32:26.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f045c004620 con 0 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4151431138 0 0) 0x7f0470000e50 con 0x7f047c0a50f0 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f045c002ee0 con 0 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (470579254 0 0) 0x7f046c001c70 con 0x7f047c0a3340 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.248 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f045c003540 con 0 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (10865655 0 0) 0x7f046c003700 con 0x7f047c0a3340 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 >> 172.21.15.170:6789/0 conn(0x7f047c0a50f0 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:32:26.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c07ab10 con 0 2020-01-26T15:32:26.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0481c28700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c0b28d0 con 0 2020-01-26T15:32:26.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0481c28700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c0a6b30 con 0 2020-01-26T15:32:26.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f046c0016e0 con 0x7f047c0a3340 2020-01-26T15:32:26.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f046c003d40 con 0x7f047c0a3340 2020-01-26T15:32:26.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f046c0049e0 con 0x7f047c0a3340 2020-01-26T15:32:26.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.252 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f046c0044c0 con 0x7f047c0a3340 2020-01-26T15:32:26.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.256 7f0481c28700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c07ae90 con 0 2020-01-26T15:32:26.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.260 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f047c07ae90 con 0x7f047c0a3340 2020-01-26T15:32:26.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.352 7f0481c28700 1 -- 172.21.15.170:0/1284647831 --> 172.21.15.170:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f047c073260 con 0 2020-01-26T15:32:26.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.352 7f0478ff9700 1 -- 172.21.15.170:0/1284647831 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v17) v1 ==== 100+0+10 (2880496653 0 265718887) 0x7f046c004d60 con 0x7f047c0a3340 2020-01-26T15:32:26.357 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:26.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.356 7f0481c28700 1 -- 172.21.15.170:0/1284647831 >> 172.21.15.170:6800/11008 conn(0x7f045c006e70 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:32:26.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.356 7f0481c28700 1 -- 172.21.15.170:0/1284647831 >> 172.21.15.170:6791/0 conn(0x7f047c0a3340 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:32:26.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.356 7f0481c28700 1 -- 172.21.15.170:0/1284647831 shutdown_connections 2020-01-26T15:32:26.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.356 7f0481c28700 1 -- 172.21.15.170:0/1284647831 shutdown_connections 2020-01-26T15:32:26.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.356 7f0481c28700 1 -- 172.21.15.170:0/1284647831 wait complete. 2020-01-26T15:32:26.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.356 7f0481c28700 1 -- 172.21.15.170:0/1284647831 >> 172.21.15.170:0/1284647831 conn(0x7f047c099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:26.368 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-01-26T15:32:26.368 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:26.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.456 7f2137b28700 1 Processor -- start 2020-01-26T15:32:26.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.456 7f2137b28700 1 -- - start start 2020-01-26T15:32:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213014bba0 con 0 2020-01-26T15:32:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213014bf40 con 0 2020-01-26T15:32:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f213534d700 1 -- 172.21.15.170:0/3317383984 learned_addr learned my addr 172.21.15.170:0/3317383984 2020-01-26T15:32:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2120003630 con 0x7f213014b460 2020-01-26T15:32:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f212c0022a0 con 0x7f2130148160 2020-01-26T15:32:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2635182172 0 0) 0x7f21200039b0 con 0x7f213014b460 2020-01-26T15:32:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2114002ea0 con 0 2020-01-26T15:32:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3924691305 0 0) 0x7f212c002620 con 0x7f2130148160 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f21140046b0 con 0 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3259759170 0 0) 0x7f2120003ea0 con 0x7f213014b460 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 >> 172.21.15.170:6790/0 conn(0x7f2130148160 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213007a9c0 con 0 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2130116f10 con 0x7f213014b460 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2134b4c700 1 -- 172.21.15.170:0/3317383984 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2120001010 con 0x7f213014b460 2020-01-26T15:32:26.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- 172.21.15.170:0/3317383984 >> 172.21.15.170:6789/0 conn(0x7f213014b460 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:32:26.466 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- 172.21.15.170:0/3317383984 shutdown_connections 2020-01-26T15:32:26.466 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- 172.21.15.170:0/3317383984 shutdown_connections 2020-01-26T15:32:26.466 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- 172.21.15.170:0/3317383984 wait complete. 2020-01-26T15:32:26.466 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- 172.21.15.170:0/3317383984 >> 172.21.15.170:0/3317383984 conn(0x7f2130144090 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:26.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 Processor -- start 2020-01-26T15:32:26.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- - start start 2020-01-26T15:32:26.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300a3e20 con 0 2020-01-26T15:32:26.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.460 7f2137b28700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300a6b60 con 0 2020-01-26T15:32:26.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2135b4e700 1 -- 172.21.15.170:0/3882966094 learned_addr learned my addr 172.21.15.170:0/3882966094 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f212c002080 con 0x7f21300a3430 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2120000e50 con 0x7f21300a63b0 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1024967701 0 0) 0x7f212c002400 con 0x7f21300a3430 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2118002df0 con 0 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1772372513 0 0) 0x7f21200033e0 con 0x7f21300a63b0 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2118004620 con 0 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3853984476 0 0) 0x7f212c000e50 con 0x7f21300a3430 2020-01-26T15:32:26.470 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2118004df0 con 0 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3988111997 0 0) 0x7f2120003760 con 0x7f21300a63b0 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f21180034b0 con 0 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1432512897 0 0) 0x7f212c0013f0 con 0x7f21300a3430 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 >> 172.21.15.170:6790/0 conn(0x7f21300a63b0 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213007ac20 con 0 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2137b28700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21300b2840 con 0 2020-01-26T15:32:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2137b28700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f213018b230 con 0 2020-01-26T15:32:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f212c000bf0 con 0x7f21300a3430 2020-01-26T15:32:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f212c001820 con 0x7f21300a3430 2020-01-26T15:32:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f212c0044b0 con 0x7f21300a3430 2020-01-26T15:32:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.464 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f212c003f90 con 0x7f21300a3430 2020-01-26T15:32:26.475 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.472 7f2137b28700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213007afc0 con 0 2020-01-26T15:32:26.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.476 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f213007afc0 con 0x7f21300a3430 2020-01-26T15:32:26.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.568 7f2137b28700 1 -- 172.21.15.170:0/3882966094 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f213018ba30 con 0 2020-01-26T15:32:26.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.568 7f2126ffd700 1 -- 172.21.15.170:0/3882966094 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2262 (882253904 0 1822045022) 0x7f212c004840 con 0x7f21300a3430 2020-01-26T15:32:26.573 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 9 2020-01-26T15:32:26.574 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:26.574 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:20.414222","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.572 7f2137b28700 1 -- 172.21.15.170:0/3882966094 >> 172.21.15.170:6800/11008 conn(0x7f21180072a0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:32:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.572 7f2137b28700 1 -- 172.21.15.170:0/3882966094 >> 172.21.15.170:6791/0 conn(0x7f21300a3430 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-01-26T15:32:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.572 7f2137b28700 1 -- 172.21.15.170:0/3882966094 shutdown_connections 2020-01-26T15:32:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.572 7f2137b28700 1 -- 172.21.15.170:0/3882966094 shutdown_connections 2020-01-26T15:32:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.572 7f2137b28700 1 -- 172.21.15.170:0/3882966094 wait complete. 2020-01-26T15:32:26.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:26.572 7f2137b28700 1 -- 172.21.15.170:0/3882966094 >> 172.21.15.170:0/3882966094 conn(0x7f2130099590 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:26.886 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 9, u'flags': 18, u'max_mds': 2, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:20.414222', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:26.886 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-01-26T15:32:26.887 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-01-26T15:32:26.984 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:26.984 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 1, 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4203, 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 7.570953, 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 9, 2020-01-26T15:32:26.987 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 17, 2020-01-26T15:32:26.988 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:32:26.990 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 9.466144 2020-01-26T15:32:26.990 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:26.991 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 1, "id": 4203, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.570953, "mdsmap_epoch": 9, "osdmap_epoch": 17, "osdmap_epoch_barrier": 16, "uptime": 9.466144 } 2020-01-26T15:32:26.991 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:32:27.073 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4225, 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 8.672427, 2020-01-26T15:32:27.074 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 9, 2020-01-26T15:32:27.075 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 17, 2020-01-26T15:32:27.075 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:32:27.075 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 9.572273 2020-01-26T15:32:27.075 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:27.080 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 0, "id": 4225, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.672427, "mdsmap_epoch": 9, "osdmap_epoch": 17, "osdmap_epoch_barrier": 16, "uptime": 9.572273 } 2020-01-26T15:32:27.080 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-01-26T15:32:27.086 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-01-26T15:32:27.086 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi163.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-01-26T15:32:27.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:27.087 INFO:teuthology.orchestra.run.smithi163:> mkdir -p /home/ubuntu/cephtest/mnt.1 2020-01-26T15:32:27.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:27.096 INFO:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:32:27.152 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:32:27.154 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:32:27.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:27.155 INFO:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2020-01-26T15:32:27.202 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-01-26T15:32:27.202 INFO:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1 2020-01-26T15:32:27.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:27.242 INFO:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:32:27.257 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:32:27.261 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:32:27.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:27.262 INFO:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2020-01-26T15:32:27.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi163.stderr:2020-01-26 15:32:27.323 7f41bee65b80 -1 init, newargv = 0x55abd0b447c0 newargc=7 2020-01-26T15:32:27.329 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi163.stderr:ceph-fuse[10033]: starting ceph client 2020-01-26T15:32:27.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi163.stderr:ceph-fuse[10033]: starting fuse 2020-01-26T15:32:28.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:28.409 INFO:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:32:28.425 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:32:28.428 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:32:28.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:28.428 INFO:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2020-01-26T15:32:28.478 INFO:teuthology.orchestra.run.smithi163.stdout:49 2020-01-26T15:32:28.479 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-01-26T15:32:28.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:28.479 INFO:teuthology.orchestra.run.smithi163:> sudo python3 -c ' 2020-01-26T15:32:28.479 INFO:teuthology.orchestra.run.smithi163:> import glob 2020-01-26T15:32:28.479 INFO:teuthology.orchestra.run.smithi163:> import re 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> import os 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> import subprocess 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> def find_socket(client_name): 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> 2020-01-26T15:32:28.480 INFO:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> return files[0] 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> for f in files: 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2020-01-26T15:32:28.481 INFO:teuthology.orchestra.run.smithi163:> return f 2020-01-26T15:32:28.482 INFO:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-01-26T15:32:28.482 INFO:teuthology.orchestra.run.smithi163:> 2020-01-26T15:32:28.482 INFO:teuthology.orchestra.run.smithi163:> print(find_socket("client.1")) 2020-01-26T15:32:28.482 INFO:teuthology.orchestra.run.smithi163:> ' 2020-01-26T15:32:28.587 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.1.10033.asok 2020-01-26T15:32:28.587 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.10033.asok 2020-01-26T15:32:28.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:28.588 INFO:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.10033.asok status 2020-01-26T15:32:28.806 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2020-01-26T15:32:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2020-01-26T15:32:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "e1c5fd9306ce839d8d3ac8160c57aba42e0231a8", 2020-01-26T15:32:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 13.2.8-63-ge1c5fd9 (e1c5fd9306ce839d8d3ac8160c57aba42e0231a8) mimic (stable)", 2020-01-26T15:32:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "1", 2020-01-26T15:32:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2020-01-26T15:32:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "10033", 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/" 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 4338, 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2020-01-26T15:32:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 4338 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 2683019854, 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0" 2020-01-26T15:32:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: } 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.4338 172.21.15.163:0/2683019854", 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "172.21.15.163:0/2683019854", 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 1, 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 9, 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 17, 2020-01-26T15:32:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2020-01-26T15:32:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "blacklisted": false 2020-01-26T15:32:28.811 INFO:teuthology.orchestra.run.smithi163.stdout:} 2020-01-26T15:32:28.811 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:28.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.908 7f1473621700 1 Processor -- start 2020-01-26T15:32:28.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.908 7f1473621700 1 -- - start start 2020-01-26T15:32:28.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.908 7f1473621700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c14bb60 con 0 2020-01-26T15:32:28.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.908 7f1473621700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c14bf00 con 0 2020-01-26T15:32:28.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f1470e46700 1 -- 172.21.15.170:0/286969506 learned_addr learned my addr 172.21.15.170:0/286969506 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1458003630 con 0x7f146c14b3d0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1357313108 0 0) 0x7f14580039b0 con 0x7f146c14b3d0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1450002a20 con 0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1460002620 con 0x7f146c1480d0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3728433696 0 0) 0x7f1460002920 con 0x7f146c1480d0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f14500046c0 con 0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (254300931 0 0) 0x7f1458003f80 con 0x7f146c14b3d0 2020-01-26T15:32:28.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 >> 172.21.15.170:6791/0 conn(0x7f146c1480d0 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-01-26T15:32:28.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c07a930 con 0 2020-01-26T15:32:28.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f146c116e80 con 0x7f146c14b3d0 2020-01-26T15:32:28.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f1473621700 1 -- 172.21.15.170:0/286969506 >> 172.21.15.170:6790/0 conn(0x7f146c14b3d0 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-01-26T15:32:28.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f146bfff700 1 -- 172.21.15.170:0/286969506 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1458001050 con 0x7f146c14b3d0 2020-01-26T15:32:28.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f1473621700 1 -- 172.21.15.170:0/286969506 shutdown_connections 2020-01-26T15:32:28.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f1473621700 1 -- 172.21.15.170:0/286969506 shutdown_connections 2020-01-26T15:32:28.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f1473621700 1 -- 172.21.15.170:0/286969506 wait complete. 2020-01-26T15:32:28.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.912 7f1473621700 1 -- 172.21.15.170:0/286969506 >> 172.21.15.170:0/286969506 conn(0x7f146c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:28.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1473621700 1 Processor -- start 2020-01-26T15:32:28.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1473621700 1 -- - start start 2020-01-26T15:32:28.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1473621700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c0a3e50 con 0 2020-01-26T15:32:28.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1473621700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c0a6bd0 con 0 2020-01-26T15:32:28.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1470e46700 1 -- 172.21.15.170:0/2435024893 learned_addr learned my addr 172.21.15.170:0/2435024893 2020-01-26T15:32:28.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1458000e50 con 0x7f146c0a6420 2020-01-26T15:32:28.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3701638189 0 0) 0x7f1458003380 con 0x7f146c0a6420 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1454002960 con 0 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1460002e60 con 0x7f146c0a3410 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1921410755 0 0) 0x7f1460002460 con 0x7f146c0a3410 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1454004620 con 0 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (655490776 0 0) 0x7f14580037d0 con 0x7f146c0a6420 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1454002ee0 con 0 2020-01-26T15:32:28.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3544572256 0 0) 0x7f1460002870 con 0x7f146c0a3410 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1454003540 con 0 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (316247957 0 0) 0x7f1458001810 con 0x7f146c0a6420 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 >> 172.21.15.170:6789/0 conn(0x7f146c0a3410 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c07ab90 con 0 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1473621700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c0b2940 con 0 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f1473621700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c18b2f0 con 0 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1458001360 con 0x7f146c0a6420 2020-01-26T15:32:28.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f1458001c40 con 0x7f146c0a6420 2020-01-26T15:32:28.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f1458004960 con 0x7f146c0a6420 2020-01-26T15:32:28.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.916 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f14580064c0 con 0x7f146c0a6420 2020-01-26T15:32:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.924 7f1473621700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448002070 con 0 2020-01-26T15:32:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:28.924 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1458004e70 con 0x7f146c0a6420 2020-01-26T15:32:29.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1448001220 con 0 2020-01-26T15:32:29.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f146a7fc700 1 -- 172.21.15.170:0/2435024893 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+6330 (3225238715 0 1927210921) 0x7f1458004440 con 0x7f146c0a6420 2020-01-26T15:32:29.023 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:29.023 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:25.428987","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:29.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 >> 172.21.15.170:6800/11008 conn(0x7f14540065f0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:32:29.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 >> 172.21.15.170:6790/0 conn(0x7f146c0a6420 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-01-26T15:32:29.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 shutdown_connections 2020-01-26T15:32:29.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 shutdown_connections 2020-01-26T15:32:29.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 wait complete. 2020-01-26T15:32:29.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.020 7f1473621700 1 -- 172.21.15.170:0/2435024893 >> 172.21.15.170:0/2435024893 conn(0x7f146c099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:11.534039', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.037219', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.435582', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:32:29.035 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:32:29.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.124 7fd82f770700 1 Processor -- start 2020-01-26T15:32:29.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.124 7fd82f770700 1 -- - start start 2020-01-26T15:32:29.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82814bb50 con 0 2020-01-26T15:32:29.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82814bef0 con 0 2020-01-26T15:32:29.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82d796700 1 -- 172.21.15.170:0/1861727868 learned_addr learned my addr 172.21.15.170:0/1861727868 2020-01-26T15:32:29.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd81c003630 con 0x7fd828148110 2020-01-26T15:32:29.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd820002620 con 0x7fd82814b410 2020-01-26T15:32:29.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1429768604 0 0) 0x7fd81c0039b0 con 0x7fd828148110 2020-01-26T15:32:29.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd80c002f40 con 0 2020-01-26T15:32:29.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1107234243 0 0) 0x7fd8200029a0 con 0x7fd82814b410 2020-01-26T15:32:29.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd80c004750 con 0 2020-01-26T15:32:29.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2347356638 0 0) 0x7fd81c003ea0 con 0x7fd828148110 2020-01-26T15:32:29.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 >> 172.21.15.170:6791/0 conn(0x7fd82814b410 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-01-26T15:32:29.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82807a8b0 con 0 2020-01-26T15:32:29.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd8280ea030 con 0x7fd828148110 2020-01-26T15:32:29.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd81bfff700 1 -- 172.21.15.170:0/1861727868 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd81c001010 con 0x7fd828148110 2020-01-26T15:32:29.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- 172.21.15.170:0/1861727868 >> 172.21.15.170:6789/0 conn(0x7fd828148110 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-01-26T15:32:29.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- 172.21.15.170:0/1861727868 shutdown_connections 2020-01-26T15:32:29.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- 172.21.15.170:0/1861727868 shutdown_connections 2020-01-26T15:32:29.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- 172.21.15.170:0/1861727868 wait complete. 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- 172.21.15.170:0/1861727868 >> 172.21.15.170:0/1861727868 conn(0x7fd828144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 Processor -- start 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.128 7fd82f770700 1 -- - start start 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd82f770700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280a3d10 con 0 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd82f770700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd828095d40 con 0 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd82cf95700 1 -- 172.21.15.170:0/4191424781 learned_addr learned my addr 172.21.15.170:0/4191424781 2020-01-26T15:32:29.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd81c000e50 con 0x7fd8280a3320 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1736767278 0 0) 0x7fd81c0033e0 con 0x7fd8280a3320 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd8100029c0 con 0 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd820002400 con 0x7fd8280a50d0 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1187532779 0 0) 0x7fd820002700 con 0x7fd8280a50d0 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd810004680 con 0 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1724533040 0 0) 0x7fd81c003760 con 0x7fd8280a3320 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd810002f40 con 0 2020-01-26T15:32:29.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (359565977 0 0) 0x7fd8200011d0 con 0x7fd8280a50d0 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd8100035a0 con 0 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1442397548 0 0) 0x7fd81c0017d0 con 0x7fd8280a3320 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 >> 172.21.15.170:6789/0 conn(0x7fd8280a50d0 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82807ab10 con 0 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd82f770700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8280b28d0 con 0 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd82f770700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8280a6ac0 con 0 2020-01-26T15:32:29.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd81c000bf0 con 0x7fd8280a3320 2020-01-26T15:32:29.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd81c001a40 con 0x7fd8280a3320 2020-01-26T15:32:29.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fd81c004780 con 0x7fd8280a3320 2020-01-26T15:32:29.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.132 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fd81c006010 con 0x7fd8280a3320 2020-01-26T15:32:29.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.140 7fd82f770700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804002070 con 0 2020-01-26T15:32:29.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.144 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd81c004260 con 0x7fd8280a3320 2020-01-26T15:32:29.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.236 7fd82f770700 1 -- 172.21.15.170:0/4191424781 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd804001270 con 0 2020-01-26T15:32:29.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd81a7fc700 1 -- 172.21.15.170:0/4191424781 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v17) v1 ==== 92+0+10 (4061927567 0 265718887) 0x7fd81c004530 con 0x7fd8280a3320 2020-01-26T15:32:29.242 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:29.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd82f770700 1 -- 172.21.15.170:0/4191424781 >> 172.21.15.170:6800/11008 conn(0x7fd810006ed0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:32:29.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd82f770700 1 -- 172.21.15.170:0/4191424781 >> 172.21.15.170:6790/0 conn(0x7fd8280a3320 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:32:29.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd82f770700 1 -- 172.21.15.170:0/4191424781 shutdown_connections 2020-01-26T15:32:29.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd82f770700 1 -- 172.21.15.170:0/4191424781 shutdown_connections 2020-01-26T15:32:29.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd82f770700 1 -- 172.21.15.170:0/4191424781 wait complete. 2020-01-26T15:32:29.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.240 7fd82f770700 1 -- 172.21.15.170:0/4191424781 >> 172.21.15.170:0/4191424781 conn(0x7fd828099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.253 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:32:29.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 Processor -- start 2020-01-26T15:32:29.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- - start start 2020-01-26T15:32:29.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23814bb50 con 0 2020-01-26T15:32:29.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23814bef0 con 0 2020-01-26T15:32:29.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23e498700 1 -- 172.21.15.170:0/1187190471 learned_addr learned my addr 172.21.15.170:0/1187190471 2020-01-26T15:32:29.347 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa2280022a0 con 0x7fa23814b410 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1231423263 0 0) 0x7fa228002620 con 0x7fa23814b410 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa220002a20 con 0 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa234003630 con 0x7fa238148110 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3096971051 0 0) 0x7fa2340039b0 con 0x7fa238148110 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa2200046c0 con 0 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3543442022 0 0) 0x7fa228002bf0 con 0x7fa23814b410 2020-01-26T15:32:29.348 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 >> 172.21.15.170:6791/0 conn(0x7fa238148110 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23807a8b0 con 0 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa238116ec0 con 0x7fa23814b410 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23d496700 1 -- 172.21.15.170:0/1187190471 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa228001050 con 0x7fa23814b410 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- 172.21.15.170:0/1187190471 >> 172.21.15.170:6790/0 conn(0x7fa23814b410 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- 172.21.15.170:0/1187190471 shutdown_connections 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- 172.21.15.170:0/1187190471 shutdown_connections 2020-01-26T15:32:29.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- 172.21.15.170:0/1187190471 wait complete. 2020-01-26T15:32:29.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- 172.21.15.170:0/1187190471 >> 172.21.15.170:0/1187190471 conn(0x7fa238144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 Processor -- start 2020-01-26T15:32:29.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- - start start 2020-01-26T15:32:29.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380a3be0 con 0 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa240472700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380a69b0 con 0 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa23e498700 1 -- 172.21.15.170:0/2834933052 learned_addr learned my addr 172.21.15.170:0/2834933052 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa234003470 con 0x7fa2380a31f0 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (489584943 0 0) 0x7fa234003d40 con 0x7fa2380a31f0 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.344 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa218002960 con 0 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa228000e50 con 0x7fa2380a6200 2020-01-26T15:32:29.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (656637468 0 0) 0x7fa228001ff0 con 0x7fa2380a6200 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa218004620 con 0 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4089364298 0 0) 0x7fa234000e50 con 0x7fa2380a31f0 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa218002ee0 con 0 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (358675196 0 0) 0x7fa228002370 con 0x7fa2380a6200 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa218003540 con 0 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1920888770 0 0) 0x7fa234001420 con 0x7fa2380a31f0 2020-01-26T15:32:29.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 >> 172.21.15.170:6791/0 conn(0x7fa2380a6200 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23807ab10 con 0 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa240472700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2380b2870 con 0 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa240472700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23818b140 con 0 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa234000bf0 con 0x7fa2380a31f0 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa234001a60 con 0x7fa2380a31f0 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fa234004780 con 0x7fa2380a31f0 2020-01-26T15:32:29.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fa234006150 con 0x7fa2380a31f0 2020-01-26T15:32:29.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.348 7fa240472700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23807ae90 con 0 2020-01-26T15:32:29.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.352 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa23807ae90 con 0x7fa2380a31f0 2020-01-26T15:32:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa238073260 con 0 2020-01-26T15:32:29.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa2277fe700 1 -- 172.21.15.170:0/2834933052 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v17) v1 ==== 104+0+10 (1945638983 0 265718887) 0x7fa234004d30 con 0x7fa2380a31f0 2020-01-26T15:32:29.439 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 >> 172.21.15.170:6800/11008 conn(0x7fa218006ed0 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:32:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 >> 172.21.15.170:6790/0 conn(0x7fa2380a31f0 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-01-26T15:32:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 shutdown_connections 2020-01-26T15:32:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 shutdown_connections 2020-01-26T15:32:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 wait complete. 2020-01-26T15:32:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.436 7fa240472700 1 -- 172.21.15.170:0/2834933052 >> 172.21.15.170:0/2834933052 conn(0x7fa2380993b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.450 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:32:29.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 Processor -- start 2020-01-26T15:32:29.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- - start start 2020-01-26T15:32:29.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c14bb50 con 0 2020-01-26T15:32:29.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c14bef0 con 0 2020-01-26T15:32:29.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a41726700 1 -- 172.21.15.170:0/1174677337 learned_addr learned my addr 172.21.15.170:0/1174677337 2020-01-26T15:32:29.545 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4a340039b0 con 0x7f4a3c148110 2020-01-26T15:32:29.545 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4a300022a0 con 0x7f4a3c14b410 2020-01-26T15:32:29.545 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (653888292 0 0) 0x7f4a34003d30 con 0x7f4a3c148110 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4a20002f40 con 0 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3401810485 0 0) 0x7f4a30002620 con 0x7f4a3c14b410 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4a20004740 con 0 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3362872293 0 0) 0x7f4a34004220 con 0x7f4a3c148110 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 >> 172.21.15.170:6791/0 conn(0x7f4a3c14b410 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c07a8b0 con 0 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4a34000f70 con 0x7f4a3c148110 2020-01-26T15:32:29.546 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a2ffff700 1 -- 172.21.15.170:0/1174677337 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4a34001390 con 0x7f4a3c148110 2020-01-26T15:32:29.547 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- 172.21.15.170:0/1174677337 >> 172.21.15.170:6789/0 conn(0x7f4a3c148110 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-01-26T15:32:29.547 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- 172.21.15.170:0/1174677337 shutdown_connections 2020-01-26T15:32:29.547 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- 172.21.15.170:0/1174677337 shutdown_connections 2020-01-26T15:32:29.547 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- 172.21.15.170:0/1174677337 wait complete. 2020-01-26T15:32:29.547 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.540 7f4a43700700 1 -- 172.21.15.170:0/1174677337 >> 172.21.15.170:0/1174677337 conn(0x7f4a3c144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a43700700 1 Processor -- start 2020-01-26T15:32:29.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a43700700 1 -- - start start 2020-01-26T15:32:29.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a43700700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c09fbf0 con 0 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a43700700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0a29c0 con 0 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a41726700 1 -- 172.21.15.170:0/1487487097 learned_addr learned my addr 172.21.15.170:0/1487487097 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4a340011d0 con 0x7f4a3c09f200 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3272601434 0 0) 0x7f4a34003760 con 0x7f4a3c09f200 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4a240029c0 con 0 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4a300020e0 con 0x7f4a3c0a2210 2020-01-26T15:32:29.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (403987801 0 0) 0x7f4a300029b0 con 0x7f4a3c0a2210 2020-01-26T15:32:29.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4a24004680 con 0 2020-01-26T15:32:29.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4081092256 0 0) 0x7f4a34003bb0 con 0x7f4a3c09f200 2020-01-26T15:32:29.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4a24002f40 con 0 2020-01-26T15:32:29.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2979814018 0 0) 0x7f4a30000e50 con 0x7f4a3c0a2210 2020-01-26T15:32:29.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4a240035a0 con 0 2020-01-26T15:32:29.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1202163661 0 0) 0x7f4a34001b50 con 0x7f4a3c09f200 2020-01-26T15:32:29.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 >> 172.21.15.170:6790/0 conn(0x7f4a3c0a2210 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c07ab10 con 0 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a43700700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c071280 con 0 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.544 7f4a43700700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c18b4e0 con 0 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.548 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4a3c0ea030 con 0x7f4a3c09f200 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.548 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4a34001dc0 con 0x7f4a3c09f200 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.548 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f4a34004b00 con 0x7f4a3c09f200 2020-01-26T15:32:29.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.548 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f4a34006390 con 0x7f4a3c09f200 2020-01-26T15:32:29.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.556 7f4a43700700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a18002070 con 0 2020-01-26T15:32:29.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.560 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4a340045e0 con 0x7f4a3c09f200 2020-01-26T15:32:29.654 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.652 7f4a43700700 1 -- 172.21.15.170:0/1487487097 --> 172.21.15.170:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f4a18001220 con 0 2020-01-26T15:32:29.655 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.652 7f4a2e7fc700 1 -- 172.21.15.170:0/1487487097 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v17) v1 ==== 100+0+10 (2880496653 0 265718887) 0x7f4a340048b0 con 0x7f4a3c09f200 2020-01-26T15:32:29.655 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.652 7f4a43700700 1 -- 172.21.15.170:0/1487487097 >> 172.21.15.170:6800/11008 conn(0x7f4a24006ed0 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:32:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.652 7f4a43700700 1 -- 172.21.15.170:0/1487487097 >> 172.21.15.170:6789/0 conn(0x7f4a3c09f200 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-01-26T15:32:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.656 7f4a43700700 1 -- 172.21.15.170:0/1487487097 shutdown_connections 2020-01-26T15:32:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.656 7f4a43700700 1 -- 172.21.15.170:0/1487487097 shutdown_connections 2020-01-26T15:32:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.656 7f4a43700700 1 -- 172.21.15.170:0/1487487097 wait complete. 2020-01-26T15:32:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.656 7f4a43700700 1 -- 172.21.15.170:0/1487487097 >> 172.21.15.170:0/1487487097 conn(0x7f4a3c178120 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.667 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-01-26T15:32:29.667 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:29.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624feff700 1 Processor -- start 2020-01-26T15:32:29.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624feff700 1 -- - start start 2020-01-26T15:32:29.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624feff700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624814bb60 con 0 2020-01-26T15:32:29.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624feff700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624814bf00 con 0 2020-01-26T15:32:29.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624d724700 1 -- 172.21.15.170:0/3456430277 learned_addr learned my addr 172.21.15.170:0/3456430277 2020-01-26T15:32:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6240002620 con 0x7f62481480d0 2020-01-26T15:32:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4186652400 0 0) 0x7f62400029a0 con 0x7f62481480d0 2020-01-26T15:32:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6234002a20 con 0 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f623c003630 con 0x7f624814b3d0 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (148235734 0 0) 0x7f623c0039b0 con 0x7f624814b3d0 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f62340046c0 con 0 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1479141462 0 0) 0x7f6240002f70 con 0x7f62481480d0 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 >> 172.21.15.170:6790/0 conn(0x7f624814b3d0 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624807a930 con 0 2020-01-26T15:32:29.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f62480e9ff0 con 0x7f62481480d0 2020-01-26T15:32:29.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624cf23700 1 -- 172.21.15.170:0/3456430277 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f62400013d0 con 0x7f62481480d0 2020-01-26T15:32:29.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.752 7f624feff700 1 -- 172.21.15.170:0/3456430277 >> 172.21.15.170:6791/0 conn(0x7f62481480d0 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-01-26T15:32:29.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- 172.21.15.170:0/3456430277 shutdown_connections 2020-01-26T15:32:29.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- 172.21.15.170:0/3456430277 shutdown_connections 2020-01-26T15:32:29.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- 172.21.15.170:0/3456430277 wait complete. 2020-01-26T15:32:29.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- 172.21.15.170:0/3456430277 >> 172.21.15.170:0/3456430277 conn(0x7f6248144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:29.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 Processor -- start 2020-01-26T15:32:29.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- - start start 2020-01-26T15:32:29.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480a3e80 con 0 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6248095e60 con 0 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624df25700 1 -- 172.21.15.170:0/3309701210 learned_addr learned my addr 172.21.15.170:0/3309701210 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6240001390 con 0x7f62480a3440 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1367739806 0 0) 0x7f62400023f0 con 0x7f62480a3440 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6228002960 con 0 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f623c003ef0 con 0x7f62480a51f0 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (272771792 0 0) 0x7f623c003470 con 0x7f62480a51f0 2020-01-26T15:32:29.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6228004620 con 0 2020-01-26T15:32:29.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2830016447 0 0) 0x7f6240002960 con 0x7f62480a3440 2020-01-26T15:32:29.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6228002ee0 con 0 2020-01-26T15:32:29.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (899999890 0 0) 0x7f6240001c80 con 0x7f62480a3440 2020-01-26T15:32:29.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 >> 172.21.15.170:6789/0 conn(0x7f62480a51f0 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:32:29.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624807ab90 con 0 2020-01-26T15:32:29.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.756 7f624feff700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62480b28d0 con 0 2020-01-26T15:32:29.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.760 7f624feff700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f62480a6cc0 con 0 2020-01-26T15:32:29.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.760 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f62400016e0 con 0x7f62480a3440 2020-01-26T15:32:29.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.760 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6240003250 con 0x7f62480a3440 2020-01-26T15:32:29.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.760 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f6240003c40 con 0x7f62480a3440 2020-01-26T15:32:29.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.760 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f6240005320 con 0x7f62480a3440 2020-01-26T15:32:29.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.764 7f624feff700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624807af30 con 0 2020-01-26T15:32:29.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.768 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f624807af30 con 0x7f62480a3440 2020-01-26T15:32:29.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6248073330 con 0 2020-01-26T15:32:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f6246ffd700 1 -- 172.21.15.170:0/3309701210 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2262 (882253904 0 1822045022) 0x7f6240003720 con 0x7f62480a3440 2020-01-26T15:32:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 9 2020-01-26T15:32:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 >> 172.21.15.170:6800/11008 conn(0x7f62280065f0 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:32:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 >> 172.21.15.170:6790/0 conn(0x7f62480a3440 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:32:29.864 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:29.864 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:20.414222","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 shutdown_connections 2020-01-26T15:32:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 shutdown_connections 2020-01-26T15:32:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 wait complete. 2020-01-26T15:32:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:29.860 7f624feff700 1 -- 172.21.15.170:0/3309701210 >> 172.21.15.170:0/3309701210 conn(0x7f6248099660 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:30.180 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 9, u'flags': 18, u'max_mds': 2, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:20.414222', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:30.180 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2020-01-26T15:32:30.181 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-01-26T15:32:30.276 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:30.277 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:30.277 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 1, 2020-01-26T15:32:30.277 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4203, 2020-01-26T15:32:30.277 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:30.277 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:30.277 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 10.865821, 2020-01-26T15:32:30.278 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 9, 2020-01-26T15:32:30.278 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 17, 2020-01-26T15:32:30.278 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:32:30.278 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 12.761015 2020-01-26T15:32:30.278 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:30.283 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 1, "id": 4203, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.865821, "mdsmap_epoch": 9, "osdmap_epoch": 17, "osdmap_epoch_barrier": 16, "uptime": 12.761015 } 2020-01-26T15:32:30.283 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:32:30.362 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4225, 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 11.961840, 2020-01-26T15:32:30.363 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 9, 2020-01-26T15:32:30.364 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 17, 2020-01-26T15:32:30.364 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:32:30.364 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 12.861681 2020-01-26T15:32:30.364 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:30.369 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 0, "id": 4225, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.961840, "mdsmap_epoch": 9, "osdmap_epoch": 17, "osdmap_epoch_barrier": 16, "uptime": 12.861681 } 2020-01-26T15:32:30.369 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-01-26T15:32:30.369 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-01-26T15:32:30.369 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi008.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-01-26T15:32:30.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:30.370 INFO:teuthology.orchestra.run.smithi008:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-01-26T15:32:30.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:30.390 INFO:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:32:30.443 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:32:30.448 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:32:30.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:30.449 INFO:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2020-01-26T15:32:30.496 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-01-26T15:32:30.496 INFO:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-01-26T15:32:30.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:30.535 INFO:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:32:30.551 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:32:30.554 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:32:30.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:30.555 INFO:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2020-01-26T15:32:30.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[10059]: starting ceph client 2020-01-26T15:32:30.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:2020-01-26 15:32:30.617 7f91e44f9b80 -1 init, newargv = 0x5613ea0007c0 newargc=7 2020-01-26T15:32:30.632 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[10059]: starting fuse 2020-01-26T15:32:31.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:31.718 INFO:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:32:31.735 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:32:31.737 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:32:31.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:31.738 INFO:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2020-01-26T15:32:31.788 INFO:teuthology.orchestra.run.smithi008.stdout:49 2020-01-26T15:32:31.789 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-01-26T15:32:31.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:31.789 INFO:teuthology.orchestra.run.smithi008:> sudo python3 -c ' 2020-01-26T15:32:31.789 INFO:teuthology.orchestra.run.smithi008:> import glob 2020-01-26T15:32:31.789 INFO:teuthology.orchestra.run.smithi008:> import re 2020-01-26T15:32:31.789 INFO:teuthology.orchestra.run.smithi008:> import os 2020-01-26T15:32:31.789 INFO:teuthology.orchestra.run.smithi008:> import subprocess 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> def find_socket(client_name): 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2020-01-26T15:32:31.790 INFO:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> return files[0] 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> for f in files: 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> return f 2020-01-26T15:32:31.791 INFO:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-01-26T15:32:31.792 INFO:teuthology.orchestra.run.smithi008:> 2020-01-26T15:32:31.792 INFO:teuthology.orchestra.run.smithi008:> print(find_socket("client.0")) 2020-01-26T15:32:31.792 INFO:teuthology.orchestra.run.smithi008:> ' 2020-01-26T15:32:31.893 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.0.10059.asok 2020-01-26T15:32:31.893 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.10059.asok 2020-01-26T15:32:31.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:31.894 INFO:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.10059.asok status 2020-01-26T15:32:32.094 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2020-01-26T15:32:32.094 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2020-01-26T15:32:32.094 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "e1c5fd9306ce839d8d3ac8160c57aba42e0231a8", 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 13.2.8-63-ge1c5fd9 (e1c5fd9306ce839d8d3ac8160c57aba42e0231a8) mimic (stable)", 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "0", 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "10059", 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2020-01-26T15:32:32.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4363, 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4363 2020-01-26T15:32:32.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 663275973, 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0" 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: } 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.4363 172.21.15.8:0/663275973", 2020-01-26T15:32:32.097 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "172.21.15.8:0/663275973", 2020-01-26T15:32:32.098 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2020-01-26T15:32:32.098 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 9, 2020-01-26T15:32:32.098 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 17, 2020-01-26T15:32:32.098 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2020-01-26T15:32:32.099 INFO:teuthology.orchestra.run.smithi008.stdout: "blacklisted": false 2020-01-26T15:32:32.099 INFO:teuthology.orchestra.run.smithi008.stdout:} 2020-01-26T15:32:32.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:32.099 INFO:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2020-01-26T15:32:32.100 INFO:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.1 2020-01-26T15:32:32.110 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2020-01-26T15:32:32.110 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-01-26T15:32:32.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:32.110 INFO:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2020-01-26T15:32:32.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:32.183 INFO:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2020-01-26T15:32:32.183 INFO:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.0 2020-01-26T15:32:32.194 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2020-01-26T15:32:32.194 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-01-26T15:32:32.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:32:32.195 INFO:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-01-26T15:32:32.555 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:32:32.568 INFO:teuthology.task.print:**** done mimic client 2020-01-26T15:32:32.568 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:32:32.583 INFO:teuthology.task.print:**** done fsstress 2020-01-26T15:32:32.583 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2020-01-26T15:32:32.598 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.696 7fed74326700 1 Processor -- start 2020-01-26T15:32:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.696 7fed74326700 1 -- - start start 2020-01-26T15:32:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.696 7fed74326700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c14bb10 con 0 2020-01-26T15:32:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed74326700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c14beb0 con 0 2020-01-26T15:32:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7234c700 1 -- 172.21.15.170:0/4087684355 learned_addr learned my addr 172.21.15.170:0/4087684355 2020-01-26T15:32:32.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fed5c0022a0 con 0x7fed6c14b3d0 2020-01-26T15:32:32.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fed680039b0 con 0x7fed6c1480d0 2020-01-26T15:32:32.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2761733432 0 0) 0x7fed5c002620 con 0x7fed6c14b3d0 2020-01-26T15:32:32.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fed54002ea0 con 0 2020-01-26T15:32:32.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4219787541 0 0) 0x7fed68003cb0 con 0x7fed6c1480d0 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fed540046b0 con 0 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (350052287 0 0) 0x7fed5c002ac0 con 0x7fed6c14b3d0 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 >> 172.21.15.170:6790/0 conn(0x7fed6c1480d0 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c07a930 con 0 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fed6c116e80 con 0x7fed6c14b3d0 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed7134a700 1 -- 172.21.15.170:0/4087684355 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fed5c001010 con 0x7fed6c14b3d0 2020-01-26T15:32:32.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed74326700 1 -- 172.21.15.170:0/4087684355 >> 172.21.15.170:6791/0 conn(0x7fed6c14b3d0 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:32:32.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed74326700 1 -- 172.21.15.170:0/4087684355 shutdown_connections 2020-01-26T15:32:32.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed74326700 1 -- 172.21.15.170:0/4087684355 shutdown_connections 2020-01-26T15:32:32.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed74326700 1 -- 172.21.15.170:0/4087684355 wait complete. 2020-01-26T15:32:32.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.700 7fed74326700 1 -- 172.21.15.170:0/4087684355 >> 172.21.15.170:0/4087684355 conn(0x7fed6c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:32.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed74326700 1 Processor -- start 2020-01-26T15:32:32.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed74326700 1 -- - start start 2020-01-26T15:32:32.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed74326700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c0a3d50 con 0 2020-01-26T15:32:32.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed74326700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c0a6b20 con 0 2020-01-26T15:32:32.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed7234c700 1 -- 172.21.15.170:0/2151105226 learned_addr learned my addr 172.21.15.170:0/2151105226 2020-01-26T15:32:32.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fed680042e0 con 0x7fed6c0a3360 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2870890824 0 0) 0x7fed68003810 con 0x7fed6c0a3360 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fed4c002960 con 0 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fed5c000e50 con 0x7fed6c0a6370 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3450180808 0 0) 0x7fed5c002050 con 0x7fed6c0a6370 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fed4c004620 con 0 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3013163915 0 0) 0x7fed68003d40 con 0x7fed6c0a3360 2020-01-26T15:32:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fed4c002ee0 con 0 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2067661771 0 0) 0x7fed5c0023d0 con 0x7fed6c0a6370 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fed4c003540 con 0 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (20423311 0 0) 0x7fed68001470 con 0x7fed6c0a3360 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 >> 172.21.15.170:6791/0 conn(0x7fed6c0a6370 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c07ab90 con 0 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed74326700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c0712f0 con 0 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed74326700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c18b1e0 con 0 2020-01-26T15:32:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fed68000f70 con 0x7fed6c0a3360 2020-01-26T15:32:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fed68001920 con 0x7fed6c0a3360 2020-01-26T15:32:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fed68001d70 con 0x7fed6c0a3360 2020-01-26T15:32:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.704 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fed68005260 con 0x7fed6c0a3360 2020-01-26T15:32:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.712 7fed74326700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c07af30 con 0 2020-01-26T15:32:32.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.716 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fed6c07af30 con 0x7fed6c0a3360 2020-01-26T15:32:32.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.808 7fed74326700 1 -- 172.21.15.170:0/2151105226 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed6c073330 con 0 2020-01-26T15:32:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.808 7fed5b7fe700 1 -- 172.21.15.170:0/2151105226 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+6330 (3225238715 0 1927210921) 0x7fed68005890 con 0x7fed6c0a3360 2020-01-26T15:32:32.811 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:32.811 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:25.428987","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.808 7fed74326700 1 -- 172.21.15.170:0/2151105226 >> 172.21.15.170:6800/11008 conn(0x7fed4c006ed0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:32:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.808 7fed74326700 1 -- 172.21.15.170:0/2151105226 >> 172.21.15.170:6789/0 conn(0x7fed6c0a3360 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:32:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.812 7fed74326700 1 -- 172.21.15.170:0/2151105226 shutdown_connections 2020-01-26T15:32:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.812 7fed74326700 1 -- 172.21.15.170:0/2151105226 shutdown_connections 2020-01-26T15:32:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.812 7fed74326700 1 -- 172.21.15.170:0/2151105226 wait complete. 2020-01-26T15:32:32.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.812 7fed74326700 1 -- 172.21.15.170:0/2151105226 >> 172.21.15.170:0/2151105226 conn(0x7fed6c099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:32.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:11.534039', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.037219', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:32:14.435582', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:32:32.823 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:32:32.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 Processor -- start 2020-01-26T15:32:32.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- - start start 2020-01-26T15:32:32.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc14bb50 con 0 2020-01-26T15:32:32.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc14bef0 con 0 2020-01-26T15:32:32.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd161c700 1 -- 172.21.15.170:0/1030552905 learned_addr learned my addr 172.21.15.170:0/1030552905 2020-01-26T15:32:32.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cc00039b0 con 0x7f0ccc14b410 2020-01-26T15:32:32.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cbc0022a0 con 0x7f0ccc148110 2020-01-26T15:32:32.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1425668032 0 0) 0x7f0cc0003d30 con 0x7f0ccc14b410 2020-01-26T15:32:32.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0cb8002ea0 con 0 2020-01-26T15:32:32.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3285759571 0 0) 0x7f0cbc002620 con 0x7f0ccc148110 2020-01-26T15:32:32.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0cb80046b0 con 0 2020-01-26T15:32:32.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3950878821 0 0) 0x7f0cc0004220 con 0x7f0ccc14b410 2020-01-26T15:32:32.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 >> 172.21.15.170:6791/0 conn(0x7f0ccc148110 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:32:32.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc07a8b0 con 0 2020-01-26T15:32:32.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0ccc116ec0 con 0x7f0ccc14b410 2020-01-26T15:32:32.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd0e1b700 1 -- 172.21.15.170:0/1030552905 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cc0001390 con 0x7f0ccc14b410 2020-01-26T15:32:32.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- 172.21.15.170:0/1030552905 >> 172.21.15.170:6790/0 conn(0x7f0ccc14b410 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-01-26T15:32:32.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- 172.21.15.170:0/1030552905 shutdown_connections 2020-01-26T15:32:32.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- 172.21.15.170:0/1030552905 shutdown_connections 2020-01-26T15:32:32.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- 172.21.15.170:0/1030552905 wait complete. 2020-01-26T15:32:32.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.916 7f0cd3df7700 1 -- 172.21.15.170:0/1030552905 >> 172.21.15.170:0/1030552905 conn(0x7f0ccc144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:32.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd3df7700 1 Processor -- start 2020-01-26T15:32:32.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd3df7700 1 -- - start start 2020-01-26T15:32:32.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd3df7700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0a3c70 con 0 2020-01-26T15:32:32.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd3df7700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0a6a40 con 0 2020-01-26T15:32:32.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd161c700 1 -- 172.21.15.170:0/2669489594 learned_addr learned my addr 172.21.15.170:0/2669489594 2020-01-26T15:32:32.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cc00011d0 con 0x7f0ccc0a6290 2020-01-26T15:32:32.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3395420883 0 0) 0x7f0cc0003760 con 0x7f0ccc0a6290 2020-01-26T15:32:32.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0cac002960 con 0 2020-01-26T15:32:32.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cbc002b60 con 0x7f0ccc0a3280 2020-01-26T15:32:32.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1821077183 0 0) 0x7f0cbc002080 con 0x7f0ccc0a3280 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0cac004620 con 0 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2893505630 0 0) 0x7f0cc0003bb0 con 0x7f0ccc0a6290 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0cac002ee0 con 0 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3821848425 0 0) 0x7f0cbc002410 con 0x7f0ccc0a3280 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0cac003540 con 0 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (441473208 0 0) 0x7f0cc0001b50 con 0x7f0ccc0a6290 2020-01-26T15:32:32.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 >> 172.21.15.170:6791/0 conn(0x7f0ccc0a3280 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-01-26T15:32:32.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc07ab10 con 0 2020-01-26T15:32:32.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc0b2900 con 0 2020-01-26T15:32:32.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc18b1e0 con 0 2020-01-26T15:32:32.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0cc00016a0 con 0x7f0ccc0a6290 2020-01-26T15:32:32.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cc0001f80 con 0x7f0ccc0a6290 2020-01-26T15:32:32.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f0cc00049f0 con 0x7f0ccc0a6290 2020-01-26T15:32:32.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.920 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f0cc00064b0 con 0x7f0ccc0a6290 2020-01-26T15:32:32.932 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.928 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca8002070 con 0 2020-01-26T15:32:32.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:32.936 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0cc00050a0 con 0x7f0ccc0a6290 2020-01-26T15:32:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.024 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 --> 172.21.15.170:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f0ca80012a0 con 0 2020-01-26T15:32:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0ccaffd700 1 -- 172.21.15.170:0/2669489594 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v17) v1 ==== 92+0+10 (4061927567 0 265718887) 0x7f0cc0004610 con 0x7f0ccc0a6290 2020-01-26T15:32:33.029 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 >> 172.21.15.170:6800/11008 conn(0x7f0cac006e70 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:32:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 >> 172.21.15.170:6789/0 conn(0x7f0ccc0a6290 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:32:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 shutdown_connections 2020-01-26T15:32:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 shutdown_connections 2020-01-26T15:32:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 wait complete. 2020-01-26T15:32:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.028 7f0cd3df7700 1 -- 172.21.15.170:0/2669489594 >> 172.21.15.170:0/2669489594 conn(0x7f0ccc099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.040 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:32:33.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.132 7ff9969ed700 1 Processor -- start 2020-01-26T15:32:33.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.132 7ff9969ed700 1 -- - start start 2020-01-26T15:32:33.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.132 7ff9969ed700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99014bb50 con 0 2020-01-26T15:32:33.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.132 7ff9969ed700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99014bef0 con 0 2020-01-26T15:32:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.132 7ff994a13700 1 -- 172.21.15.170:0/3442055561 learned_addr learned my addr 172.21.15.170:0/3442055561 2020-01-26T15:32:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff980003630 con 0x7ff990148110 2020-01-26T15:32:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff9840022a0 con 0x7ff99014b410 2020-01-26T15:32:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1450226811 0 0) 0x7ff9800039b0 con 0x7ff990148110 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff97c002ea0 con 0 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2611103406 0 0) 0x7ff9840025a0 con 0x7ff99014b410 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff97c0046b0 con 0 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (575080343 0 0) 0x7ff980003e50 con 0x7ff990148110 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 >> 172.21.15.170:6789/0 conn(0x7ff99014b410 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99007a8b0 con 0 2020-01-26T15:32:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff9900ea030 con 0x7ff990148110 2020-01-26T15:32:33.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff98f7fe700 1 -- 172.21.15.170:0/3442055561 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff980001010 con 0x7ff990148110 2020-01-26T15:32:33.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff9969ed700 1 -- 172.21.15.170:0/3442055561 >> 172.21.15.170:6790/0 conn(0x7ff990148110 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:32:33.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff9969ed700 1 -- 172.21.15.170:0/3442055561 shutdown_connections 2020-01-26T15:32:33.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff9969ed700 1 -- 172.21.15.170:0/3442055561 shutdown_connections 2020-01-26T15:32:33.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff9969ed700 1 -- 172.21.15.170:0/3442055561 wait complete. 2020-01-26T15:32:33.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.136 7ff9969ed700 1 -- 172.21.15.170:0/3442055561 >> 172.21.15.170:0/3442055561 conn(0x7ff990144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff9969ed700 1 Processor -- start 2020-01-26T15:32:33.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff9969ed700 1 -- - start start 2020-01-26T15:32:33.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff9969ed700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9900a3ed0 con 0 2020-01-26T15:32:33.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff9969ed700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff990092b70 con 0 2020-01-26T15:32:33.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff994a13700 1 -- 172.21.15.170:0/3493005903 learned_addr learned my addr 172.21.15.170:0/3493005903 2020-01-26T15:32:33.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff980000e50 con 0x7ff9900a34e0 2020-01-26T15:32:33.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3896470440 0 0) 0x7ff9800033e0 con 0x7ff9900a34e0 2020-01-26T15:32:33.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff970002960 con 0 2020-01-26T15:32:33.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff9840020e0 con 0x7ff9900a5290 2020-01-26T15:32:33.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1644879026 0 0) 0x7ff984002920 con 0x7ff9900a5290 2020-01-26T15:32:33.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff970004620 con 0 2020-01-26T15:32:33.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1815532099 0 0) 0x7ff980003830 con 0x7ff9900a34e0 2020-01-26T15:32:33.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff970002ee0 con 0 2020-01-26T15:32:33.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (669682444 0 0) 0x7ff984002b90 con 0x7ff9900a5290 2020-01-26T15:32:33.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff970003540 con 0 2020-01-26T15:32:33.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1504994783 0 0) 0x7ff9800017d0 con 0x7ff9900a34e0 2020-01-26T15:32:33.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 >> 172.21.15.170:6791/0 conn(0x7ff9900a5290 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-01-26T15:32:33.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99007ab10 con 0 2020-01-26T15:32:33.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9900711a0 con 0 2020-01-26T15:32:33.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9900a6d60 con 0 2020-01-26T15:32:33.147 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff980000bf0 con 0x7ff9900a34e0 2020-01-26T15:32:33.148 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7ff980001c00 con 0x7ff9900a34e0 2020-01-26T15:32:33.148 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7ff980004780 con 0x7ff9900a34e0 2020-01-26T15:32:33.148 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.140 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7ff9800060b0 con 0x7ff9900a34e0 2020-01-26T15:32:33.148 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.148 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c002070 con 0 2020-01-26T15:32:33.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.148 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff980004260 con 0x7ff9900a34e0 2020-01-26T15:32:33.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.240 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 --> 172.21.15.170:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ff96c0012a0 con 0 2020-01-26T15:32:33.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff98dffb700 1 -- 172.21.15.170:0/3493005903 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v17) v1 ==== 104+0+10 (1945638983 0 265718887) 0x7ff980006350 con 0x7ff9900a34e0 2020-01-26T15:32:33.246 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:33.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 >> 172.21.15.170:6800/11008 conn(0x7ff970006ed0 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:32:33.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 >> 172.21.15.170:6790/0 conn(0x7ff9900a34e0 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:32:33.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 shutdown_connections 2020-01-26T15:32:33.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 shutdown_connections 2020-01-26T15:32:33.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 wait complete. 2020-01-26T15:32:33.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.244 7ff9969ed700 1 -- 172.21.15.170:0/3493005903 >> 172.21.15.170:0/3493005903 conn(0x7ff9900995c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.257 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:32:33.347 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb3373c1700 1 Processor -- start 2020-01-26T15:32:33.347 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb3373c1700 1 -- - start start 2020-01-26T15:32:33.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb3373c1700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33014bba0 con 0 2020-01-26T15:32:33.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb3373c1700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33014bf40 con 0 2020-01-26T15:32:33.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb334be6700 1 -- 172.21.15.170:0/624888864 learned_addr learned my addr 172.21.15.170:0/624888864 2020-01-26T15:32:33.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb32c002620 con 0x7fb330148110 2020-01-26T15:32:33.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1752923829 0 0) 0x7fb32c0029a0 con 0x7fb330148110 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb314002a20 con 0 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb320003630 con 0x7fb33014b410 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (712026210 0 0) 0x7fb320003930 con 0x7fb33014b410 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb3140046c0 con 0 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3043591728 0 0) 0x7fb32c002f70 con 0x7fb330148110 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 >> 172.21.15.170:6791/0 conn(0x7fb33014b410 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:32:33.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.344 7fb327fff700 1 -- 172.21.15.170:0/624888864 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33007a8b0 con 0 2020-01-26T15:32:33.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb32c000f70 con 0x7fb330148110 2020-01-26T15:32:33.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb327fff700 1 -- 172.21.15.170:0/624888864 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb32c0013d0 con 0x7fb330148110 2020-01-26T15:32:33.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 -- 172.21.15.170:0/624888864 >> 172.21.15.170:6789/0 conn(0x7fb330148110 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-01-26T15:32:33.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 -- 172.21.15.170:0/624888864 shutdown_connections 2020-01-26T15:32:33.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 -- 172.21.15.170:0/624888864 shutdown_connections 2020-01-26T15:32:33.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 -- 172.21.15.170:0/624888864 wait complete. 2020-01-26T15:32:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 -- 172.21.15.170:0/624888864 >> 172.21.15.170:0/624888864 conn(0x7fb330144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 Processor -- start 2020-01-26T15:32:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.348 7fb3373c1700 1 -- - start start 2020-01-26T15:32:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3373c1700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3300a3ee0 con 0 2020-01-26T15:32:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3373c1700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb330095ec0 con 0 2020-01-26T15:32:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3353e7700 1 -- 172.21.15.170:0/4048385430 learned_addr learned my addr 172.21.15.170:0/4048385430 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb32c0011d0 con 0x7fb3300a34a0 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3815779077 0 0) 0x7fb32c002370 con 0x7fb3300a34a0 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb318002960 con 0 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb320003e70 con 0x7fb3300a5250 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3738012177 0 0) 0x7fb320003470 con 0x7fb3300a5250 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb318004620 con 0 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1159733113 0 0) 0x7fb32c0027c0 con 0x7fb3300a34a0 2020-01-26T15:32:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb318002ee0 con 0 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (868843521 0 0) 0x7fb3200036e0 con 0x7fb3300a5250 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb318003540 con 0 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3868652793 0 0) 0x7fb32c001b90 con 0x7fb3300a34a0 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 >> 172.21.15.170:6790/0 conn(0x7fb3300a5250 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33007ab10 con 0 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3300b27e0 con 0 2020-01-26T15:32:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3300a6d70 con 0 2020-01-26T15:32:33.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb32c0016e0 con 0x7fb3300a34a0 2020-01-26T15:32:33.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb32c001fc0 con 0x7fb3300a34a0 2020-01-26T15:32:33.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fb32c003980 con 0x7fb3300a34a0 2020-01-26T15:32:33.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.352 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fb32c003f80 con 0x7fb3300a34a0 2020-01-26T15:32:33.362 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.360 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33007ae90 con 0 2020-01-26T15:32:33.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.364 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb33007ae90 con 0x7fb3300a34a0 2020-01-26T15:32:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.456 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 --> 172.21.15.170:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fb330070bc0 con 0 2020-01-26T15:32:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.456 7fb3267fc700 1 -- 172.21.15.170:0/4048385430 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v17) v1 ==== 100+0+10 (2880496653 0 265718887) 0x7fb32c003520 con 0x7fb3300a34a0 2020-01-26T15:32:33.460 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:32:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.460 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 >> 172.21.15.170:6800/11008 conn(0x7fb318006ed0 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:32:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.460 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 >> 172.21.15.170:6789/0 conn(0x7fb3300a34a0 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-01-26T15:32:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.460 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 shutdown_connections 2020-01-26T15:32:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.460 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 shutdown_connections 2020-01-26T15:32:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.460 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 wait complete. 2020-01-26T15:32:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.460 7fb3373c1700 1 -- 172.21.15.170:0/4048385430 >> 172.21.15.170:0/4048385430 conn(0x7fb330099610 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.471 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:33.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 Processor -- start 2020-01-26T15:32:33.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- - start start 2020-01-26T15:32:33.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225014bb10 con 0 2020-01-26T15:32:33.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225014beb0 con 0 2020-01-26T15:32:33.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f22554d0700 1 -- 172.21.15.170:0/3788878893 learned_addr learned my addr 172.21.15.170:0/3788878893 2020-01-26T15:32:33.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2240002220 con 0x7f22501480d0 2020-01-26T15:32:33.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1546654231 0 0) 0x7f22400025a0 con 0x7f22501480d0 2020-01-26T15:32:33.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f223c002a20 con 0 2020-01-26T15:32:33.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f22440039b0 con 0x7f225014b3d0 2020-01-26T15:32:33.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (315455391 0 0) 0x7f2244003cb0 con 0x7f225014b3d0 2020-01-26T15:32:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f223c0046b0 con 0 2020-01-26T15:32:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3645301795 0 0) 0x7f2240002b20 con 0x7f22501480d0 2020-01-26T15:32:33.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 >> 172.21.15.170:6791/0 conn(0x7f225014b3d0 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-01-26T15:32:33.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225007a930 con 0 2020-01-26T15:32:33.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f22500e9ff0 con 0x7f22501480d0 2020-01-26T15:32:33.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2254ccf700 1 -- 172.21.15.170:0/3788878893 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2240001010 con 0x7f22501480d0 2020-01-26T15:32:33.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- 172.21.15.170:0/3788878893 >> 172.21.15.170:6789/0 conn(0x7f22501480d0 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:32:33.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- 172.21.15.170:0/3788878893 shutdown_connections 2020-01-26T15:32:33.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- 172.21.15.170:0/3788878893 shutdown_connections 2020-01-26T15:32:33.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- 172.21.15.170:0/3788878893 wait complete. 2020-01-26T15:32:33.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.564 7f2257cab700 1 -- 172.21.15.170:0/3788878893 >> 172.21.15.170:0/3788878893 conn(0x7f2250144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2257cab700 1 Processor -- start 2020-01-26T15:32:33.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2257cab700 1 -- - start start 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2257cab700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500a3d50 con 0 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2257cab700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500a6b20 con 0 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2255cd1700 1 -- 172.21.15.170:0/937183037 learned_addr learned my addr 172.21.15.170:0/937183037 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2240001010 con 0x7f22500a3360 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f22440041f0 con 0x7f22500a6370 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1374978925 0 0) 0x7f2240001f70 con 0x7f22500a3360 2020-01-26T15:32:33.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2230002df0 con 0 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2232648126 0 0) 0x7f22440037f0 con 0x7f22500a6370 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2230004620 con 0 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4221173446 0 0) 0x7f2244003b80 con 0x7f22500a6370 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2230004df0 con 0 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (630158146 0 0) 0x7f2240002410 con 0x7f22500a3360 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2230006570 con 0 2020-01-26T15:32:33.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1021811136 0 0) 0x7f2244001470 con 0x7f22500a6370 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 >> 172.21.15.170:6791/0 conn(0x7f22500a3360 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225007ab90 con 0 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2257cab700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500b2940 con 0 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f2257cab700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f225018b170 con 0 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2250116e80 con 0x7f22500a6370 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f22440018a0 con 0x7f22500a6370 2020-01-26T15:32:33.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2244001cf0 con 0x7f22500a6370 2020-01-26T15:32:33.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.568 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f22440045e0 con 0x7f22500a6370 2020-01-26T15:32:33.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.576 7f2257cab700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225007af30 con 0 2020-01-26T15:32:33.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.580 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f225007af30 con 0x7f22500a6370 2020-01-26T15:32:33.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.664 7f2257cab700 1 -- 172.21.15.170:0/937183037 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2250073330 con 0 2020-01-26T15:32:33.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.664 7f224effd700 1 -- 172.21.15.170:0/937183037 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2262 (882253904 0 1822045022) 0x7f2244004a40 con 0x7f22500a6370 2020-01-26T15:32:33.703 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 9 2020-01-26T15:32:33.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.668 7f2257cab700 1 -- 172.21.15.170:0/937183037 >> 172.21.15.170:6800/11008 conn(0x7f22300072a0 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-01-26T15:32:33.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.668 7f2257cab700 1 -- 172.21.15.170:0/937183037 >> 172.21.15.170:6790/0 conn(0x7f22500a6370 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:32:33.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.668 7f2257cab700 1 -- 172.21.15.170:0/937183037 shutdown_connections 2020-01-26T15:32:33.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.668 7f2257cab700 1 -- 172.21.15.170:0/937183037 shutdown_connections 2020-01-26T15:32:33.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.668 7f2257cab700 1 -- 172.21.15.170:0/937183037 wait complete. 2020-01-26T15:32:33.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.668 7f2257cab700 1 -- 172.21.15.170:0/937183037 >> 172.21.15.170:0/937183037 conn(0x7f2250099450 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:33.705 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:20.414222","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:33.705 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:32:33.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 Processor -- start 2020-01-26T15:32:33.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- - start start 2020-01-26T15:32:33.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f014bb10 con 0 2020-01-26T15:32:33.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f014beb0 con 0 2020-01-26T15:32:33.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75effff700 1 -- 172.21.15.170:0/590585101 learned_addr learned my addr 172.21.15.170:0/590585101 2020-01-26T15:32:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f75e0002620 con 0x7f75f01480d0 2020-01-26T15:32:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3089352669 0 0) 0x7f75e00029a0 con 0x7f75f01480d0 2020-01-26T15:32:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75d0002a20 con 0 2020-01-26T15:32:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f75d8003630 con 0x7f75f014b3d0 2020-01-26T15:32:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3607904954 0 0) 0x7f75d8003930 con 0x7f75f014b3d0 2020-01-26T15:32:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75d00046c0 con 0 2020-01-26T15:32:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3571405056 0 0) 0x7f75e0002f70 con 0x7f75f01480d0 2020-01-26T15:32:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 >> 172.21.15.170:6789/0 conn(0x7f75f014b3d0 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-01-26T15:32:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f007a930 con 0 2020-01-26T15:32:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f75e0000f70 con 0x7f75f01480d0 2020-01-26T15:32:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75ef7fe700 1 -- 172.21.15.170:0/590585101 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f75e00013d0 con 0x7f75f01480d0 2020-01-26T15:32:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- 172.21.15.170:0/590585101 >> 172.21.15.170:6791/0 conn(0x7f75f01480d0 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:32:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- 172.21.15.170:0/590585101 shutdown_connections 2020-01-26T15:32:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- 172.21.15.170:0/590585101 shutdown_connections 2020-01-26T15:32:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- 172.21.15.170:0/590585101 wait complete. 2020-01-26T15:32:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.800 7f75f6de5700 1 -- 172.21.15.170:0/590585101 >> 172.21.15.170:0/590585101 conn(0x7f75f0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f6de5700 1 Processor -- start 2020-01-26T15:32:33.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f6de5700 1 -- - start start 2020-01-26T15:32:33.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f6de5700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00a4040 con 0 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f6de5700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00a6d80 con 0 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f4e0b700 1 -- 172.21.15.170:0/1651599435 learned_addr learned my addr 172.21.15.170:0/1651599435 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f75d8003e70 con 0x7f75f00a65d0 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4247859815 0 0) 0x7f75d8003440 con 0x7f75f00a65d0 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75d4002960 con 0 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f75e00011d0 con 0x7f75f00a3650 2020-01-26T15:32:33.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (763583082 0 0) 0x7f75e0002370 con 0x7f75f00a3650 2020-01-26T15:32:33.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75d4004620 con 0 2020-01-26T15:32:33.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4120158014 0 0) 0x7f75d8000e50 con 0x7f75f00a65d0 2020-01-26T15:32:33.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75d4002ee0 con 0 2020-01-26T15:32:33.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1194768563 0 0) 0x7f75e00025e0 con 0x7f75f00a3650 2020-01-26T15:32:33.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75d4003540 con 0 2020-01-26T15:32:33.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2854299113 0 0) 0x7f75e00018f0 con 0x7f75f00a3650 2020-01-26T15:32:33.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 >> 172.21.15.170:6791/0 conn(0x7f75f00a65d0 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-01-26T15:32:33.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f007ab90 con 0 2020-01-26T15:32:33.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f00b2940 con 0 2020-01-26T15:32:33.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0096050 con 0 2020-01-26T15:32:33.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f75e00016e0 con 0x7f75f00a3650 2020-01-26T15:32:33.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f75e0001b60 con 0x7f75f00a3650 2020-01-26T15:32:33.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.804 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f75e0003650 con 0x7f75f00a3650 2020-01-26T15:32:33.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.808 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f75e00062b0 con 0x7f75f00a3650 2020-01-26T15:32:33.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.812 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f007af30 con 0 2020-01-26T15:32:33.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.816 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f75f007af30 con 0x7f75f00a3650 2020-01-26T15:32:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f0073330 con 0 2020-01-26T15:32:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75edffb700 1 -- 172.21.15.170:0/1651599435 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+6330 (3225238715 0 1927210921) 0x7f75e0003cd0 con 0x7f75f00a3650 2020-01-26T15:32:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:33.911 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26 15:32:02.055148","modified":"2020-01-26 15:32:25.428987","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:32:11.534039","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:32:14.037219","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:32:14.435582","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:32:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 >> 172.21.15.170:6800/11008 conn(0x7f75d4006e70 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:32:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 >> 172.21.15.170:6790/0 conn(0x7f75f00a3650 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-01-26T15:32:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 shutdown_connections 2020-01-26T15:32:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 shutdown_connections 2020-01-26T15:32:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.908 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 wait complete. 2020-01-26T15:32:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:33.912 7f75f6de5700 1 -- 172.21.15.170:0/1651599435 >> 172.21.15.170:0/1651599435 conn(0x7f75f0099700 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:33.923 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2020-01-26T15:32:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.012 7f8535363700 1 Processor -- start 2020-01-26T15:32:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.012 7f8535363700 1 -- - start start 2020-01-26T15:32:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853014bb50 con 0 2020-01-26T15:32:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853014bef0 con 0 2020-01-26T15:32:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852f269700 1 -- 172.21.15.170:0/2760040072 learned_addr learned my addr 172.21.15.170:0/2760040072 2020-01-26T15:32:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85280039b0 con 0x7f8530148110 2020-01-26T15:32:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3422868076 0 0) 0x7f8528003d30 con 0x7f8530148110 2020-01-26T15:32:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f851c002a20 con 0 2020-01-26T15:32:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8524002220 con 0x7f853014b410 2020-01-26T15:32:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (771717279 0 0) 0x7f8524002520 con 0x7f853014b410 2020-01-26T15:32:34.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f851c0046c0 con 0 2020-01-26T15:32:34.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1535109927 0 0) 0x7f8528004230 con 0x7f8530148110 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 >> 172.21.15.170:6790/0 conn(0x7f853014b410 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853007a8b0 con 0 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f85300ea030 con 0x7f8530148110 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f852e267700 1 -- 172.21.15.170:0/2760040072 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8528001390 con 0x7f8530148110 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- 172.21.15.170:0/2760040072 >> 172.21.15.170:6791/0 conn(0x7f8530148110 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- 172.21.15.170:0/2760040072 shutdown_connections 2020-01-26T15:32:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- 172.21.15.170:0/2760040072 shutdown_connections 2020-01-26T15:32:34.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- 172.21.15.170:0/2760040072 wait complete. 2020-01-26T15:32:34.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.016 7f8535363700 1 -- 172.21.15.170:0/2760040072 >> 172.21.15.170:0/2760040072 conn(0x7f8530144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:34.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f8535363700 1 Processor -- start 2020-01-26T15:32:34.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f8535363700 1 -- - start start 2020-01-26T15:32:34.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f8535363700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300a3cf0 con 0 2020-01-26T15:32:34.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f8535363700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300a51a0 con 0 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852f269700 1 -- 172.21.15.170:0/2101639728 learned_addr learned my addr 172.21.15.170:0/2101639728 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85280011d0 con 0x7f85300a33f0 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4112114813 0 0) 0x7f85280018b0 con 0x7f85300a33f0 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8510002960 con 0 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85240024c0 con 0x7f8530095c30 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2256060805 0 0) 0x7f8524002840 con 0x7f8530095c30 2020-01-26T15:32:34.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8510004620 con 0 2020-01-26T15:32:34.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2684111158 0 0) 0x7f8528001e20 con 0x7f85300a33f0 2020-01-26T15:32:34.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8510002ee0 con 0 2020-01-26T15:32:34.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2180188207 0 0) 0x7f8524000e50 con 0x7f8530095c30 2020-01-26T15:32:34.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8510003540 con 0 2020-01-26T15:32:34.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2387757997 0 0) 0x7f85280039a0 con 0x7f85300a33f0 2020-01-26T15:32:34.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 >> 172.21.15.170:6790/0 conn(0x7f8530095c30 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-01-26T15:32:34.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853007ab10 con 0 2020-01-26T15:32:34.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f8535363700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300b2710 con 0 2020-01-26T15:32:34.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f8535363700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f85300a6c30 con 0 2020-01-26T15:32:34.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f85280016a0 con 0x7f85300a33f0 2020-01-26T15:32:34.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f8528003dd0 con 0x7f85300a33f0 2020-01-26T15:32:34.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f8528004b00 con 0x7f85300a33f0 2020-01-26T15:32:34.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.020 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f8528005590 con 0x7f85300a33f0 2020-01-26T15:32:34.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.028 7f8535363700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c002070 con 0 2020-01-26T15:32:34.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.032 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8528005be0 con 0x7f85300a33f0 2020-01-26T15:32:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.124 7f8535363700 1 -- 172.21.15.170:0/2101639728 --> 172.21.15.170:6789/0 -- mon_command({"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "1"} v 0) v1 -- 0x7f850c0012a0 con 0 2020-01-26T15:32:34.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.232 7f852ca64700 1 -- 172.21.15.170:0/2101639728 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "1"}]=0 v10) v1 ==== 105+0+0 (2450683133 0 0) 0x7f8528004e30 con 0x7f85300a33f0 2020-01-26T15:32:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.240 7f8535363700 1 -- 172.21.15.170:0/2101639728 >> 172.21.15.170:6800/11008 conn(0x7f8510006e70 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:32:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.240 7f8535363700 1 -- 172.21.15.170:0/2101639728 >> 172.21.15.170:6789/0 conn(0x7f85300a33f0 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:32:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.240 7f8535363700 1 -- 172.21.15.170:0/2101639728 shutdown_connections 2020-01-26T15:32:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.240 7f8535363700 1 -- 172.21.15.170:0/2101639728 shutdown_connections 2020-01-26T15:32:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.240 7f8535363700 1 -- 172.21.15.170:0/2101639728 wait complete. 2020-01-26T15:32:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.240 7f8535363700 1 -- 172.21.15.170:0/2101639728 >> 172.21.15.170:0/2101639728 conn(0x7f8530099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:34.254 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:34.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f201748b700 1 Processor -- start 2020-01-26T15:32:34.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f201748b700 1 -- - start start 2020-01-26T15:32:34.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f201748b700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201014bb10 con 0 2020-01-26T15:32:34.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f201748b700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201014beb0 con 0 2020-01-26T15:32:34.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f2014cb0700 1 -- 172.21.15.170:0/3778048919 learned_addr learned my addr 172.21.15.170:0/3778048919 2020-01-26T15:32:34.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2000003630 con 0x7f201014b3d0 2020-01-26T15:32:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (450808645 0 0) 0x7f20000039b0 con 0x7f201014b3d0 2020-01-26T15:32:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ffc002a20 con 0 2020-01-26T15:32:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f20040022a0 con 0x7f20101480d0 2020-01-26T15:32:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2197022109 0 0) 0x7f20040025a0 con 0x7f20101480d0 2020-01-26T15:32:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ffc0046c0 con 0 2020-01-26T15:32:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (585766174 0 0) 0x7f2000003f80 con 0x7f201014b3d0 2020-01-26T15:32:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 >> 172.21.15.170:6791/0 conn(0x7f20101480d0 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-01-26T15:32:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201007a930 con 0 2020-01-26T15:32:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2010116e80 con 0x7f201014b3d0 2020-01-26T15:32:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f200ffff700 1 -- 172.21.15.170:0/3778048919 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2000001050 con 0x7f201014b3d0 2020-01-26T15:32:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.348 7f201748b700 1 -- 172.21.15.170:0/3778048919 >> 172.21.15.170:6789/0 conn(0x7f201014b3d0 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:32:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- 172.21.15.170:0/3778048919 shutdown_connections 2020-01-26T15:32:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- 172.21.15.170:0/3778048919 shutdown_connections 2020-01-26T15:32:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- 172.21.15.170:0/3778048919 wait complete. 2020-01-26T15:32:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- 172.21.15.170:0/3778048919 >> 172.21.15.170:0/3778048919 conn(0x7f2010144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 Processor -- start 2020-01-26T15:32:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- - start start 2020-01-26T15:32:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20100a3d50 con 0 2020-01-26T15:32:34.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f201748b700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20100a5200 con 0 2020-01-26T15:32:34.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f20154b1700 1 -- 172.21.15.170:0/3002039228 learned_addr learned my addr 172.21.15.170:0/3002039228 2020-01-26T15:32:34.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f20040020e0 con 0x7f20100a3450 2020-01-26T15:32:34.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f2000000e50 con 0x7f2010095cd0 2020-01-26T15:32:34.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1463147302 0 0) 0x7f20040023e0 con 0x7f20100a3450 2020-01-26T15:32:34.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ff0002df0 con 0 2020-01-26T15:32:34.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2686676058 0 0) 0x7f2000003380 con 0x7f2010095cd0 2020-01-26T15:32:34.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ff0004620 con 0 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1720687920 0 0) 0x7f2004000e50 con 0x7f20100a3450 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ff0004df0 con 0 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (618878242 0 0) 0x7f2000003700 con 0x7f2010095cd0 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.352 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ff0006570 con 0 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3182634909 0 0) 0x7f20040013c0 con 0x7f20100a3450 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 >> 172.21.15.170:6790/0 conn(0x7f2010095cd0 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-01-26T15:32:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201007ab90 con 0 2020-01-26T15:32:34.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f201748b700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20100712f0 con 0 2020-01-26T15:32:34.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f201748b700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f20100a6c90 con 0 2020-01-26T15:32:34.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f20100e9ff0 con 0x7f20100a3450 2020-01-26T15:32:34.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f20040017f0 con 0x7f20100a3450 2020-01-26T15:32:34.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f2004001a30 con 0x7f20100a3450 2020-01-26T15:32:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.356 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f2004005ba0 con 0x7f20100a3450 2020-01-26T15:32:34.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.360 7f201748b700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec002070 con 0 2020-01-26T15:32:34.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.364 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2004003f90 con 0x7f20100a3450 2020-01-26T15:32:34.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.452 7f201748b700 1 -- 172.21.15.170:0/3002039228 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fec0011d0 con 0 2020-01-26T15:32:34.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.452 7f200e7fc700 1 -- 172.21.15.170:0/3002039228 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f2004004c10 con 0x7f20100a3450 2020-01-26T15:32:34.455 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:34.456 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:34.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.452 7f201748b700 1 -- 172.21.15.170:0/3002039228 >> 172.21.15.170:6800/11008 conn(0x7f1ff00072a0 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:32:34.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.452 7f201748b700 1 -- 172.21.15.170:0/3002039228 >> 172.21.15.170:6791/0 conn(0x7f20100a3450 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-01-26T15:32:34.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.456 7f201748b700 1 -- 172.21.15.170:0/3002039228 shutdown_connections 2020-01-26T15:32:34.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.456 7f201748b700 1 -- 172.21.15.170:0/3002039228 shutdown_connections 2020-01-26T15:32:34.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.456 7f201748b700 1 -- 172.21.15.170:0/3002039228 wait complete. 2020-01-26T15:32:34.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:34.456 7f201748b700 1 -- 172.21.15.170:0/3002039228 >> 172.21.15.170:0/3002039228 conn(0x7f2010099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:34.770 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:34.771 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:35.772 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:35.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99c1325700 1 Processor -- start 2020-01-26T15:32:35.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99c1325700 1 -- - start start 2020-01-26T15:32:35.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99c1325700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc14bb10 con 0 2020-01-26T15:32:35.868 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99c1325700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc14beb0 con 0 2020-01-26T15:32:35.868 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99bb269700 1 -- 172.21.15.170:0/405887091 learned_addr learned my addr 172.21.15.170:0/405887091 2020-01-26T15:32:35.869 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f99ac0039b0 con 0x7f99bc1480d0 2020-01-26T15:32:35.869 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1276269621 0 0) 0x7f99ac003d30 con 0x7f99bc1480d0 2020-01-26T15:32:35.869 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f999c002a20 con 0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f99a40022a0 con 0x7f99bc14b3d0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1778205812 0 0) 0x7f99a4002620 con 0x7f99bc14b3d0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f999c0046c0 con 0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1411320734 0 0) 0x7f99ac004300 con 0x7f99bc1480d0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 >> 172.21.15.170:6791/0 conn(0x7f99bc14b3d0 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc07a930 con 0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f99bc0e9ff0 con 0x7f99bc1480d0 2020-01-26T15:32:35.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.864 7f99ba267700 1 -- 172.21.15.170:0/405887091 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f99ac0013d0 con 0x7f99bc1480d0 2020-01-26T15:32:35.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- 172.21.15.170:0/405887091 >> 172.21.15.170:6790/0 conn(0x7f99bc1480d0 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-01-26T15:32:35.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- 172.21.15.170:0/405887091 shutdown_connections 2020-01-26T15:32:35.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- 172.21.15.170:0/405887091 shutdown_connections 2020-01-26T15:32:35.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- 172.21.15.170:0/405887091 wait complete. 2020-01-26T15:32:35.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- 172.21.15.170:0/405887091 >> 172.21.15.170:0/405887091 conn(0x7f99bc144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:35.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 Processor -- start 2020-01-26T15:32:35.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- - start start 2020-01-26T15:32:35.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0a3df0 con 0 2020-01-26T15:32:35.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99c1325700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0a6b30 con 0 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.868 7f99baa68700 1 -- 172.21.15.170:0/4086755465 learned_addr learned my addr 172.21.15.170:0/4086755465 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f99ac0011d0 con 0x7f99bc0a3400 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f99a40022a0 con 0x7f99bc0a6380 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1264202743 0 0) 0x7f99ac0018f0 con 0x7f99bc0a3400 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f99a0002df0 con 0 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (372612225 0 0) 0x7f99a40029b0 con 0x7f99bc0a6380 2020-01-26T15:32:35.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f99a0004620 con 0 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2005118516 0 0) 0x7f99ac001c70 con 0x7f99bc0a3400 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99a0004df0 con 0 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4035870162 0 0) 0x7f99a4000e50 con 0x7f99bc0a6380 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99a00034b0 con 0 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2323167843 0 0) 0x7f99ac003700 con 0x7f99bc0a3400 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 >> 172.21.15.170:6791/0 conn(0x7f99bc0a6380 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-01-26T15:32:35.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc07ab90 con 0 2020-01-26T15:32:35.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99c1325700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0b2780 con 0 2020-01-26T15:32:35.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99c1325700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc18b200 con 0 2020-01-26T15:32:35.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f99ac000f70 con 0x7f99bc0a3400 2020-01-26T15:32:35.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f99ac003b30 con 0x7f99bc0a3400 2020-01-26T15:32:35.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f99ac003d70 con 0x7f99bc0a3400 2020-01-26T15:32:35.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.872 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f99ac0052d0 con 0x7f99bc0a3400 2020-01-26T15:32:35.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.880 7f99c1325700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9994002070 con 0 2020-01-26T15:32:35.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.884 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f99ac004c10 con 0x7f99bc0a3400 2020-01-26T15:32:35.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.972 7f99c1325700 1 -- 172.21.15.170:0/4086755465 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99940011a0 con 0 2020-01-26T15:32:35.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99b8a64700 1 -- 172.21.15.170:0/4086755465 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f99ac0044c0 con 0x7f99bc0a3400 2020-01-26T15:32:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:35.978 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:35.978 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99c1325700 1 -- 172.21.15.170:0/4086755465 >> 172.21.15.170:6800/11008 conn(0x7f99a00072a0 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:32:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99c1325700 1 -- 172.21.15.170:0/4086755465 >> 172.21.15.170:6789/0 conn(0x7f99bc0a3400 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-01-26T15:32:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99c1325700 1 -- 172.21.15.170:0/4086755465 shutdown_connections 2020-01-26T15:32:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99c1325700 1 -- 172.21.15.170:0/4086755465 shutdown_connections 2020-01-26T15:32:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99c1325700 1 -- 172.21.15.170:0/4086755465 wait complete. 2020-01-26T15:32:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:35.976 7f99c1325700 1 -- 172.21.15.170:0/4086755465 >> 172.21.15.170:0/4086755465 conn(0x7f99bc099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:36.290 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:36.290 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:37.291 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.384 7f4dc0246700 1 Processor -- start 2020-01-26T15:32:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.384 7f4dc0246700 1 -- - start start 2020-01-26T15:32:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db814bb10 con 0 2020-01-26T15:32:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db814beb0 con 0 2020-01-26T15:32:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbe26c700 1 -- 172.21.15.170:0/2083503363 learned_addr learned my addr 172.21.15.170:0/2083503363 2020-01-26T15:32:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4db4003630 con 0x7f4db81480d0 2020-01-26T15:32:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3127214208 0 0) 0x7f4db40039b0 con 0x7f4db81480d0 2020-01-26T15:32:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4da0002a20 con 0 2020-01-26T15:32:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4da80022a0 con 0x7f4db814b3d0 2020-01-26T15:32:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (127362717 0 0) 0x7f4da80025a0 con 0x7f4db814b3d0 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4da00046c0 con 0 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1221048368 0 0) 0x7f4db4003f80 con 0x7f4db81480d0 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 >> 172.21.15.170:6790/0 conn(0x7f4db814b3d0 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db807a930 con 0 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4db80e9ff0 con 0x7f4db81480d0 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dbd26a700 1 -- 172.21.15.170:0/2083503363 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4db4001050 con 0x7f4db81480d0 2020-01-26T15:32:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- 172.21.15.170:0/2083503363 >> 172.21.15.170:6789/0 conn(0x7f4db81480d0 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:32:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- 172.21.15.170:0/2083503363 shutdown_connections 2020-01-26T15:32:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- 172.21.15.170:0/2083503363 shutdown_connections 2020-01-26T15:32:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- 172.21.15.170:0/2083503363 wait complete. 2020-01-26T15:32:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.388 7f4dc0246700 1 -- 172.21.15.170:0/2083503363 >> 172.21.15.170:0/2083503363 conn(0x7f4db8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4dc0246700 1 Processor -- start 2020-01-26T15:32:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4dc0246700 1 -- - start start 2020-01-26T15:32:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4dc0246700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db80a3d50 con 0 2020-01-26T15:32:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4dc0246700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db80a5200 con 0 2020-01-26T15:32:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4dbda6b700 1 -- 172.21.15.170:0/3350011020 learned_addr learned my addr 172.21.15.170:0/3350011020 2020-01-26T15:32:37.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4da80020e0 con 0x7f4db8095cd0 2020-01-26T15:32:37.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1868083766 0 0) 0x7f4da80023e0 con 0x7f4db8095cd0 2020-01-26T15:32:37.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d98002960 con 0 2020-01-26T15:32:37.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4db4000e50 con 0x7f4db80a3450 2020-01-26T15:32:37.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (474972685 0 0) 0x7f4db4003380 con 0x7f4db80a3450 2020-01-26T15:32:37.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d98004620 con 0 2020-01-26T15:32:37.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (711388845 0 0) 0x7f4da8000e50 con 0x7f4db8095cd0 2020-01-26T15:32:37.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d98002ee0 con 0 2020-01-26T15:32:37.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4271244594 0 0) 0x7f4db4003710 con 0x7f4db80a3450 2020-01-26T15:32:37.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d98003540 con 0 2020-01-26T15:32:37.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2342988869 0 0) 0x7f4da80014b0 con 0x7f4db8095cd0 2020-01-26T15:32:37.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 >> 172.21.15.170:6791/0 conn(0x7f4db80a3450 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-01-26T15:32:37.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db807ab90 con 0 2020-01-26T15:32:37.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.392 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db80b27b0 con 0 2020-01-26T15:32:37.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.396 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db80a6cd0 con 0 2020-01-26T15:32:37.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.396 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4db8116e80 con 0x7f4db8095cd0 2020-01-26T15:32:37.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.396 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4da80018e0 con 0x7f4db8095cd0 2020-01-26T15:32:37.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.396 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f4da8001b20 con 0x7f4db8095cd0 2020-01-26T15:32:37.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.396 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f4da8005c90 con 0x7f4db8095cd0 2020-01-26T15:32:37.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.400 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db807af30 con 0 2020-01-26T15:32:37.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.404 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4db807af30 con 0x7f4db8095cd0 2020-01-26T15:32:37.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4db818bd30 con 0 2020-01-26T15:32:37.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4da77fe700 1 -- 172.21.15.170:0/3350011020 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f4da8003f90 con 0x7f4db8095cd0 2020-01-26T15:32:37.499 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:37.499 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:37.499 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:37.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 >> 172.21.15.170:6800/11008 conn(0x7f4d98006ed0 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:32:37.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 >> 172.21.15.170:6790/0 conn(0x7f4db8095cd0 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-01-26T15:32:37.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 shutdown_connections 2020-01-26T15:32:37.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 shutdown_connections 2020-01-26T15:32:37.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 wait complete. 2020-01-26T15:32:37.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:37.496 7f4dc0246700 1 -- 172.21.15.170:0/3350011020 >> 172.21.15.170:0/3350011020 conn(0x7f4db8099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:37.814 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:37.814 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:38.815 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:38.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.912 7f18c361c700 1 Processor -- start 2020-01-26T15:32:38.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.912 7f18c361c700 1 -- - start start 2020-01-26T15:32:38.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.912 7f18c361c700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc14bb10 con 0 2020-01-26T15:32:38.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.912 7f18c361c700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc14beb0 con 0 2020-01-26T15:32:38.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.912 7f18c1642700 1 -- 172.21.15.170:0/94706470 learned_addr learned my addr 172.21.15.170:0/94706470 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f18b8003630 con 0x7f18bc1480d0 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2802745799 0 0) 0x7f18b80039b0 con 0x7f18bc1480d0 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f18a0002a20 con 0 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f18ac0022a0 con 0x7f18bc14b3d0 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (742349094 0 0) 0x7f18ac0025a0 con 0x7f18bc14b3d0 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f18a00046c0 con 0 2020-01-26T15:32:38.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3801334742 0 0) 0x7f18b8003eb0 con 0x7f18bc1480d0 2020-01-26T15:32:38.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 >> 172.21.15.170:6790/0 conn(0x7f18bc14b3d0 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-01-26T15:32:38.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc07a930 con 0 2020-01-26T15:32:38.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f18bc0e9ff0 con 0x7f18bc1480d0 2020-01-26T15:32:38.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18b3fff700 1 -- 172.21.15.170:0/94706470 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f18b8001010 con 0x7f18bc1480d0 2020-01-26T15:32:38.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18c361c700 1 -- 172.21.15.170:0/94706470 >> 172.21.15.170:6789/0 conn(0x7f18bc1480d0 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-01-26T15:32:38.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18c361c700 1 -- 172.21.15.170:0/94706470 shutdown_connections 2020-01-26T15:32:38.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18c361c700 1 -- 172.21.15.170:0/94706470 shutdown_connections 2020-01-26T15:32:38.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18c361c700 1 -- 172.21.15.170:0/94706470 wait complete. 2020-01-26T15:32:38.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.916 7f18c361c700 1 -- 172.21.15.170:0/94706470 >> 172.21.15.170:0/94706470 conn(0x7f18bc144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:38.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c361c700 1 Processor -- start 2020-01-26T15:32:38.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c361c700 1 -- - start start 2020-01-26T15:32:38.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c361c700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0a3e90 con 0 2020-01-26T15:32:38.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c361c700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0a5250 con 0 2020-01-26T15:32:38.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c1642700 1 -- 172.21.15.170:0/2624764100 learned_addr learned my addr 172.21.15.170:0/2624764100 2020-01-26T15:32:38.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f18b8000e50 con 0x7f18bc0a34a0 2020-01-26T15:32:38.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3730350996 0 0) 0x7f18b8001530 con 0x7f18bc0a34a0 2020-01-26T15:32:38.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f18a4002960 con 0 2020-01-26T15:32:38.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f18ac002ae0 con 0x7f18bc095cf0 2020-01-26T15:32:38.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4031982777 0 0) 0x7f18ac0020b0 con 0x7f18bc095cf0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f18a4004620 con 0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3477411306 0 0) 0x7f18b8001aa0 con 0x7f18bc0a34a0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f18a4002ee0 con 0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (109172531 0 0) 0x7f18ac002510 con 0x7f18bc095cf0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f18a4003540 con 0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2263123304 0 0) 0x7f18ac0010f0 con 0x7f18bc095cf0 2020-01-26T15:32:38.925 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 >> 172.21.15.170:6790/0 conn(0x7f18bc0a34a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=114 cs=1 l=1).mark_down 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc07ab90 con 0 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c361c700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc0b27f0 con 0 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f18ac000bf0 con 0x7f18bc095cf0 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18c361c700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc0a6c20 con 0 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f18ac001520 con 0x7f18bc095cf0 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f18ac001a40 con 0x7f18bc095cf0 2020-01-26T15:32:38.926 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.920 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f18ac004a70 con 0x7f18bc095cf0 2020-01-26T15:32:38.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.928 7f18c361c700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc07af30 con 0 2020-01-26T15:32:38.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:38.932 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f18bc07af30 con 0x7f18bc095cf0 2020-01-26T15:32:39.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.024 7f18c361c700 1 -- 172.21.15.170:0/2624764100 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18bc18bb70 con 0 2020-01-26T15:32:39.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.024 7f18b27fc700 1 -- 172.21.15.170:0/2624764100 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f18ac003520 con 0x7f18bc095cf0 2020-01-26T15:32:39.028 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:39.028 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:39.029 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:39.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.028 7f18c361c700 1 -- 172.21.15.170:0/2624764100 >> 172.21.15.170:6800/11008 conn(0x7f18a4006ec0 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-01-26T15:32:39.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.028 7f18c361c700 1 -- 172.21.15.170:0/2624764100 >> 172.21.15.170:6791/0 conn(0x7f18bc095cf0 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-01-26T15:32:39.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.028 7f18c361c700 1 -- 172.21.15.170:0/2624764100 shutdown_connections 2020-01-26T15:32:39.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.028 7f18c361c700 1 -- 172.21.15.170:0/2624764100 shutdown_connections 2020-01-26T15:32:39.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.028 7f18c361c700 1 -- 172.21.15.170:0/2624764100 wait complete. 2020-01-26T15:32:39.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:39.028 7f18c361c700 1 -- 172.21.15.170:0/2624764100 >> 172.21.15.170:0/2624764100 conn(0x7f18bc099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:39.343 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:39.343 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:40.345 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:40.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdedb2ea700 1 Processor -- start 2020-01-26T15:32:40.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdedb2ea700 1 -- - start start 2020-01-26T15:32:40.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdedb2ea700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded414bb60 con 0 2020-01-26T15:32:40.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdedb2ea700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded414bf00 con 0 2020-01-26T15:32:40.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fded8b0f700 1 -- 172.21.15.170:0/465301439 learned_addr learned my addr 172.21.15.170:0/465301439 2020-01-26T15:32:40.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fded0002620 con 0x7fded41480d0 2020-01-26T15:32:40.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1554298089 0 0) 0x7fded00029a0 con 0x7fded41480d0 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdecbfff700 1 -- 172.21.15.170:0/465301439 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdeb8002a20 con 0 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdec4003630 con 0x7fded414b3d0 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.440 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1505563263 0 0) 0x7fdec40039b0 con 0x7fded414b3d0 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdecbfff700 1 -- 172.21.15.170:0/465301439 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdeb80046c0 con 0 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3939660471 0 0) 0x7fded0002f70 con 0x7fded41480d0 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdecbfff700 1 -- 172.21.15.170:0/465301439 >> 172.21.15.170:6790/0 conn(0x7fded414b3d0 :-1 s=STATE_OPEN pgs=115 cs=1 l=1).mark_down 2020-01-26T15:32:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdecbfff700 1 -- 172.21.15.170:0/465301439 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded407a930 con 0 2020-01-26T15:32:40.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fded40e9ff0 con 0x7fded41480d0 2020-01-26T15:32:40.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdecbfff700 1 -- 172.21.15.170:0/465301439 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fded00013d0 con 0x7fded41480d0 2020-01-26T15:32:40.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- 172.21.15.170:0/465301439 >> 172.21.15.170:6791/0 conn(0x7fded41480d0 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-01-26T15:32:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- 172.21.15.170:0/465301439 shutdown_connections 2020-01-26T15:32:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- 172.21.15.170:0/465301439 shutdown_connections 2020-01-26T15:32:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- 172.21.15.170:0/465301439 wait complete. 2020-01-26T15:32:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- 172.21.15.170:0/465301439 >> 172.21.15.170:0/465301439 conn(0x7fded4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 Processor -- start 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- - start start 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40a3e80 con 0 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fdedb2ea700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded4095e60 con 0 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.444 7fded9310700 1 -- 172.21.15.170:0/429014978 learned_addr learned my addr 172.21.15.170:0/429014978 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fded0001390 con 0x7fded40a3440 2020-01-26T15:32:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1970107155 0 0) 0x7fded00023f0 con 0x7fded40a3440 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdebc002960 con 0 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdec4003ef0 con 0x7fded40a51f0 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2618775648 0 0) 0x7fdec4003470 con 0x7fded40a51f0 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdebc004620 con 0 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (933052755 0 0) 0x7fded0002960 con 0x7fded40a3440 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdebc002ee0 con 0 2020-01-26T15:32:40.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2517199142 0 0) 0x7fdec4003800 con 0x7fded40a51f0 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdebc003540 con 0 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3434811806 0 0) 0x7fded0001c80 con 0x7fded40a3440 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 >> 172.21.15.170:6789/0 conn(0x7fded40a51f0 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded407ab90 con 0 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded40b28d0 con 0 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fded40a6cc0 con 0 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fded00016e0 con 0x7fded40a3440 2020-01-26T15:32:40.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fded0003250 con 0x7fded40a3440 2020-01-26T15:32:40.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fded00039b0 con 0x7fded40a3440 2020-01-26T15:32:40.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.448 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fded00066f0 con 0x7fded40a3440 2020-01-26T15:32:40.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.456 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0002070 con 0 2020-01-26T15:32:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.460 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fded0003490 con 0x7fded40a3440 2020-01-26T15:32:40.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.552 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdeb00011d0 con 0 2020-01-26T15:32:40.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdeca7fc700 1 -- 172.21.15.170:0/429014978 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7fded0006990 con 0x7fded40a3440 2020-01-26T15:32:40.558 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:40.558 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:40.558 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:40.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 >> 172.21.15.170:6800/11008 conn(0x7fdebc0065f0 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-01-26T15:32:40.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 >> 172.21.15.170:6790/0 conn(0x7fded40a3440 :-1 s=STATE_OPEN pgs=116 cs=1 l=1).mark_down 2020-01-26T15:32:40.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 shutdown_connections 2020-01-26T15:32:40.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 shutdown_connections 2020-01-26T15:32:40.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 wait complete. 2020-01-26T15:32:40.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:40.556 7fdedb2ea700 1 -- 172.21.15.170:0/429014978 >> 172.21.15.170:0/429014978 conn(0x7fded4099660 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:40.872 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:40.872 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:41.874 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:41.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.972 7f0cc4f07700 1 Processor -- start 2020-01-26T15:32:41.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.972 7f0cc4f07700 1 -- - start start 2020-01-26T15:32:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc014bb10 con 0 2020-01-26T15:32:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc014beb0 con 0 2020-01-26T15:32:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbed71700 1 -- 172.21.15.170:0/1466399009 learned_addr learned my addr 172.21.15.170:0/1466399009 2020-01-26T15:32:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cb40022a0 con 0x7f0cc014b3d0 2020-01-26T15:32:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3710907736 0 0) 0x7f0cb4002620 con 0x7f0cc014b3d0 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0ca4002a20 con 0 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cb0003630 con 0x7f0cc01480d0 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (591126613 0 0) 0x7f0cb00039b0 con 0x7f0cc01480d0 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0ca40046c0 con 0 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2620387972 0 0) 0x7f0cb4002bf0 con 0x7f0cc014b3d0 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 >> 172.21.15.170:6790/0 conn(0x7f0cc01480d0 :-1 s=STATE_OPEN pgs=117 cs=1 l=1).mark_down 2020-01-26T15:32:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc007a930 con 0 2020-01-26T15:32:41.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0cc0116e80 con 0x7f0cc014b3d0 2020-01-26T15:32:41.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cbdd6f700 1 -- 172.21.15.170:0/1466399009 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cb4001050 con 0x7f0cc014b3d0 2020-01-26T15:32:41.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- 172.21.15.170:0/1466399009 >> 172.21.15.170:6791/0 conn(0x7f0cc014b3d0 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-01-26T15:32:41.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- 172.21.15.170:0/1466399009 shutdown_connections 2020-01-26T15:32:41.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- 172.21.15.170:0/1466399009 shutdown_connections 2020-01-26T15:32:41.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- 172.21.15.170:0/1466399009 wait complete. 2020-01-26T15:32:41.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.976 7f0cc4f07700 1 -- 172.21.15.170:0/1466399009 >> 172.21.15.170:0/1466399009 conn(0x7f0cc0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:41.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cc4f07700 1 Processor -- start 2020-01-26T15:32:41.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cc4f07700 1 -- - start start 2020-01-26T15:32:41.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cc4f07700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00a3f50 con 0 2020-01-26T15:32:41.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cc4f07700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00a5470 con 0 2020-01-26T15:32:41.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cbed71700 1 -- 172.21.15.170:0/275501748 learned_addr learned my addr 172.21.15.170:0/275501748 2020-01-26T15:32:41.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cb4000e50 con 0x7f0cc00a3560 2020-01-26T15:32:41.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (137577415 0 0) 0x7f0cb4001ff0 con 0x7f0cc00a3560 2020-01-26T15:32:41.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0c9c002960 con 0 2020-01-26T15:32:41.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cb0003470 con 0x7f0cc0095da0 2020-01-26T15:32:41.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2515525502 0 0) 0x7f0cb0003d40 con 0x7f0cc0095da0 2020-01-26T15:32:41.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0c9c004620 con 0 2020-01-26T15:32:41.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (635998585 0 0) 0x7f0cb4002440 con 0x7f0cc00a3560 2020-01-26T15:32:41.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c9c002ee0 con 0 2020-01-26T15:32:41.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (354358200 0 0) 0x7f0cb0003fb0 con 0x7f0cc0095da0 2020-01-26T15:32:41.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c9c003540 con 0 2020-01-26T15:32:41.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1957373318 0 0) 0x7f0cb4001810 con 0x7f0cc00a3560 2020-01-26T15:32:41.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 >> 172.21.15.170:6789/0 conn(0x7f0cc0095da0 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-01-26T15:32:41.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc007ab90 con 0 2020-01-26T15:32:41.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc00712f0 con 0 2020-01-26T15:32:41.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc00a6da0 con 0 2020-01-26T15:32:41.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0cb4000bf0 con 0x7f0cc00a3560 2020-01-26T15:32:41.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0cb4001c40 con 0x7f0cc00a3560 2020-01-26T15:32:41.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f0cb40033f0 con 0x7f0cc00a3560 2020-01-26T15:32:41.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.980 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f0cb4004c80 con 0x7f0cc00a3560 2020-01-26T15:32:41.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.988 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0002070 con 0 2020-01-26T15:32:41.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:41.992 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0cb4002ed0 con 0x7f0cc00a3560 2020-01-26T15:32:42.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca00011d0 con 0 2020-01-26T15:32:42.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0caffff700 1 -- 172.21.15.170:0/275501748 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f0cb4003cf0 con 0x7f0cc00a3560 2020-01-26T15:32:42.092 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:42.092 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:42.092 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:42.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 >> 172.21.15.170:6800/11008 conn(0x7f0c9c006400 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-01-26T15:32:42.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 >> 172.21.15.170:6790/0 conn(0x7f0cc00a3560 :-1 s=STATE_OPEN pgs=118 cs=1 l=1).mark_down 2020-01-26T15:32:42.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 shutdown_connections 2020-01-26T15:32:42.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 shutdown_connections 2020-01-26T15:32:42.094 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 wait complete. 2020-01-26T15:32:42.094 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:42.088 7f0cc4f07700 1 -- 172.21.15.170:0/275501748 >> 172.21.15.170:0/275501748 conn(0x7f0cc0099660 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:42.409 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:42.409 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:43.410 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:43.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b9d9f700 1 Processor -- start 2020-01-26T15:32:43.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b9d9f700 1 -- - start start 2020-01-26T15:32:43.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b9d9f700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b414bb10 con 0 2020-01-26T15:32:43.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b9d9f700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b414beb0 con 0 2020-01-26T15:32:43.511 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b2ffd700 1 -- 172.21.15.170:0/2665342102 learned_addr learned my addr 172.21.15.170:0/2665342102 2020-01-26T15:32:43.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f309c003630 con 0x7f30b414b3d0 2020-01-26T15:32:43.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (503038822 0 0) 0x7f309c0039b0 con 0x7f30b414b3d0 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3094002a20 con 0 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f30a4002620 con 0x7f30b41480d0 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (446883201 0 0) 0x7f30a40029a0 con 0x7f30b41480d0 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f30940046c0 con 0 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1869505156 0 0) 0x7f309c003f80 con 0x7f30b414b3d0 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 >> 172.21.15.170:6789/0 conn(0x7f30b41480d0 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-01-26T15:32:43.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b407a930 con 0 2020-01-26T15:32:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f30b4116e80 con 0x7f30b414b3d0 2020-01-26T15:32:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b27fc700 1 -- 172.21.15.170:0/2665342102 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f309c001050 con 0x7f30b414b3d0 2020-01-26T15:32:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.508 7f30b9d9f700 1 -- 172.21.15.170:0/2665342102 >> 172.21.15.170:6791/0 conn(0x7f30b414b3d0 :-1 s=STATE_OPEN pgs=114 cs=1 l=1).mark_down 2020-01-26T15:32:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.512 7f30b9d9f700 1 -- 172.21.15.170:0/2665342102 shutdown_connections 2020-01-26T15:32:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.512 7f30b9d9f700 1 -- 172.21.15.170:0/2665342102 shutdown_connections 2020-01-26T15:32:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.512 7f30b9d9f700 1 -- 172.21.15.170:0/2665342102 wait complete. 2020-01-26T15:32:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.512 7f30b9d9f700 1 -- 172.21.15.170:0/2665342102 >> 172.21.15.170:0/2665342102 conn(0x7f30b4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.512 7f30b9d9f700 1 Processor -- start 2020-01-26T15:32:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.512 7f30b9d9f700 1 -- - start start 2020-01-26T15:32:43.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b9d9f700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b40a3f50 con 0 2020-01-26T15:32:43.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b9d9f700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b40a5470 con 0 2020-01-26T15:32:43.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b37fe700 1 -- 172.21.15.170:0/2672072527 learned_addr learned my addr 172.21.15.170:0/2672072527 2020-01-26T15:32:43.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f30a4002620 con 0x7f30b4095da0 2020-01-26T15:32:43.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2054341765 0 0) 0x7f30a4002d30 con 0x7f30b4095da0 2020-01-26T15:32:43.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3098002960 con 0 2020-01-26T15:32:43.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f309c000e50 con 0x7f30b40a3560 2020-01-26T15:32:43.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2752174398 0 0) 0x7f309c001570 con 0x7f30b40a3560 2020-01-26T15:32:43.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3098004620 con 0 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (957392957 0 0) 0x7f30a40012f0 con 0x7f30b4095da0 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3098002ee0 con 0 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4027178774 0 0) 0x7f309c001900 con 0x7f30b40a3560 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3098003540 con 0 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1851259946 0 0) 0x7f30a4001950 con 0x7f30b4095da0 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 >> 172.21.15.170:6789/0 conn(0x7f30b40a3560 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-01-26T15:32:43.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b407ab90 con 0 2020-01-26T15:32:43.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b40712f0 con 0 2020-01-26T15:32:43.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b40a6da0 con 0 2020-01-26T15:32:43.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f30b40e9ff0 con 0x7f30b4095da0 2020-01-26T15:32:43.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f30a4001d80 con 0x7f30b4095da0 2020-01-26T15:32:43.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f30a4004830 con 0x7f30b4095da0 2020-01-26T15:32:43.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.516 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f30a4006070 con 0x7f30b4095da0 2020-01-26T15:32:43.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.524 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308c002070 con 0 2020-01-26T15:32:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.524 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f30a4004310 con 0x7f30b4095da0 2020-01-26T15:32:43.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.612 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f308c0011d0 con 0 2020-01-26T15:32:43.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.612 7f30b0ff9700 1 -- 172.21.15.170:0/2672072527 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f30a4006350 con 0x7f30b4095da0 2020-01-26T15:32:43.615 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:43.615 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:43.615 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:43.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.616 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 >> 172.21.15.170:6800/11008 conn(0x7f3098006ed0 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-01-26T15:32:43.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.616 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 >> 172.21.15.170:6791/0 conn(0x7f30b4095da0 :-1 s=STATE_OPEN pgs=115 cs=1 l=1).mark_down 2020-01-26T15:32:43.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.616 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 shutdown_connections 2020-01-26T15:32:43.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.616 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 shutdown_connections 2020-01-26T15:32:43.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.616 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 wait complete. 2020-01-26T15:32:43.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:43.616 7f30b9d9f700 1 -- 172.21.15.170:0/2672072527 >> 172.21.15.170:0/2672072527 conn(0x7f30b4099660 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:43.932 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:43.932 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:44.933 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:45.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb2362f8700 1 Processor -- start 2020-01-26T15:32:45.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb2362f8700 1 -- - start start 2020-01-26T15:32:45.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb2362f8700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23014bb10 con 0 2020-01-26T15:32:45.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb2362f8700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23014beb0 con 0 2020-01-26T15:32:45.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22f7fe700 1 -- 172.21.15.170:0/3676267988 learned_addr learned my addr 172.21.15.170:0/3676267988 2020-01-26T15:32:45.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2200025a0 con 0x7fb2301480d0 2020-01-26T15:32:45.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1686274138 0 0) 0x7fb220002920 con 0x7fb2301480d0 2020-01-26T15:32:45.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22effd700 1 -- 172.21.15.170:0/3676267988 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb21c0029d0 con 0 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb224003630 con 0x7fb23014b3d0 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3049696552 0 0) 0x7fb224003930 con 0x7fb23014b3d0 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.028 7fb22effd700 1 -- 172.21.15.170:0/3676267988 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb21c004800 con 0 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2657856890 0 0) 0x7fb224003de0 con 0x7fb23014b3d0 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb22effd700 1 -- 172.21.15.170:0/3676267988 >> 172.21.15.170:6790/0 conn(0x7fb2301480d0 :-1 s=STATE_OPEN pgs=119 cs=1 l=1).mark_down 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb22effd700 1 -- 172.21.15.170:0/3676267988 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23007a930 con 0 2020-01-26T15:32:45.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb230116e80 con 0x7fb23014b3d0 2020-01-26T15:32:45.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb22effd700 1 -- 172.21.15.170:0/3676267988 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb224001010 con 0x7fb23014b3d0 2020-01-26T15:32:45.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 -- 172.21.15.170:0/3676267988 >> 172.21.15.170:6791/0 conn(0x7fb23014b3d0 :-1 s=STATE_OPEN pgs=116 cs=1 l=1).mark_down 2020-01-26T15:32:45.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 -- 172.21.15.170:0/3676267988 shutdown_connections 2020-01-26T15:32:45.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 -- 172.21.15.170:0/3676267988 shutdown_connections 2020-01-26T15:32:45.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 -- 172.21.15.170:0/3676267988 wait complete. 2020-01-26T15:32:45.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 -- 172.21.15.170:0/3676267988 >> 172.21.15.170:0/3676267988 conn(0x7fb230144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:45.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 Processor -- start 2020-01-26T15:32:45.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.032 7fb2362f8700 1 -- - start start 2020-01-26T15:32:45.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb2362f8700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2300a3cb0 con 0 2020-01-26T15:32:45.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb2362f8700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2300a6a80 con 0 2020-01-26T15:32:45.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22ffff700 1 -- 172.21.15.170:0/3228062997 learned_addr learned my addr 172.21.15.170:0/3228062997 2020-01-26T15:32:45.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb224003de0 con 0x7fb2300a62d0 2020-01-26T15:32:45.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4039135201 0 0) 0x7fb224000e50 con 0x7fb2300a62d0 2020-01-26T15:32:45.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2100029c0 con 0 2020-01-26T15:32:45.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2200023b0 con 0x7fb2300a32c0 2020-01-26T15:32:45.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2156835699 0 0) 0x7fb2200026b0 con 0x7fb2300a32c0 2020-01-26T15:32:45.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb210004680 con 0 2020-01-26T15:32:45.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2204935366 0 0) 0x7fb224003410 con 0x7fb2300a62d0 2020-01-26T15:32:45.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb210002f40 con 0 2020-01-26T15:32:45.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4013260433 0 0) 0x7fb2200011d0 con 0x7fb2300a32c0 2020-01-26T15:32:45.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2100035a0 con 0 2020-01-26T15:32:45.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1437855605 0 0) 0x7fb2240017d0 con 0x7fb2300a62d0 2020-01-26T15:32:45.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 >> 172.21.15.170:6790/0 conn(0x7fb2300a32c0 :-1 s=STATE_OPEN pgs=120 cs=1 l=1).mark_down 2020-01-26T15:32:45.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23007ab90 con 0 2020-01-26T15:32:45.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2300b29a0 con 0 2020-01-26T15:32:45.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23018b170 con 0 2020-01-26T15:32:45.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb224001320 con 0x7fb2300a62d0 2020-01-26T15:32:45.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb224001c00 con 0x7fb2300a62d0 2020-01-26T15:32:45.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fb224004880 con 0x7fb2300a62d0 2020-01-26T15:32:45.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.036 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fb224004b60 con 0x7fb2300a62d0 2020-01-26T15:32:45.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.040 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23007af30 con 0 2020-01-26T15:32:45.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.048 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb23007af30 con 0x7fb2300a62d0 2020-01-26T15:32:45.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.140 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb230073330 con 0 2020-01-26T15:32:45.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.140 7fb22d7fa700 1 -- 172.21.15.170:0/3228062997 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7fb224004360 con 0x7fb2300a62d0 2020-01-26T15:32:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:45.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:45.144 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:45.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.140 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 >> 172.21.15.170:6800/11008 conn(0x7fb210006ed0 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:32:45.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.140 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 >> 172.21.15.170:6789/0 conn(0x7fb2300a62d0 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-01-26T15:32:45.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.140 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 shutdown_connections 2020-01-26T15:32:45.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.144 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 shutdown_connections 2020-01-26T15:32:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.144 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 wait complete. 2020-01-26T15:32:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:45.144 7fb2362f8700 1 -- 172.21.15.170:0/3228062997 >> 172.21.15.170:0/3228062997 conn(0x7fb2300994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:45.460 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:45.461 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:46.461 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:46.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.556 7f85fc9d6700 1 Processor -- start 2020-01-26T15:32:46.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.556 7f85fc9d6700 1 -- - start start 2020-01-26T15:32:46.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f814bb10 con 0 2020-01-26T15:32:46.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f814beb0 con 0 2020-01-26T15:32:46.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f6025700 1 -- 172.21.15.170:0/1292185583 learned_addr learned my addr 172.21.15.170:0/1292185583 2020-01-26T15:32:46.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85e8003630 con 0x7f85f814b3d0 2020-01-26T15:32:46.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (937028061 0 0) 0x7f85e80039b0 con 0x7f85f814b3d0 2020-01-26T15:32:46.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f85d8002a20 con 0 2020-01-26T15:32:46.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85e00022a0 con 0x7f85f81480d0 2020-01-26T15:32:46.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2481962537 0 0) 0x7f85e00025a0 con 0x7f85f81480d0 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f85d80046c0 con 0 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (648414258 0 0) 0x7f85e8003f80 con 0x7f85f814b3d0 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 >> 172.21.15.170:6790/0 conn(0x7f85f81480d0 :-1 s=STATE_OPEN pgs=121 cs=1 l=1).mark_down 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f807a930 con 0 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f85f8116e80 con 0x7f85f814b3d0 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85f5824700 1 -- 172.21.15.170:0/1292185583 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85e8001050 con 0x7f85f814b3d0 2020-01-26T15:32:46.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- 172.21.15.170:0/1292185583 >> 172.21.15.170:6791/0 conn(0x7f85f814b3d0 :-1 s=STATE_OPEN pgs=117 cs=1 l=1).mark_down 2020-01-26T15:32:46.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- 172.21.15.170:0/1292185583 shutdown_connections 2020-01-26T15:32:46.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- 172.21.15.170:0/1292185583 shutdown_connections 2020-01-26T15:32:46.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- 172.21.15.170:0/1292185583 wait complete. 2020-01-26T15:32:46.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.560 7f85fc9d6700 1 -- 172.21.15.170:0/1292185583 >> 172.21.15.170:0/1292185583 conn(0x7f85f8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:46.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85fc9d6700 1 Processor -- start 2020-01-26T15:32:46.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85fc9d6700 1 -- - start start 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85fc9d6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80a3fa0 con 0 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85fc9d6700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80a6ce0 con 0 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85f6826700 1 -- 172.21.15.170:0/2148482752 learned_addr learned my addr 172.21.15.170:0/2148482752 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85e00020e0 con 0x7f85f80a35b0 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1696196667 0 0) 0x7f85e00023e0 con 0x7f85f80a35b0 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f85dc002960 con 0 2020-01-26T15:32:46.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85e8000e50 con 0x7f85f80a6530 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1332705451 0 0) 0x7f85e8003380 con 0x7f85f80a6530 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f85dc004620 con 0 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3737030274 0 0) 0x7f85e0000e50 con 0x7f85f80a35b0 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f85dc002ee0 con 0 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (83939985 0 0) 0x7f85e8003700 con 0x7f85f80a6530 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.564 7f85effff700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f85dc003540 con 0 2020-01-26T15:32:46.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3029447053 0 0) 0x7f85e00014e0 con 0x7f85f80a35b0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 >> 172.21.15.170:6791/0 conn(0x7f85f80a6530 :-1 s=STATE_OPEN pgs=118 cs=1 l=1).mark_down 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f807ab90 con 0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f80712f0 con 0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f85f80e9ff0 con 0x7f85f80a35b0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f85e0001910 con 0x7f85f80a35b0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8096050 con 0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f85e00044b0 con 0x7f85f80a35b0 2020-01-26T15:32:46.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.568 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f85e0005f70 con 0x7f85f80a35b0 2020-01-26T15:32:46.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.572 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f807af30 con 0 2020-01-26T15:32:46.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.576 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f85e001a040 con 0x7f85f80a35b0 2020-01-26T15:32:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.668 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f80ba3b0 con 0 2020-01-26T15:32:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85effff700 1 -- 172.21.15.170:0/2148482752 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f85e00078f0 con 0x7f85f80a35b0 2020-01-26T15:32:46.673 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:46.673 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:46.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 >> 172.21.15.170:6800/11008 conn(0x7f85dc006e70 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-01-26T15:32:46.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 >> 172.21.15.170:6789/0 conn(0x7f85f80a35b0 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-01-26T15:32:46.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 shutdown_connections 2020-01-26T15:32:46.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 shutdown_connections 2020-01-26T15:32:46.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 wait complete. 2020-01-26T15:32:46.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:46.672 7f85fc9d6700 1 -- 172.21.15.170:0/2148482752 >> 172.21.15.170:0/2148482752 conn(0x7f85f8099620 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:46.986 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:46.987 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:47.987 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.088 7fb3133bf700 1 Processor -- start 2020-01-26T15:32:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.088 7fb3133bf700 1 -- - start start 2020-01-26T15:32:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c14bb10 con 0 2020-01-26T15:32:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c14beb0 con 0 2020-01-26T15:32:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb310be4700 1 -- 172.21.15.170:0/2180405089 learned_addr learned my addr 172.21.15.170:0/2180405089 2020-01-26T15:32:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2fc003630 con 0x7fb30c14b3d0 2020-01-26T15:32:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3588400522 0 0) 0x7fb2fc0039b0 con 0x7fb30c14b3d0 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2f0002a20 con 0 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb3080022a0 con 0x7fb30c1480d0 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2593435311 0 0) 0x7fb3080025a0 con 0x7fb30c1480d0 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2f00046c0 con 0 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1951293974 0 0) 0x7fb2fc003f80 con 0x7fb30c14b3d0 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 >> 172.21.15.170:6789/0 conn(0x7fb30c1480d0 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-01-26T15:32:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c07a930 con 0 2020-01-26T15:32:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb30c116e80 con 0x7fb30c14b3d0 2020-01-26T15:32:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb303fff700 1 -- 172.21.15.170:0/2180405089 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2fc001050 con 0x7fb30c14b3d0 2020-01-26T15:32:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- 172.21.15.170:0/2180405089 >> 172.21.15.170:6791/0 conn(0x7fb30c14b3d0 :-1 s=STATE_OPEN pgs=119 cs=1 l=1).mark_down 2020-01-26T15:32:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- 172.21.15.170:0/2180405089 shutdown_connections 2020-01-26T15:32:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- 172.21.15.170:0/2180405089 shutdown_connections 2020-01-26T15:32:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- 172.21.15.170:0/2180405089 wait complete. 2020-01-26T15:32:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.092 7fb3133bf700 1 -- 172.21.15.170:0/2180405089 >> 172.21.15.170:0/2180405089 conn(0x7fb30c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3133bf700 1 Processor -- start 2020-01-26T15:32:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3133bf700 1 -- - start start 2020-01-26T15:32:48.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3133bf700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0a3e40 con 0 2020-01-26T15:32:48.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3133bf700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0a35b0 con 0 2020-01-26T15:32:48.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb310be4700 1 -- 172.21.15.170:0/549547869 learned_addr learned my addr 172.21.15.170:0/549547869 2020-01-26T15:32:48.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb308002ae0 con 0x7fb30c095d50 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3450998198 0 0) 0x7fb3080020e0 con 0x7fb30c095d50 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2f4002960 con 0 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2fc000e50 con 0x7fb30c0a5200 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (161042547 0 0) 0x7fb2fc003380 con 0x7fb30c0a5200 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2f4004620 con 0 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1955194137 0 0) 0x7fb3080025b0 con 0x7fb30c095d50 2020-01-26T15:32:48.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2f4002ee0 con 0 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (570829106 0 0) 0x7fb2fc003700 con 0x7fb30c0a5200 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2f4003540 con 0 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1901199413 0 0) 0x7fb3080010f0 con 0x7fb30c095d50 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 >> 172.21.15.170:6790/0 conn(0x7fb30c0a5200 :-1 s=STATE_OPEN pgs=122 cs=1 l=1).mark_down 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c07ab90 con 0 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3133bf700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0712f0 con 0 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3133bf700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c0a6bf0 con 0 2020-01-26T15:32:48.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb308000bf0 con 0x7fb30c095d50 2020-01-26T15:32:48.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb308001520 con 0x7fb30c095d50 2020-01-26T15:32:48.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fb308001970 con 0x7fb30c095d50 2020-01-26T15:32:48.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.096 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fb308003bf0 con 0x7fb30c095d50 2020-01-26T15:32:48.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.104 7fb3133bf700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8002070 con 0 2020-01-26T15:32:48.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.108 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb308002f40 con 0x7fb30c095d50 2020-01-26T15:32:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.200 7fb3133bf700 1 -- 172.21.15.170:0/549547869 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2e80011d0 con 0 2020-01-26T15:32:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.200 7fb3027fc700 1 -- 172.21.15.170:0/549547869 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7fb308003440 con 0x7fb30c095d50 2020-01-26T15:32:48.204 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:48.204 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.204 7fb3133bf700 1 -- 172.21.15.170:0/549547869 >> 172.21.15.170:6800/11008 conn(0x7fb2f4006ed0 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-01-26T15:32:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.204 7fb3133bf700 1 -- 172.21.15.170:0/549547869 >> 172.21.15.170:6789/0 conn(0x7fb30c095d50 :-1 s=STATE_OPEN pgs=114 cs=1 l=1).mark_down 2020-01-26T15:32:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.204 7fb3133bf700 1 -- 172.21.15.170:0/549547869 shutdown_connections 2020-01-26T15:32:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.204 7fb3133bf700 1 -- 172.21.15.170:0/549547869 shutdown_connections 2020-01-26T15:32:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.204 7fb3133bf700 1 -- 172.21.15.170:0/549547869 wait complete. 2020-01-26T15:32:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:48.204 7fb3133bf700 1 -- 172.21.15.170:0/549547869 >> 172.21.15.170:0/549547869 conn(0x7fb30c099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:48.517 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:48.518 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:49.519 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:49.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe168170700 1 Processor -- start 2020-01-26T15:32:49.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe168170700 1 -- - start start 2020-01-26T15:32:49.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe168170700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16014bb10 con 0 2020-01-26T15:32:49.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe168170700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16014beb0 con 0 2020-01-26T15:32:49.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe166196700 1 -- 172.21.15.170:0/3232895977 learned_addr learned my addr 172.21.15.170:0/3232895977 2020-01-26T15:32:49.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fe15c003630 con 0x7fe1601480d0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2040764749 0 0) 0x7fe15c0039b0 con 0x7fe1601480d0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe148002a20 con 0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fe1500022a0 con 0x7fe16014b3d0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2995764737 0 0) 0x7fe1500025a0 con 0x7fe16014b3d0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe1480046c0 con 0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3848463590 0 0) 0x7fe150002a40 con 0x7fe16014b3d0 2020-01-26T15:32:49.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 >> 172.21.15.170:6790/0 conn(0x7fe1601480d0 :-1 s=STATE_OPEN pgs=123 cs=1 l=1).mark_down 2020-01-26T15:32:49.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.604 7fe165194700 1 -- 172.21.15.170:0/3232895977 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16007a930 con 0 2020-01-26T15:32:49.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe160116e80 con 0x7fe16014b3d0 2020-01-26T15:32:49.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe165194700 1 -- 172.21.15.170:0/3232895977 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fe150000e50 con 0x7fe16014b3d0 2020-01-26T15:32:49.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe168170700 1 -- 172.21.15.170:0/3232895977 >> 172.21.15.170:6789/0 conn(0x7fe16014b3d0 :-1 s=STATE_OPEN pgs=115 cs=1 l=1).mark_down 2020-01-26T15:32:49.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe168170700 1 -- 172.21.15.170:0/3232895977 shutdown_connections 2020-01-26T15:32:49.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe168170700 1 -- 172.21.15.170:0/3232895977 shutdown_connections 2020-01-26T15:32:49.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe168170700 1 -- 172.21.15.170:0/3232895977 wait complete. 2020-01-26T15:32:49.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.608 7fe168170700 1 -- 172.21.15.170:0/3232895977 >> 172.21.15.170:0/3232895977 conn(0x7fe160144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:49.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe168170700 1 Processor -- start 2020-01-26T15:32:49.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe168170700 1 -- - start start 2020-01-26T15:32:49.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe168170700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600a3d00 con 0 2020-01-26T15:32:49.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe168170700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600a6ad0 con 0 2020-01-26T15:32:49.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe166196700 1 -- 172.21.15.170:0/1938226827 learned_addr learned my addr 172.21.15.170:0/1938226827 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fe15c003440 con 0x7fe1600a3310 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1627448363 0 0) 0x7fe15c003780 con 0x7fe1600a3310 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe140002960 con 0 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fe150002a40 con 0x7fe1600a6320 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (856582130 0 0) 0x7fe150002080 con 0x7fe1600a6320 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe140004620 con 0 2020-01-26T15:32:49.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3149616627 0 0) 0x7fe15c000e50 con 0x7fe1600a3310 2020-01-26T15:32:49.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe140002ee0 con 0 2020-01-26T15:32:49.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3813696054 0 0) 0x7fe150002400 con 0x7fe1600a6320 2020-01-26T15:32:49.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe140003540 con 0 2020-01-26T15:32:49.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2279126726 0 0) 0x7fe15c001390 con 0x7fe1600a3310 2020-01-26T15:32:49.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 >> 172.21.15.170:6789/0 conn(0x7fe1600a6320 :-1 s=STATE_OPEN pgs=116 cs=1 l=1).mark_down 2020-01-26T15:32:49.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16007ab90 con 0 2020-01-26T15:32:49.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe168170700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1600712f0 con 0 2020-01-26T15:32:49.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe168170700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16018b180 con 0 2020-01-26T15:32:49.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe1600e9ff0 con 0x7fe1600a3310 2020-01-26T15:32:49.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fe15c0017c0 con 0x7fe1600a3310 2020-01-26T15:32:49.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fe15c001a00 con 0x7fe1600a3310 2020-01-26T15:32:49.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.612 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fe15c005e70 con 0x7fe1600a3310 2020-01-26T15:32:49.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.616 7fe168170700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16007af30 con 0 2020-01-26T15:32:49.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.624 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe16007af30 con 0x7fe1600a3310 2020-01-26T15:32:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.712 7fe168170700 1 -- 172.21.15.170:0/1938226827 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1601563d0 con 0 2020-01-26T15:32:49.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.712 7fe14f7fe700 1 -- 172.21.15.170:0/1938226827 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7fe15c004260 con 0x7fe1600a3310 2020-01-26T15:32:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:49.716 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:49.716 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.716 7fe168170700 1 -- 172.21.15.170:0/1938226827 >> 172.21.15.170:6800/11008 conn(0x7fe140006e70 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:32:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.716 7fe168170700 1 -- 172.21.15.170:0/1938226827 >> 172.21.15.170:6790/0 conn(0x7fe1600a3310 :-1 s=STATE_OPEN pgs=124 cs=1 l=1).mark_down 2020-01-26T15:32:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.716 7fe168170700 1 -- 172.21.15.170:0/1938226827 shutdown_connections 2020-01-26T15:32:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.716 7fe168170700 1 -- 172.21.15.170:0/1938226827 shutdown_connections 2020-01-26T15:32:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.716 7fe168170700 1 -- 172.21.15.170:0/1938226827 wait complete. 2020-01-26T15:32:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:49.716 7fe168170700 1 -- 172.21.15.170:0/1938226827 >> 172.21.15.170:0/1938226827 conn(0x7fe160099710 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:50.030 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:50.030 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:51.031 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:51.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.128 7fd97053d700 1 Processor -- start 2020-01-26T15:32:51.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.128 7fd97053d700 1 -- - start start 2020-01-26T15:32:51.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96814bb10 con 0 2020-01-26T15:32:51.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96814beb0 con 0 2020-01-26T15:32:51.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96dd62700 1 -- 172.21.15.170:0/1046299790 learned_addr learned my addr 172.21.15.170:0/1046299790 2020-01-26T15:32:51.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd958003630 con 0x7fd96814b3d0 2020-01-26T15:32:51.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2697333021 0 0) 0x7fd9580039b0 con 0x7fd96814b3d0 2020-01-26T15:32:51.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd950002a20 con 0 2020-01-26T15:32:51.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd9640022a0 con 0x7fd9681480d0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2769041325 0 0) 0x7fd9640025a0 con 0x7fd9681480d0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd9500046c0 con 0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3184860277 0 0) 0x7fd958003f80 con 0x7fd96814b3d0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 >> 172.21.15.170:6790/0 conn(0x7fd9681480d0 :-1 s=STATE_OPEN pgs=125 cs=1 l=1).mark_down 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96807a930 con 0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd968116e80 con 0x7fd96814b3d0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd96d561700 1 -- 172.21.15.170:0/1046299790 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd958001050 con 0x7fd96814b3d0 2020-01-26T15:32:51.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- 172.21.15.170:0/1046299790 >> 172.21.15.170:6791/0 conn(0x7fd96814b3d0 :-1 s=STATE_OPEN pgs=120 cs=1 l=1).mark_down 2020-01-26T15:32:51.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- 172.21.15.170:0/1046299790 shutdown_connections 2020-01-26T15:32:51.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- 172.21.15.170:0/1046299790 shutdown_connections 2020-01-26T15:32:51.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- 172.21.15.170:0/1046299790 wait complete. 2020-01-26T15:32:51.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.132 7fd97053d700 1 -- 172.21.15.170:0/1046299790 >> 172.21.15.170:0/1046299790 conn(0x7fd968144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:51.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd97053d700 1 Processor -- start 2020-01-26T15:32:51.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd97053d700 1 -- - start start 2020-01-26T15:32:51.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd97053d700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680a3e00 con 0 2020-01-26T15:32:51.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd97053d700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680a6b40 con 0 2020-01-26T15:32:51.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd96e563700 1 -- 172.21.15.170:0/353242762 learned_addr learned my addr 172.21.15.170:0/353242762 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd9640020b0 con 0x7fd9680a3410 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1823939200 0 0) 0x7fd964002430 con 0x7fd9680a3410 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd948002960 con 0 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd958000e50 con 0x7fd9680a6390 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2100838008 0 0) 0x7fd958001570 con 0x7fd9680a6390 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd948004620 con 0 2020-01-26T15:32:51.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (380347189 0 0) 0x7fd964000e50 con 0x7fd9680a3410 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd948002ee0 con 0 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3833746344 0 0) 0x7fd9580018f0 con 0x7fd9680a6390 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd948003540 con 0 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1718768697 0 0) 0x7fd964001540 con 0x7fd9680a3410 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 >> 172.21.15.170:6789/0 conn(0x7fd9680a6390 :-1 s=STATE_OPEN pgs=117 cs=1 l=1).mark_down 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd9577fe700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96807ab90 con 0 2020-01-26T15:32:51.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd97053d700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9680b27b0 con 0 2020-01-26T15:32:51.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.136 7fd97053d700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96818b200 con 0 2020-01-26T15:32:51.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.140 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd964000bf0 con 0x7fd9680a3410 2020-01-26T15:32:51.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.140 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fd964001970 con 0x7fd9680a3410 2020-01-26T15:32:51.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.140 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fd9640044b0 con 0x7fd9680a3410 2020-01-26T15:32:51.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.140 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fd964004e00 con 0x7fd9680a3410 2020-01-26T15:32:51.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.144 7fd97053d700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944002070 con 0 2020-01-26T15:32:51.150 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.148 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd9640047e0 con 0x7fd9680a3410 2020-01-26T15:32:51.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9440011d0 con 0 2020-01-26T15:32:51.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd9577fe700 1 -- 172.21.15.170:0/353242762 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7fd964003f90 con 0x7fd9680a3410 2020-01-26T15:32:51.243 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:51.243 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:51.243 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:51.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 >> 172.21.15.170:6800/11008 conn(0x7fd948006ed0 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:32:51.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 >> 172.21.15.170:6791/0 conn(0x7fd9680a3410 :-1 s=STATE_OPEN pgs=121 cs=1 l=1).mark_down 2020-01-26T15:32:51.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 shutdown_connections 2020-01-26T15:32:51.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 shutdown_connections 2020-01-26T15:32:51.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 wait complete. 2020-01-26T15:32:51.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:51.240 7fd97053d700 1 -- 172.21.15.170:0/353242762 >> 172.21.15.170:0/353242762 conn(0x7fd968099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:51.562 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:51.562 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:52.563 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:52.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f636a4e6700 1 Processor -- start 2020-01-26T15:32:52.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f636a4e6700 1 -- - start start 2020-01-26T15:32:52.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f636a4e6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636414bb10 con 0 2020-01-26T15:32:52.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f636a4e6700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636414beb0 con 0 2020-01-26T15:32:52.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f635b7fe700 1 -- 172.21.15.170:0/4095313054 learned_addr learned my addr 172.21.15.170:0/4095313054 2020-01-26T15:32:52.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f634c003630 con 0x7f636414b3d0 2020-01-26T15:32:52.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4264535360 0 0) 0x7f634c0039b0 con 0x7f636414b3d0 2020-01-26T15:32:52.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6344002a20 con 0 2020-01-26T15:32:52.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6354002220 con 0x7f63641480d0 2020-01-26T15:32:52.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2561131242 0 0) 0x7f6354002520 con 0x7f63641480d0 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f63440046c0 con 0 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2834634112 0 0) 0x7f634c003f80 con 0x7f636414b3d0 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 >> 172.21.15.170:6789/0 conn(0x7f63641480d0 :-1 s=STATE_OPEN pgs=118 cs=1 l=1).mark_down 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636407a930 con 0 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6364116e80 con 0x7f636414b3d0 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f636a4e6700 1 -- 172.21.15.170:0/4095313054 >> 172.21.15.170:6791/0 conn(0x7f636414b3d0 :-1 s=STATE_OPEN pgs=122 cs=1 l=1).mark_down 2020-01-26T15:32:52.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.656 7f63637fe700 1 -- 172.21.15.170:0/4095313054 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f634c001050 con 0x7f636414b3d0 2020-01-26T15:32:52.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- 172.21.15.170:0/4095313054 shutdown_connections 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- 172.21.15.170:0/4095313054 shutdown_connections 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- 172.21.15.170:0/4095313054 wait complete. 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- 172.21.15.170:0/4095313054 >> 172.21.15.170:0/4095313054 conn(0x7f6364144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 Processor -- start 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- - start start 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640a3e40 con 0 2020-01-26T15:32:52.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f636a4e6700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640a35b0 con 0 2020-01-26T15:32:52.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f635b7fe700 1 -- 172.21.15.170:0/313500115 learned_addr learned my addr 172.21.15.170:0/313500115 2020-01-26T15:32:52.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f6354002220 con 0x7f6364095d50 2020-01-26T15:32:52.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (72441526 0 0) 0x7f6354002600 con 0x7f6364095d50 2020-01-26T15:32:52.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6348002960 con 0 2020-01-26T15:32:52.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f634c000e50 con 0x7f63640a5200 2020-01-26T15:32:52.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (100078257 0 0) 0x7f634c003380 con 0x7f63640a5200 2020-01-26T15:32:52.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6348004620 con 0 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4147041367 0 0) 0x7f6354002b50 con 0x7f6364095d50 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6348002ee0 con 0 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2597947267 0 0) 0x7f634c003700 con 0x7f63640a5200 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.660 7f6361ffb700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6348003540 con 0 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3251496055 0 0) 0x7f634c001570 con 0x7f63640a5200 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 >> 172.21.15.170:6791/0 conn(0x7f6364095d50 :-1 s=STATE_OPEN pgs=123 cs=1 l=1).mark_down 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636407ab90 con 0 2020-01-26T15:32:52.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f636a4e6700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63640712f0 con 0 2020-01-26T15:32:52.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f636a4e6700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f63640a6c30 con 0 2020-01-26T15:32:52.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f634c001360 con 0x7f63640a5200 2020-01-26T15:32:52.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f634c0019a0 con 0x7f63640a5200 2020-01-26T15:32:52.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f634c004750 con 0x7f63640a5200 2020-01-26T15:32:52.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.664 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f634c005ef0 con 0x7f63640a5200 2020-01-26T15:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.668 7f636a4e6700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c002070 con 0 2020-01-26T15:32:52.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.676 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f634c004230 con 0x7f63640a5200 2020-01-26T15:32:52.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f633c0011d0 con 0 2020-01-26T15:32:52.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f6361ffb700 1 -- 172.21.15.170:0/313500115 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f634c0044e0 con 0x7f63640a5200 2020-01-26T15:32:52.770 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:52.771 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:52.771 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:52.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 >> 172.21.15.170:6800/11008 conn(0x7f6348006e70 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:32:52.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 >> 172.21.15.170:6789/0 conn(0x7f63640a5200 :-1 s=STATE_OPEN pgs=119 cs=1 l=1).mark_down 2020-01-26T15:32:52.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 shutdown_connections 2020-01-26T15:32:52.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 shutdown_connections 2020-01-26T15:32:52.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 wait complete. 2020-01-26T15:32:52.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:52.768 7f636a4e6700 1 -- 172.21.15.170:0/313500115 >> 172.21.15.170:0/313500115 conn(0x7f6364099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:53.084 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:53.084 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:54.086 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:54.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37c6078700 1 Processor -- start 2020-01-26T15:32:54.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37c6078700 1 -- - start start 2020-01-26T15:32:54.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37c6078700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c014bb10 con 0 2020-01-26T15:32:54.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37c6078700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c014beb0 con 0 2020-01-26T15:32:54.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37bffff700 1 -- 172.21.15.170:0/429510996 learned_addr learned my addr 172.21.15.170:0/429510996 2020-01-26T15:32:54.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37a80022a0 con 0x7f37c014b3d0 2020-01-26T15:32:54.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37b0003630 con 0x7f37c01480d0 2020-01-26T15:32:54.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2777388856 0 0) 0x7f37a8002620 con 0x7f37c014b3d0 2020-01-26T15:32:54.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37beffd700 1 -- 172.21.15.170:0/429510996 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37a0002f40 con 0 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2891684893 0 0) 0x7f37b00039b0 con 0x7f37c01480d0 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.180 7f37beffd700 1 -- 172.21.15.170:0/429510996 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37a0004740 con 0 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2801922739 0 0) 0x7f37a8002b10 con 0x7f37c014b3d0 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37beffd700 1 -- 172.21.15.170:0/429510996 >> 172.21.15.170:6789/0 conn(0x7f37c01480d0 :-1 s=STATE_OPEN pgs=120 cs=1 l=1).mark_down 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37beffd700 1 -- 172.21.15.170:0/429510996 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c007a930 con 0 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f37a8000bf0 con 0x7f37c014b3d0 2020-01-26T15:32:54.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37c6078700 1 -- 172.21.15.170:0/429510996 >> 172.21.15.170:6791/0 conn(0x7f37c014b3d0 :-1 s=STATE_OPEN pgs=124 cs=1 l=1).mark_down 2020-01-26T15:32:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37beffd700 1 -- 172.21.15.170:0/429510996 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37a8001010 con 0x7f37c014b3d0 2020-01-26T15:32:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37c6078700 1 -- 172.21.15.170:0/429510996 shutdown_connections 2020-01-26T15:32:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37c6078700 1 -- 172.21.15.170:0/429510996 shutdown_connections 2020-01-26T15:32:54.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37c6078700 1 -- 172.21.15.170:0/429510996 wait complete. 2020-01-26T15:32:54.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.184 7f37c6078700 1 -- 172.21.15.170:0/429510996 >> 172.21.15.170:0/429510996 conn(0x7f37c0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:54.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37c6078700 1 Processor -- start 2020-01-26T15:32:54.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37c6078700 1 -- - start start 2020-01-26T15:32:54.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37c6078700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c009fc20 con 0 2020-01-26T15:32:54.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37c6078700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00a29f0 con 0 2020-01-26T15:32:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bffff700 1 -- 172.21.15.170:0/3738474864 learned_addr learned my addr 172.21.15.170:0/3738474864 2020-01-26T15:32:54.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37a8002b10 con 0x7f37c00a2240 2020-01-26T15:32:54.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1999302811 0 0) 0x7f37a8000e50 con 0x7f37c00a2240 2020-01-26T15:32:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37a40029c0 con 0 2020-01-26T15:32:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37b0003470 con 0x7f37c009f230 2020-01-26T15:32:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (793617128 0 0) 0x7f37b0003d30 con 0x7f37c009f230 2020-01-26T15:32:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f37a4004680 con 0 2020-01-26T15:32:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1286585725 0 0) 0x7f37a8002170 con 0x7f37c00a2240 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37a4002f40 con 0 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3522420529 0 0) 0x7f37b0003fa0 con 0x7f37c009f230 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37a40035a0 con 0 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2687067253 0 0) 0x7f37a8001530 con 0x7f37c00a2240 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 >> 172.21.15.170:6791/0 conn(0x7f37c009f230 :-1 s=STATE_OPEN pgs=125 cs=1 l=1).mark_down 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c007ab90 con 0 2020-01-26T15:32:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37c6078700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c00712f0 con 0 2020-01-26T15:32:54.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37c6078700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c018b390 con 0 2020-01-26T15:32:54.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f37a8001320 con 0x7f37c00a2240 2020-01-26T15:32:54.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f37a80019b0 con 0x7f37c00a2240 2020-01-26T15:32:54.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f37a8001bf0 con 0x7f37c00a2240 2020-01-26T15:32:54.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.188 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f37a8004d80 con 0x7f37c00a2240 2020-01-26T15:32:54.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.196 7f37c6078700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c007af30 con 0 2020-01-26T15:32:54.201 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.200 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f37c007af30 con 0x7f37c00a2240 2020-01-26T15:32:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.292 7f37c6078700 1 -- 172.21.15.170:0/3738474864 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37c0073330 con 0 2020-01-26T15:32:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.292 7f37bd7fa700 1 -- 172.21.15.170:0/3738474864 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f37a80038c0 con 0x7f37c00a2240 2020-01-26T15:32:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:54.296 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:54.297 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.296 7f37c6078700 1 -- 172.21.15.170:0/3738474864 >> 172.21.15.170:6800/11008 conn(0x7f37a4006ed0 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-01-26T15:32:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.296 7f37c6078700 1 -- 172.21.15.170:0/3738474864 >> 172.21.15.170:6790/0 conn(0x7f37c00a2240 :-1 s=STATE_OPEN pgs=126 cs=1 l=1).mark_down 2020-01-26T15:32:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.296 7f37c6078700 1 -- 172.21.15.170:0/3738474864 shutdown_connections 2020-01-26T15:32:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.296 7f37c6078700 1 -- 172.21.15.170:0/3738474864 shutdown_connections 2020-01-26T15:32:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.296 7f37c6078700 1 -- 172.21.15.170:0/3738474864 wait complete. 2020-01-26T15:32:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:54.296 7f37c6078700 1 -- 172.21.15.170:0/3738474864 >> 172.21.15.170:0/3738474864 conn(0x7f37c0177f00 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:54.610 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:54.611 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:55.611 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:55.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.708 7fabbddc6700 1 Processor -- start 2020-01-26T15:32:55.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.708 7fabbddc6700 1 -- - start start 2020-01-26T15:32:55.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb814bb10 con 0 2020-01-26T15:32:55.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb814beb0 con 0 2020-01-26T15:32:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb77fe700 1 -- 172.21.15.170:0/1989839534 learned_addr learned my addr 172.21.15.170:0/1989839534 2020-01-26T15:32:55.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7faba8003630 con 0x7fabb81480d0 2020-01-26T15:32:55.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1023660277 0 0) 0x7faba80039b0 con 0x7fabb81480d0 2020-01-26T15:32:55.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7faba4002a20 con 0 2020-01-26T15:32:55.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fabac0022a0 con 0x7fabb814b3d0 2020-01-26T15:32:55.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2635079753 0 0) 0x7fabac002620 con 0x7fabb814b3d0 2020-01-26T15:32:55.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7faba40046c0 con 0 2020-01-26T15:32:55.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (38804610 0 0) 0x7faba8003f80 con 0x7fabb81480d0 2020-01-26T15:32:55.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 >> 172.21.15.170:6790/0 conn(0x7fabb814b3d0 :-1 s=STATE_OPEN pgs=127 cs=1 l=1).mark_down 2020-01-26T15:32:55.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb807a930 con 0 2020-01-26T15:32:55.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fabb80e9ff0 con 0x7fabb81480d0 2020-01-26T15:32:55.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabb67fc700 1 -- 172.21.15.170:0/1989839534 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7faba8001050 con 0x7fabb81480d0 2020-01-26T15:32:55.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- 172.21.15.170:0/1989839534 >> 172.21.15.170:6789/0 conn(0x7fabb81480d0 :-1 s=STATE_OPEN pgs=121 cs=1 l=1).mark_down 2020-01-26T15:32:55.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- 172.21.15.170:0/1989839534 shutdown_connections 2020-01-26T15:32:55.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- 172.21.15.170:0/1989839534 shutdown_connections 2020-01-26T15:32:55.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- 172.21.15.170:0/1989839534 wait complete. 2020-01-26T15:32:55.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.712 7fabbddc6700 1 -- 172.21.15.170:0/1989839534 >> 172.21.15.170:0/1989839534 conn(0x7fabb8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:55.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabbddc6700 1 Processor -- start 2020-01-26T15:32:55.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabbddc6700 1 -- - start start 2020-01-26T15:32:55.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabbddc6700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80a3df0 con 0 2020-01-26T15:32:55.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabbddc6700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80a6b30 con 0 2020-01-26T15:32:55.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb77fe700 1 -- 172.21.15.170:0/4016664032 learned_addr learned my addr 172.21.15.170:0/4016664032 2020-01-26T15:32:55.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fabac0020e0 con 0x7fabb80a6380 2020-01-26T15:32:55.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3587991440 0 0) 0x7fabac0029b0 con 0x7fabb80a6380 2020-01-26T15:32:55.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fab98002960 con 0 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7faba8000e50 con 0x7fabb80a3400 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2512832734 0 0) 0x7faba8001570 con 0x7fabb80a3400 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fab98004620 con 0 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1806435195 0 0) 0x7fabac000e50 con 0x7fabb80a6380 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab98002ee0 con 0 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2583074058 0 0) 0x7faba80018f0 con 0x7fabb80a3400 2020-01-26T15:32:55.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.716 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab98003540 con 0 2020-01-26T15:32:55.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3377021407 0 0) 0x7fabac001360 con 0x7fabb80a6380 2020-01-26T15:32:55.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 >> 172.21.15.170:6789/0 conn(0x7fabb80a3400 :-1 s=STATE_OPEN pgs=122 cs=1 l=1).mark_down 2020-01-26T15:32:55.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb807ab90 con 0 2020-01-26T15:32:55.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb80b2780 con 0 2020-01-26T15:32:55.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fabac000bf0 con 0x7fabb80a6380 2020-01-26T15:32:55.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb818b200 con 0 2020-01-26T15:32:55.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fabac001790 con 0x7fabb80a6380 2020-01-26T15:32:55.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fabac0033f0 con 0x7fabb80a6380 2020-01-26T15:32:55.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.720 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fabac0036d0 con 0x7fabb80a6380 2020-01-26T15:32:55.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.724 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb807af30 con 0 2020-01-26T15:32:55.730 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.728 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fabb807af30 con 0x7fabb80a6380 2020-01-26T15:32:55.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabb818ba00 con 0 2020-01-26T15:32:55.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabb4ff9700 1 -- 172.21.15.170:0/4016664032 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7fabac002ed0 con 0x7fabb80a6380 2020-01-26T15:32:55.821 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:55.822 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:55.822 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:55.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 >> 172.21.15.170:6800/11008 conn(0x7fab98006ed0 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-01-26T15:32:55.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 >> 172.21.15.170:6790/0 conn(0x7fabb80a6380 :-1 s=STATE_OPEN pgs=128 cs=1 l=1).mark_down 2020-01-26T15:32:55.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 shutdown_connections 2020-01-26T15:32:55.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 shutdown_connections 2020-01-26T15:32:55.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 wait complete. 2020-01-26T15:32:55.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:55.820 7fabbddc6700 1 -- 172.21.15.170:0/4016664032 >> 172.21.15.170:0/4016664032 conn(0x7fabb8099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:56.135 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:56.135 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:57.136 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:57.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c91e9700 1 Processor -- start 2020-01-26T15:32:57.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c91e9700 1 -- - start start 2020-01-26T15:32:57.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c91e9700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c414bb70 con 0 2020-01-26T15:32:57.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c91e9700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c414bf10 con 0 2020-01-26T15:32:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c3027700 1 -- 172.21.15.170:0/2474838639 learned_addr learned my addr 172.21.15.170:0/2474838639 2020-01-26T15:32:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95bc0039b0 con 0x7f95c4148130 2020-01-26T15:32:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3605137390 0 0) 0x7f95bc003d30 con 0x7f95c4148130 2020-01-26T15:32:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c2025700 1 -- 172.21.15.170:0/2474838639 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95a4002a20 con 0 2020-01-26T15:32:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ac0022a0 con 0x7f95c414b430 2020-01-26T15:32:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (898066409 0 0) 0x7f95ac0025a0 con 0x7f95c414b430 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.236 7f95c2025700 1 -- 172.21.15.170:0/2474838639 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95a40046c0 con 0 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1320854721 0 0) 0x7f95bc004300 con 0x7f95c4148130 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c2025700 1 -- 172.21.15.170:0/2474838639 >> 172.21.15.170:6789/0 conn(0x7f95c414b430 :-1 s=STATE_OPEN pgs=123 cs=1 l=1).mark_down 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c2025700 1 -- 172.21.15.170:0/2474838639 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c407a990 con 0 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f95c40ea050 con 0x7f95c4148130 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c2025700 1 -- 172.21.15.170:0/2474838639 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95bc0013d0 con 0x7f95c4148130 2020-01-26T15:32:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c91e9700 1 -- 172.21.15.170:0/2474838639 >> 172.21.15.170:6790/0 conn(0x7f95c4148130 :-1 s=STATE_OPEN pgs=129 cs=1 l=1).mark_down 2020-01-26T15:32:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c91e9700 1 -- 172.21.15.170:0/2474838639 shutdown_connections 2020-01-26T15:32:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c91e9700 1 -- 172.21.15.170:0/2474838639 shutdown_connections 2020-01-26T15:32:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c91e9700 1 -- 172.21.15.170:0/2474838639 wait complete. 2020-01-26T15:32:57.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.240 7f95c91e9700 1 -- 172.21.15.170:0/2474838639 >> 172.21.15.170:0/2474838639 conn(0x7f95c4144060 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:57.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c91e9700 1 Processor -- start 2020-01-26T15:32:57.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c91e9700 1 -- - start start 2020-01-26T15:32:57.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c91e9700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40a3d80 con 0 2020-01-26T15:32:57.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c91e9700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40a6b50 con 0 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c2826700 1 -- 172.21.15.170:0/306276360 learned_addr learned my addr 172.21.15.170:0/306276360 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ac0020b0 con 0x7f95c40a63a0 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4205466408 0 0) 0x7f95ac0023b0 con 0x7f95c40a63a0 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95a8002960 con 0 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95bc0011d0 con 0x7f95c40a3390 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2625924423 0 0) 0x7f95bc0018f0 con 0x7f95c40a3390 2020-01-26T15:32:57.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f95a8004620 con 0 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (615192782 0 0) 0x7f95ac000e50 con 0x7f95c40a63a0 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f95a8002ee0 con 0 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1887883029 0 0) 0x7f95bc001c70 con 0x7f95c40a3390 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f95a8003540 con 0 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1904433434 0 0) 0x7f95ac001480 con 0x7f95c40a63a0 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 >> 172.21.15.170:6791/0 conn(0x7f95c40a3390 :-1 s=STATE_OPEN pgs=126 cs=1 l=1).mark_down 2020-01-26T15:32:57.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c407abf0 con 0 2020-01-26T15:32:57.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c91e9700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c4071350 con 0 2020-01-26T15:32:57.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c91e9700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c418b200 con 0 2020-01-26T15:32:57.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f95ac000bf0 con 0x7f95c40a63a0 2020-01-26T15:32:57.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f95ac0018b0 con 0x7f95c40a63a0 2020-01-26T15:32:57.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f95ac0044b0 con 0x7f95c40a63a0 2020-01-26T15:32:57.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.244 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f95ac005f20 con 0x7f95c40a63a0 2020-01-26T15:32:57.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.252 7f95c91e9700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c407af90 con 0 2020-01-26T15:32:57.258 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.256 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f95c407af90 con 0x7f95c40a63a0 2020-01-26T15:32:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.348 7f95c91e9700 1 -- 172.21.15.170:0/306276360 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95c4073390 con 0 2020-01-26T15:32:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.348 7f95c0822700 1 -- 172.21.15.170:0/306276360 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2266 (2358742663 0 3580501714) 0x7f95ac004a00 con 0x7f95c40a63a0 2020-01-26T15:32:57.351 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2020-01-26T15:32:57.351 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:57.351 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:34.237683","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4225,"mds_1":4203},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4203":{"gid":4203,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.170:6819/3203442437","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195},"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:57.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.348 7f95c91e9700 1 -- 172.21.15.170:0/306276360 >> 172.21.15.170:6800/11008 conn(0x7f95a8006e70 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:32:57.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.348 7f95c91e9700 1 -- 172.21.15.170:0/306276360 >> 172.21.15.170:6789/0 conn(0x7f95c40a63a0 :-1 s=STATE_OPEN pgs=124 cs=1 l=1).mark_down 2020-01-26T15:32:57.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.352 7f95c91e9700 1 -- 172.21.15.170:0/306276360 shutdown_connections 2020-01-26T15:32:57.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.352 7f95c91e9700 1 -- 172.21.15.170:0/306276360 shutdown_connections 2020-01-26T15:32:57.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.352 7f95c91e9700 1 -- 172.21.15.170:0/306276360 wait complete. 2020-01-26T15:32:57.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:57.352 7f95c91e9700 1 -- 172.21.15.170:0/306276360 >> 172.21.15.170:0/306276360 conn(0x7f95c4099770 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:57.665 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225, u'mds_1': 4203}, u'last_failure_osd_epoch': 0, u'in': [0, 1], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4203': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'a', u'incarnation': 8, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:stopping', u'gid': 4203, u'features': 4611087854031667195, u'rank': 1, u'standby_for_name': u'', u'addr': u'172.21.15.170:6819/3203442437'}, u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:34.237683', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:57.665 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4203:up:stopping 2020-01-26T15:32:58.379 INFO:tasks.ceph.mds.a.smithi170.stdout:starting mds.a at - 2020-01-26T15:32:58.666 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 Processor -- start 2020-01-26T15:32:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- - start start 2020-01-26T15:32:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea814bb10 con 0 2020-01-26T15:32:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea814beb0 con 0 2020-01-26T15:32:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea7fff700 1 -- 172.21.15.170:0/3253039438 learned_addr learned my addr 172.21.15.170:0/3253039438 2020-01-26T15:32:58.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0e900022a0 con 0x7f0ea814b3d0 2020-01-26T15:32:58.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (698650736 0 0) 0x7f0e90002620 con 0x7f0ea814b3d0 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e88002a20 con 0 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0e980035b0 con 0x7f0ea81480d0 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (304605200 0 0) 0x7f0e980038b0 con 0x7f0ea81480d0 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e880046c0 con 0 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (441679720 0 0) 0x7f0e90002bf0 con 0x7f0ea814b3d0 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 >> 172.21.15.170:6789/0 conn(0x7f0ea81480d0 :-1 s=STATE_OPEN pgs=126 cs=1 l=1).mark_down 2020-01-26T15:32:58.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea807a930 con 0 2020-01-26T15:32:58.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e90000bf0 con 0x7f0ea814b3d0 2020-01-26T15:32:58.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0ea6ffd700 1 -- 172.21.15.170:0/3253039438 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0e90001050 con 0x7f0ea814b3d0 2020-01-26T15:32:58.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- 172.21.15.170:0/3253039438 >> 172.21.15.170:6790/0 conn(0x7f0ea814b3d0 :-1 s=STATE_OPEN pgs=132 cs=1 l=1).mark_down 2020-01-26T15:32:58.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- 172.21.15.170:0/3253039438 shutdown_connections 2020-01-26T15:32:58.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- 172.21.15.170:0/3253039438 shutdown_connections 2020-01-26T15:32:58.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- 172.21.15.170:0/3253039438 wait complete. 2020-01-26T15:32:58.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.760 7f0eae50f700 1 -- 172.21.15.170:0/3253039438 >> 172.21.15.170:0/3253039438 conn(0x7f0ea8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:58.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0eae50f700 1 Processor -- start 2020-01-26T15:32:58.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0eae50f700 1 -- - start start 2020-01-26T15:32:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0eae50f700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80a3f00 con 0 2020-01-26T15:32:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0eae50f700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea8095f30 con 0 2020-01-26T15:32:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea77fe700 1 -- 172.21.15.170:0/2950433292 learned_addr learned my addr 172.21.15.170:0/2950433292 2020-01-26T15:32:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0e90000e50 con 0x7f0ea80a52c0 2020-01-26T15:32:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3085598435 0 0) 0x7f0e90001ff0 con 0x7f0ea80a52c0 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e8c002960 con 0 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0e980035b0 con 0x7f0ea80a3510 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2303717292 0 0) 0x7f0e98003990 con 0x7f0ea80a3510 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e8c004620 con 0 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (292925424 0 0) 0x7f0e90002440 con 0x7f0ea80a52c0 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e8c002ee0 con 0 2020-01-26T15:32:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (757430130 0 0) 0x7f0e98003df0 con 0x7f0ea80a3510 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e8c003540 con 0 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (927224929 0 0) 0x7f0e90001810 con 0x7f0ea80a52c0 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 >> 172.21.15.170:6790/0 conn(0x7f0ea80a3510 :-1 s=STATE_OPEN pgs=133 cs=1 l=1).mark_down 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea807ab90 con 0 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea80712f0 con 0 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea80a6cf0 con 0 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e90001360 con 0x7f0ea80a52c0 2020-01-26T15:32:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.764 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f0e90001c40 con 0x7f0ea80a52c0 2020-01-26T15:32:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.768 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f0e900035d0 con 0x7f0ea80a52c0 2020-01-26T15:32:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.768 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f0e90003c20 con 0x7f0ea80a52c0 2020-01-26T15:32:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.772 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e80002070 con 0 2020-01-26T15:32:58.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.776 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0e900030b0 con 0x7f0ea80a52c0 2020-01-26T15:32:58.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.868 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e800011d0 con 0 2020-01-26T15:32:58.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.868 7f0ea57fa700 1 -- 172.21.15.170:0/2950433292 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1976 (3275286184 0 3105498386) 0x7f0e900057c0 con 0x7f0ea80a52c0 2020-01-26T15:32:58.873 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 12 2020-01-26T15:32:58.873 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:58.873 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:58.344929","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:58.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.872 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 >> 172.21.15.170:6800/11008 conn(0x7f0e8c006ed0 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:32:58.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.872 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 >> 172.21.15.170:6789/0 conn(0x7f0ea80a52c0 :-1 s=STATE_OPEN pgs=127 cs=1 l=1).mark_down 2020-01-26T15:32:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.872 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 shutdown_connections 2020-01-26T15:32:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.872 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 shutdown_connections 2020-01-26T15:32:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.872 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 wait complete. 2020-01-26T15:32:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:58.872 7f0eae50f700 1 -- 172.21.15.170:0/2950433292 >> 172.21.15.170:0/2950433292 conn(0x7f0ea8099600 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:59.186 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 12, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:58.344929', u'session_timeout': 60, u'stopped': [1], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:59.186 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:32:59.186 INFO:tasks.cephfs.filesystem:are_daemons_healthy: skipping max_mds check 2020-01-26T15:32:59.187 INFO:tasks.cephfs.filesystem:deactivating rank 0 2020-01-26T15:32:59.187 INFO:tasks.cephfs.filesystem:Error: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks/cephfs/filesystem.py", line 512, in reach_max_mds self.deactivate(target['rank']) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks/cephfs/filesystem.py", line 494, in deactivate raise RuntimeError("cannot deactivate rank 0") RuntimeError: cannot deactivate rank 0 2020-01-26T15:32:59.187 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:32:59.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.280 7f4f9b39a700 1 Processor -- start 2020-01-26T15:32:59.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.280 7f4f9b39a700 1 -- - start start 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.280 7f4f9b39a700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9414bb10 con 0 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.280 7f4f9b39a700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9414beb0 con 0 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.280 7f4f993c0700 1 -- 172.21.15.170:0/75994224 learned_addr learned my addr 172.21.15.170:0/75994224 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4f84003630 con 0x7f4f941480d0 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1991764028 0 0) 0x7f4f840039b0 con 0x7f4f941480d0 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4f80002a20 con 0 2020-01-26T15:32:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4f880022a0 con 0x7f4f9414b3d0 2020-01-26T15:32:59.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2394614067 0 0) 0x7f4f88002620 con 0x7f4f9414b3d0 2020-01-26T15:32:59.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4f800046c0 con 0 2020-01-26T15:32:59.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3580509308 0 0) 0x7f4f84003f80 con 0x7f4f941480d0 2020-01-26T15:32:59.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 >> 172.21.15.170:6791/0 conn(0x7f4f9414b3d0 :-1 s=STATE_OPEN pgs=128 cs=1 l=1).mark_down 2020-01-26T15:32:59.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9407a930 con 0 2020-01-26T15:32:59.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4f940e9ff0 con 0x7f4f941480d0 2020-01-26T15:32:59.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f93fff700 1 -- 172.21.15.170:0/75994224 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4f84001050 con 0x7f4f941480d0 2020-01-26T15:32:59.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f9b39a700 1 -- 172.21.15.170:0/75994224 >> 172.21.15.170:6790/0 conn(0x7f4f941480d0 :-1 s=STATE_OPEN pgs=134 cs=1 l=1).mark_down 2020-01-26T15:32:59.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f9b39a700 1 -- 172.21.15.170:0/75994224 shutdown_connections 2020-01-26T15:32:59.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f9b39a700 1 -- 172.21.15.170:0/75994224 shutdown_connections 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f9b39a700 1 -- 172.21.15.170:0/75994224 wait complete. 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.284 7f4f9b39a700 1 -- 172.21.15.170:0/75994224 >> 172.21.15.170:0/75994224 conn(0x7f4f94144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f9b39a700 1 Processor -- start 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f9b39a700 1 -- - start start 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f9b39a700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940a3cf0 con 0 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f9b39a700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940a6ac0 con 0 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f993c0700 1 -- 172.21.15.170:0/762090860 learned_addr learned my addr 172.21.15.170:0/762090860 2020-01-26T15:32:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4f84000e50 con 0x7f4f940a3300 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1695404675 0 0) 0x7f4f84001570 con 0x7f4f940a3300 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4f74002960 con 0 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4f880020e0 con 0x7f4f940a6310 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1600132892 0 0) 0x7f4f880029b0 con 0x7f4f940a6310 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4f74004620 con 0 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (349020029 0 0) 0x7f4f840019c0 con 0x7f4f940a3300 2020-01-26T15:32:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f74002ee0 con 0 2020-01-26T15:32:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2702670259 0 0) 0x7f4f88000e50 con 0x7f4f940a6310 2020-01-26T15:32:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f74003540 con 0 2020-01-26T15:32:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (292414738 0 0) 0x7f4f88001360 con 0x7f4f940a6310 2020-01-26T15:32:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 >> 172.21.15.170:6791/0 conn(0x7f4f940a3300 :-1 s=STATE_OPEN pgs=129 cs=1 l=1).mark_down 2020-01-26T15:32:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9407ab90 con 0 2020-01-26T15:32:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f940b29a0 con 0 2020-01-26T15:32:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4f94116e80 con 0x7f4f940a6310 2020-01-26T15:32:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9418b170 con 0 2020-01-26T15:32:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f4f880015d0 con 0x7f4f940a6310 2020-01-26T15:32:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f4f88001a20 con 0x7f4f940a6310 2020-01-26T15:32:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.288 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f4f88004a90 con 0x7f4f940a6310 2020-01-26T15:32:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.296 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9407af30 con 0 2020-01-26T15:32:59.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.300 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4f9407af30 con 0x7f4f940a6310 2020-01-26T15:32:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f941563d0 con 0 2020-01-26T15:32:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f927fc700 1 -- 172.21.15.170:0/762090860 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1976 (3275286184 0 3105498386) 0x7f4f880035c0 con 0x7f4f940a6310 2020-01-26T15:32:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 12 2020-01-26T15:32:59.399 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:32:59.399 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:58.344929","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:32:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 >> 172.21.15.170:6800/11008 conn(0x7f4f74006ec0 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:32:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 >> 172.21.15.170:6789/0 conn(0x7f4f940a6310 :-1 s=STATE_OPEN pgs=128 cs=1 l=1).mark_down 2020-01-26T15:32:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 shutdown_connections 2020-01-26T15:32:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 shutdown_connections 2020-01-26T15:32:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 wait complete. 2020-01-26T15:32:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:32:59.396 7f4f9b39a700 1 -- 172.21.15.170:0/762090860 >> 172.21.15.170:0/762090860 conn(0x7f4f940994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:32:59.723 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 12, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4225': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 6, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:32:15.376136', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:32:58.344929', u'session_timeout': 60, u'stopped': [1], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:32:59.723 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:32:59.723 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:32:59.819 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:32:59.819 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:32:59.819 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4225, 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 41.419055, 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 12, 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 17, 2020-01-26T15:32:59.820 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 17, 2020-01-26T15:32:59.821 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 42.318899 2020-01-26T15:32:59.821 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:32:59.827 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 0, "id": 4225, "want_state": "up:active", "state": "up:active", "rank_uptime": 41.419055, "mdsmap_epoch": 12, "osdmap_epoch": 17, "osdmap_epoch_barrier": 17, "uptime": 42.318899 } 2020-01-26T15:32:59.827 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-01-26T15:32:59.827 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:32:59.839 INFO:tasks.ceph.mds.a:Stopped 2020-01-26T15:32:59.839 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-01-26T15:32:59.840 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:32:59.897 INFO:tasks.ceph.mds.b:Stopped 2020-01-26T15:33:04.898 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:33:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:04.996 7fb2c1817700 1 Processor -- start 2020-01-26T15:33:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:04.996 7fb2c1817700 1 -- - start start 2020-01-26T15:33:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc14bb10 con 0 2020-01-26T15:33:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc14beb0 con 0 2020-01-26T15:33:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2bb7fe700 1 -- 172.21.15.170:0/1659930588 learned_addr learned my addr 172.21.15.170:0/1659930588 2020-01-26T15:33:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2ac0039b0 con 0x7fb2bc1480d0 2020-01-26T15:33:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3536721419 0 0) 0x7fb2ac003d30 con 0x7fb2bc1480d0 2020-01-26T15:33:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb29c002a20 con 0 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2a40022a0 con 0x7fb2bc14b3d0 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2741853631 0 0) 0x7fb2a40025a0 con 0x7fb2bc14b3d0 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb29c0046c0 con 0 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1795155137 0 0) 0x7fb2a4002a40 con 0x7fb2bc14b3d0 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 >> 172.21.15.170:6791/0 conn(0x7fb2bc1480d0 :-1 s=STATE_OPEN pgs=130 cs=1 l=1).mark_down 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc07a930 con 0 2020-01-26T15:33:05.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.1 172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb2bc116e80 con 0x7fb2bc14b3d0 2020-01-26T15:33:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2ba7fc700 1 -- 172.21.15.170:0/1659930588 <== mon.1 172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2a4000e50 con 0x7fb2bc14b3d0 2020-01-26T15:33:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- 172.21.15.170:0/1659930588 >> 172.21.15.170:6790/0 conn(0x7fb2bc14b3d0 :-1 s=STATE_OPEN pgs=135 cs=1 l=1).mark_down 2020-01-26T15:33:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- 172.21.15.170:0/1659930588 shutdown_connections 2020-01-26T15:33:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- 172.21.15.170:0/1659930588 shutdown_connections 2020-01-26T15:33:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- 172.21.15.170:0/1659930588 wait complete. 2020-01-26T15:33:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.000 7fb2c1817700 1 -- 172.21.15.170:0/1659930588 >> 172.21.15.170:0/1659930588 conn(0x7fb2bc144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2c1817700 1 Processor -- start 2020-01-26T15:33:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2c1817700 1 -- - start start 2020-01-26T15:33:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2c1817700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0a3d50 con 0 2020-01-26T15:33:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2c1817700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0a6b20 con 0 2020-01-26T15:33:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2baffd700 1 -- 172.21.15.170:0/2027786706 learned_addr learned my addr 172.21.15.170:0/2027786706 2020-01-26T15:33:05.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2a4002c00 con 0x7fb2bc0a6370 2020-01-26T15:33:05.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2052487605 0 0) 0x7fb2a4002080 con 0x7fb2bc0a6370 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2a0002960 con 0 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2ac0037c0 con 0x7fb2bc0a3360 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3332086610 0 0) 0x7fb2ac003a80 con 0x7fb2bc0a3360 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb2a0004620 con 0 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.004 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2076583519 0 0) 0x7fb2a4002560 con 0x7fb2bc0a6370 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2a0002ee0 con 0 2020-01-26T15:33:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2917267989 0 0) 0x7fb2ac003cf0 con 0x7fb2bc0a3360 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2a0003540 con 0 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1707444242 0 0) 0x7fb2a4001770 con 0x7fb2bc0a6370 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 >> 172.21.15.170:6790/0 conn(0x7fb2bc0a3360 :-1 s=STATE_OPEN pgs=136 cs=1 l=1).mark_down 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc07ab90 con 0 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc0712f0 con 0 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc18b1e0 con 0 2020-01-26T15:33:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb2a4000bf0 con 0x7fb2bc0a6370 2020-01-26T15:33:05.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fb2a4001ba0 con 0x7fb2bc0a6370 2020-01-26T15:33:05.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fb2a40033f0 con 0x7fb2bc0a6370 2020-01-26T15:33:05.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.008 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fb2a4005f30 con 0x7fb2bc0a6370 2020-01-26T15:33:05.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.012 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294002070 con 0 2020-01-26T15:33:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.016 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb2a4003ca0 con 0x7fb2bc0a6370 2020-01-26T15:33:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 --> 172.21.15.170:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2940011d0 con 0 2020-01-26T15:33:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2b8ff9700 1 -- 172.21.15.170:0/2027786706 <== mon.2 172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1976 (3275286184 0 3105498386) 0x7fb2a4002f80 con 0x7fb2bc0a6370 2020-01-26T15:33:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:33:05.109 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:58.344929","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:33:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 12 2020-01-26T15:33:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 >> 172.21.15.170:6800/11008 conn(0x7fb2a0006f20 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:33:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 >> 172.21.15.170:6791/0 conn(0x7fb2bc0a6370 :-1 s=STATE_OPEN pgs=131 cs=1 l=1).mark_down 2020-01-26T15:33:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 shutdown_connections 2020-01-26T15:33:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 shutdown_connections 2020-01-26T15:33:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 wait complete. 2020-01-26T15:33:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:05.108 7fb2c1817700 1 -- 172.21.15.170:0/2027786706 >> 172.21.15.170:0/2027786706 conn(0x7fb2bc099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:10.122 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:33:10.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 Processor -- start 2020-01-26T15:33:10.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- - start start 2020-01-26T15:33:10.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b014bb10 con 0 2020-01-26T15:33:10.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b014beb0 con 0 2020-01-26T15:33:10.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b643f700 1 -- 172.21.15.170:0/1067488875 learned_addr learned my addr 172.21.15.170:0/1067488875 2020-01-26T15:33:10.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6ac003630 con 0x7fa6b01480d0 2020-01-26T15:33:10.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2701203901 0 0) 0x7fa6ac0039b0 con 0x7fa6b01480d0 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa698002a20 con 0 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6a00022a0 con 0x7fa6b014b3d0 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (786889579 0 0) 0x7fa6a0002620 con 0x7fa6b014b3d0 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa6980046c0 con 0 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1399190559 0 0) 0x7fa6a0002ad0 con 0x7fa6b014b3d0 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 >> 172.21.15.170:6790/0 conn(0x7fa6b01480d0 :-1 s=STATE_OPEN pgs=137 cs=1 l=1).mark_down 2020-01-26T15:33:10.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b007a930 con 0 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.0 172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa6a0000bf0 con 0x7fa6b014b3d0 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b543d700 1 -- 172.21.15.170:0/1067488875 <== mon.0 172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6a0001010 con 0x7fa6b014b3d0 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- 172.21.15.170:0/1067488875 >> 172.21.15.170:6789/0 conn(0x7fa6b014b3d0 :-1 s=STATE_OPEN pgs=129 cs=1 l=1).mark_down 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- 172.21.15.170:0/1067488875 shutdown_connections 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- 172.21.15.170:0/1067488875 shutdown_connections 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- 172.21.15.170:0/1067488875 wait complete. 2020-01-26T15:33:10.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.220 7fa6b8419700 1 -- 172.21.15.170:0/1067488875 >> 172.21.15.170:0/1067488875 conn(0x7fa6b0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:10.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b8419700 1 Processor -- start 2020-01-26T15:33:10.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b8419700 1 -- - start start 2020-01-26T15:33:10.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b8419700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00a3e10 con 0 2020-01-26T15:33:10.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b8419700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b0095e50 con 0 2020-01-26T15:33:10.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b643f700 1 -- 172.21.15.170:0/1718752750 learned_addr learned my addr 172.21.15.170:0/1718752750 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6ac003440 con 0x7fa6b00a3420 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4201191178 0 0) 0x7fa6ac003780 con 0x7fa6b00a3420 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa690002960 con 0 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6a0002540 con 0x7fa6b00a51d0 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1888794843 0 0) 0x7fa6a0000e50 con 0x7fa6b00a51d0 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa690004620 con 0 2020-01-26T15:33:10.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2108736834 0 0) 0x7fa6ac000e50 con 0x7fa6b00a3420 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa690002ee0 con 0 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1209029640 0 0) 0x7fa6a0002080 con 0x7fa6b00a51d0 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa690003540 con 0 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2151486072 0 0) 0x7fa6ac001390 con 0x7fa6b00a3420 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 >> 172.21.15.170:6791/0 conn(0x7fa6b00a51d0 :-1 s=STATE_OPEN pgs=132 cs=1 l=1).mark_down 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b007ab90 con 0 2020-01-26T15:33:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b00712f0 con 0 2020-01-26T15:33:10.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00a6bb0 con 0 2020-01-26T15:33:10.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa6b00e9ff0 con 0x7fa6b00a3420 2020-01-26T15:33:10.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.224 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fa6ac0017c0 con 0x7fa6b00a3420 2020-01-26T15:33:10.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.228 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fa6ac001a00 con 0x7fa6b00a3420 2020-01-26T15:33:10.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.228 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fa6ac005e20 con 0x7fa6b00a3420 2020-01-26T15:33:10.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.232 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b007af30 con 0 2020-01-26T15:33:10.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.236 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa6b007af30 con 0x7fa6b00a3420 2020-01-26T15:33:10.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.328 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 --> 172.21.15.170:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6b0073330 con 0 2020-01-26T15:33:10.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa69f7fe700 1 -- 172.21.15.170:0/1718752750 <== mon.1 172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1976 (3275286184 0 3105498386) 0x7fa6ac004260 con 0x7fa6b00a3420 2020-01-26T15:33:10.333 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:33:10.333 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:58.344929","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:33:10.333 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 12 2020-01-26T15:33:10.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 >> 172.21.15.170:6800/11008 conn(0x7fa690006ed0 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-01-26T15:33:10.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 >> 172.21.15.170:6790/0 conn(0x7fa6b00a3420 :-1 s=STATE_OPEN pgs=138 cs=1 l=1).mark_down 2020-01-26T15:33:10.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 shutdown_connections 2020-01-26T15:33:10.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 shutdown_connections 2020-01-26T15:33:10.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 wait complete. 2020-01-26T15:33:10.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:10.332 7fa6b8419700 1 -- 172.21.15.170:0/1718752750 >> 172.21.15.170:0/1718752750 conn(0x7fa6b00995b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:15.349 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.444 7f5801f66700 1 Processor -- start 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.444 7f5801f66700 1 -- - start start 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc14bb10 con 0 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc14beb0 con 0 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fb7fe700 1 -- 172.21.15.170:0/3782971452 learned_addr learned my addr 172.21.15.170:0/3782971452 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f57f4003630 con 0x7f57fc1480d0 2020-01-26T15:33:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3700526280 0 0) 0x7f57f40039b0 con 0x7f57fc1480d0 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f57dc002a20 con 0 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f57e40022a0 con 0x7f57fc14b3d0 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2255438584 0 0) 0x7f57e4002620 con 0x7f57fc14b3d0 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f57dc0046b0 con 0 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (340950299 0 0) 0x7f57f4003f80 con 0x7f57fc1480d0 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 >> 172.21.15.170:6790/0 conn(0x7f57fc14b3d0 :-1 s=STATE_OPEN pgs=139 cs=1 l=1).mark_down 2020-01-26T15:33:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc07a930 con 0 2020-01-26T15:33:15.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f57fc0e9ff0 con 0x7f57fc1480d0 2020-01-26T15:33:15.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f57fa7fc700 1 -- 172.21.15.170:0/3782971452 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f57f4001050 con 0x7f57fc1480d0 2020-01-26T15:33:15.452 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- 172.21.15.170:0/3782971452 >> 172.21.15.170:6791/0 conn(0x7f57fc1480d0 :-1 s=STATE_OPEN pgs=133 cs=1 l=1).mark_down 2020-01-26T15:33:15.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- 172.21.15.170:0/3782971452 shutdown_connections 2020-01-26T15:33:15.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- 172.21.15.170:0/3782971452 shutdown_connections 2020-01-26T15:33:15.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- 172.21.15.170:0/3782971452 wait complete. 2020-01-26T15:33:15.453 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.448 7f5801f66700 1 -- 172.21.15.170:0/3782971452 >> 172.21.15.170:0/3782971452 conn(0x7f57fc144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:15.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f5801f66700 1 Processor -- start 2020-01-26T15:33:15.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f5801f66700 1 -- - start start 2020-01-26T15:33:15.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f5801f66700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc0a3e30 con 0 2020-01-26T15:33:15.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f5801f66700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc095e60 con 0 2020-01-26T15:33:15.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57fb7fe700 1 -- 172.21.15.170:0/1189352509 learned_addr learned my addr 172.21.15.170:0/1189352509 2020-01-26T15:33:15.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f57f4000e50 con 0x7f57fc0a3440 2020-01-26T15:33:15.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3085619428 0 0) 0x7f57f4001570 con 0x7f57fc0a3440 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f57e0002960 con 0 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f57e4002b60 con 0x7f57fc0a51f0 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1928509591 0 0) 0x7f57e40020e0 con 0x7f57fc0a51f0 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f57e0004620 con 0 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3232768928 0 0) 0x7f57f40019c0 con 0x7f57fc0a3440 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f57e0002ee0 con 0 2020-01-26T15:33:15.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4160487117 0 0) 0x7f57e4002470 con 0x7f57fc0a51f0 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f57e0003540 con 0 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2612914189 0 0) 0x7f57f4003620 con 0x7f57fc0a3440 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 >> 172.21.15.170:6790/0 conn(0x7f57fc0a51f0 :-1 s=STATE_OPEN pgs=140 cs=1 l=1).mark_down 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc07ab90 con 0 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f5801f66700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc0712f0 con 0 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f5801f66700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc0a6be0 con 0 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.452 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f57f4001360 con 0x7f57fc0a3440 2020-01-26T15:33:15.458 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.456 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7f57f4003a50 con 0x7f57fc0a3440 2020-01-26T15:33:15.459 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.456 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7f57f4004780 con 0x7f57fc0a3440 2020-01-26T15:33:15.459 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.456 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7f57f4006100 con 0x7f57fc0a3440 2020-01-26T15:33:15.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.460 7f5801f66700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc07af30 con 0 2020-01-26T15:33:15.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.464 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f57fc07af30 con 0x7f57fc0a3440 2020-01-26T15:33:15.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.556 7f5801f66700 1 -- 172.21.15.170:0/1189352509 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57fc1563d0 con 0 2020-01-26T15:33:15.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.556 7f57f8ff9700 1 -- 172.21.15.170:0/1189352509 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1976 (3275286184 0 3105498386) 0x7f57f4004260 con 0x7f57fc0a3440 2020-01-26T15:33:15.565 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 12 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.560 7f5801f66700 1 -- 172.21.15.170:0/1189352509 >> 172.21.15.170:6800/11008 conn(0x7f57e0006ed0 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.560 7f5801f66700 1 -- 172.21.15.170:0/1189352509 >> 172.21.15.170:6789/0 conn(0x7f57fc0a3440 :-1 s=STATE_OPEN pgs=130 cs=1 l=1).mark_down 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.560 7f5801f66700 1 -- 172.21.15.170:0/1189352509 shutdown_connections 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.560 7f5801f66700 1 -- 172.21.15.170:0/1189352509 shutdown_connections 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.560 7f5801f66700 1 -- 172.21.15.170:0/1189352509 wait complete. 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:15.560 7f5801f66700 1 -- 172.21.15.170:0/1189352509 >> 172.21.15.170:0/1189352509 conn(0x7f57fc099620 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:15.566 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:33:15.567 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6818/1897118663","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:58.344929","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:33:20.586 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:33:20.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 Processor -- start 2020-01-26T15:33:20.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- - start start 2020-01-26T15:33:20.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7414bb10 con 0 2020-01-26T15:33:20.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- - --> 172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7414beb0 con 0 2020-01-26T15:33:20.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb737fe700 1 -- 172.21.15.170:0/3239748959 learned_addr learned my addr 172.21.15.170:0/3239748959 2020-01-26T15:33:20.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdb64003630 con 0x7fdb741480d0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3147118831 0 0) 0x7fdb640039b0 con 0x7fdb741480d0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdb60002a20 con 0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.2 172.21.15.170:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdb680022a0 con 0x7fdb7414b3d0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.2 172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (279814801 0 0) 0x7fdb68002620 con 0x7fdb7414b3d0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 --> 172.21.15.170:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdb600046c0 con 0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.2 172.21.15.170:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (630559101 0 0) 0x7fdb68002ac0 con 0x7fdb7414b3d0 2020-01-26T15:33:20.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 >> 172.21.15.170:6789/0 conn(0x7fdb741480d0 :-1 s=STATE_OPEN pgs=131 cs=1 l=1).mark_down 2020-01-26T15:33:20.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 --> 172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7407a930 con 0 2020-01-26T15:33:20.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.2 172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fdb74116e80 con 0x7fdb7414b3d0 2020-01-26T15:33:20.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb727fc700 1 -- 172.21.15.170:0/3239748959 <== mon.2 172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdb68001010 con 0x7fdb7414b3d0 2020-01-26T15:33:20.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- 172.21.15.170:0/3239748959 >> 172.21.15.170:6791/0 conn(0x7fdb7414b3d0 :-1 s=STATE_OPEN pgs=134 cs=1 l=1).mark_down 2020-01-26T15:33:20.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- 172.21.15.170:0/3239748959 shutdown_connections 2020-01-26T15:33:20.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- 172.21.15.170:0/3239748959 shutdown_connections 2020-01-26T15:33:20.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- 172.21.15.170:0/3239748959 wait complete. 2020-01-26T15:33:20.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.680 7fdb79fb9700 1 -- 172.21.15.170:0/3239748959 >> 172.21.15.170:0/3239748959 conn(0x7fdb74144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:20.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb79fb9700 1 Processor -- start 2020-01-26T15:33:20.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb79fb9700 1 -- - start start 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb79fb9700 1 -- - --> 172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740a3e00 con 0 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb79fb9700 1 -- - --> 172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740a6b40 con 0 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb737fe700 1 -- 172.21.15.170:0/3713863656 learned_addr learned my addr 172.21.15.170:0/3713863656 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.1 172.21.15.170:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdb68000e50 con 0x7fdb740a6390 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.1 172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2708682421 0 0) 0x7fdb68002080 con 0x7fdb740a6390 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdb54002960 con 0 2020-01-26T15:33:20.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdb64003440 con 0x7fdb740a3410 2020-01-26T15:33:20.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1572099010 0 0) 0x7fdb64003700 con 0x7fdb740a3410 2020-01-26T15:33:20.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fdb54004620 con 0 2020-01-26T15:33:20.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1756259746 0 0) 0x7fdb64003970 con 0x7fdb740a3410 2020-01-26T15:33:20.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdb54002ee0 con 0 2020-01-26T15:33:20.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.1 172.21.15.170:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3016963360 0 0) 0x7fdb680024d0 con 0x7fdb740a6390 2020-01-26T15:33:20.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdb54003540 con 0 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (627826313 0 0) 0x7fdb640010f0 con 0x7fdb740a3410 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 >> 172.21.15.170:6790/0 conn(0x7fdb740a6390 :-1 s=STATE_OPEN pgs=141 cs=1 l=1).mark_down 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7407ab90 con 0 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb740b27b0 con 0 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7418b200 con 0 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fdb64000bf0 con 0x7fdb740a3410 2020-01-26T15:33:20.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (3837947711 0 0) 0x7fdb64001520 con 0x7fdb740a3410 2020-01-26T15:33:20.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 7 ==== mgrmap(e 4) v1 ==== 1228+0+0 (176624143 0 0) 0x7fdb64001970 con 0x7fdb740a3410 2020-01-26T15:33:20.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.684 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (4024184856 0 0) 0x7fdb64004e40 con 0x7fdb740a3410 2020-01-26T15:33:20.694 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.692 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7407af30 con 0 2020-01-26T15:33:20.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.696 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fdb7407af30 con 0x7fdb740a3410 2020-01-26T15:33:20.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 --> 172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb74073330 con 0 2020-01-26T15:33:20.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb70ff9700 1 -- 172.21.15.170:0/3713863656 <== mon.0 172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1702 (312852535 0 1438288351) 0x7fdb640047d0 con 0x7fdb740a3410 2020-01-26T15:33:20.790 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 13 2020-01-26T15:33:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:33:20.790 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:32:15.376136","modified":"2020-01-26 15:32:58.344929","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:33:20.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 >> 172.21.15.170:6800/11008 conn(0x7fdb54006ed0 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-01-26T15:33:20.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 >> 172.21.15.170:6789/0 conn(0x7fdb740a3410 :-1 s=STATE_OPEN pgs=132 cs=1 l=1).mark_down 2020-01-26T15:33:20.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 shutdown_connections 2020-01-26T15:33:20.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 shutdown_connections 2020-01-26T15:33:20.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 wait complete. 2020-01-26T15:33:20.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26 15:33:20.788 7fdb79fb9700 1 -- 172.21.15.170:0/3713863656 >> 172.21.15.170:0/3713863656 conn(0x7fdb74099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:33:20.801 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:33:20.815 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2020-01-26T15:33:20.815 INFO:teuthology.run_tasks:Running task install.upgrade... 2020-01-26T15:33:20.942 INFO:teuthology.task.install:project ceph config {'mon.a': None, 'mon.b': None} overrides {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'} 2020-01-26T15:33:20.943 WARNING:teuthology.task.install:remote ubuntu@smithi170.front.sepia.ceph.com came up twice (role mon.b) 2020-01-26T15:33:20.943 INFO:teuthology.task.install:remote ubuntu@smithi170.front.sepia.ceph.com config {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'} 2020-01-26T15:33:20.943 INFO:teuthology.task.install:extra packages: [] 2020-01-26T15:33:20.943 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:33:20.992 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:33:20.997 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:33:21.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-01-26T15:33:21.003 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2020-01-26T15:33:21.004 INFO:teuthology.orchestra.run.smithi170:> dpkg-query -W -f '${Version}' ceph-common 2020-01-26T15:33:21.028 INFO:teuthology.orchestra.run.smithi170.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:33:21.028 INFO:teuthology.packaging:The installed version of ceph-common is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:33:21.028 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:33:21.125 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:33:21.130 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:33:21.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:33:21.284 INFO:teuthology.task.install:Ceph deb upgrade from 13.2.8-63-ge1c5fd9-1bionic to 15.0.0-9766-g084f050-1bionic 2020-01-26T15:33:21.285 INFO:teuthology.orchestra.run.smithi170:> sudo apt-key list | grep Ceph 2020-01-26T15:33:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:33:21.438 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:33:21.438 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:33:21.440 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:33:21.490 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:33:21.495 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:33:21.496 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:33:21.657 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default/ 2020-01-26T15:33:21.657 INFO:teuthology.task.install.deb:Package version is 15.0.0-9766-g084f050-1bionic 2020-01-26T15:33:21.787 INFO:teuthology.orchestra.run.smithi170:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:33:21.833 INFO:teuthology.orchestra.run.smithi170:> sudo apt-get update 2020-01-26T15:33:22.070 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:33:22.091 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-01-26T15:33:22.114 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:33:22.144 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:33:22.145 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,610 B] 2020-01-26T15:33:22.155 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:6 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:33:22.176 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.3 kB] 2020-01-26T15:33:22.234 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:33:22.316 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:33:22.725 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 25.6 kB in 1s (37.1 kB/s) 2020-01-26T15:33:23.893 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:33:23.936 INFO:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-9766-g084f050-1bionic cephadm=15.0.0-9766-g084f050-1bionic ceph-mds=15.0.0-9766-g084f050-1bionic ceph-mgr=15.0.0-9766-g084f050-1bionic ceph-common=15.0.0-9766-g084f050-1bionic ceph-fuse=15.0.0-9766-g084f050-1bionic ceph-test=15.0.0-9766-g084f050-1bionic radosgw=15.0.0-9766-g084f050-1bionic python3-rados=15.0.0-9766-g084f050-1bionic python3-rgw=15.0.0-9766-g084f050-1bionic python3-cephfs=15.0.0-9766-g084f050-1bionic python3-rbd=15.0.0-9766-g084f050-1bionic libcephfs2=15.0.0-9766-g084f050-1bionic libcephfs-dev=15.0.0-9766-g084f050-1bionic librados2=15.0.0-9766-g084f050-1bionic librbd1=15.0.0-9766-g084f050-1bionic rbd-fuse=15.0.0-9766-g084f050-1bionic 2020-01-26T15:33:24.015 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2020-01-26T15:33:24.258 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2020-01-26T15:33:24.259 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2020-01-26T15:33:24.416 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages were automatically installed and are no longer required: 2020-01-26T15:33:24.417 INFO:teuthology.orchestra.run.smithi170.stdout: formencode-i18n libjs-sphinxdoc libjs-underscore python-bcrypt python-bs4 2020-01-26T15:33:24.417 INFO:teuthology.orchestra.run.smithi170.stdout: python-ceph-argparse python-certifi python-chardet python-cherrypy3 2020-01-26T15:33:24.417 INFO:teuthology.orchestra.run.smithi170.stdout: python-dnspython python-formencode python-html5lib python-jinja2 2020-01-26T15:33:24.417 INFO:teuthology.orchestra.run.smithi170.stdout: python-logutils python-lxml python-mako python-markupsafe python-openid 2020-01-26T15:33:24.417 INFO:teuthology.orchestra.run.smithi170.stdout: python-paste python-pastedeploy python-pastescript python-pecan 2020-01-26T15:33:24.417 INFO:teuthology.orchestra.run.smithi170.stdout: python-prettytable python-pyinotify python-rbd python-repoze.lru 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout: python-requests python-routes python-scgi python-simplegeneric 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout: python-simplejson python-singledispatch python-tempita python-urllib3 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout: python-waitress python-webencodings python-webob python-webtest 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout: python-werkzeug 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout:Use 'sudo apt autoremove' to remove them. 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2020-01-26T15:33:24.418 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-26T15:33:24.419 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2020-01-26T15:33:24.419 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd librabbitmq4 libradosstriper1 librdkafka1 librgw2 python-attr 2020-01-26T15:33:24.419 INFO:teuthology.orchestra.run.smithi170.stdout: python-funcsigs python-pluggy python-py python-pytest python3-asn1crypto 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common python3-cffi-backend python3-cherrypy3 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-joblib 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-01-26T15:33:24.421 INFO:teuthology.orchestra.run.smithi170.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-01-26T15:33:24.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-01-26T15:33:24.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webtest python3-werkzeug 2020-01-26T15:33:24.422 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2020-01-26T15:33:24.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-01-26T15:33:24.422 INFO:teuthology.orchestra.run.smithi170.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-01-26T15:33:24.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2020-01-26T15:33:24.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2020-01-26T15:33:24.423 INFO:teuthology.orchestra.run.smithi170.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2020-01-26T15:33:24.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2020-01-26T15:33:24.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2020-01-26T15:33:24.423 INFO:teuthology.orchestra.run.smithi170.stdout: python-numpy-doc python3-dev python3-numpy-dbg python-openssl-doc 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: libjs-mochikit python-pecan-doc python-pil-doc python3-pil-dbg 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2020-01-26T15:33:24.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-watchdog python-werkzeug-doc 2020-01-26T15:33:24.511 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages will be REMOVED: 2020-01-26T15:33:24.512 INFO:teuthology.orchestra.run.smithi170.stdout: python-cephfs python-rados python-rgw 2020-01-26T15:33:24.512 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2020-01-26T15:33:24.512 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-26T15:33:24.512 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook cephadm 2020-01-26T15:33:24.516 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq4 librdkafka1 python-attr python-funcsigs python-pluggy python-py 2020-01-26T15:33:24.516 INFO:teuthology.orchestra.run.smithi170.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common python3-cffi-backend python3-cherrypy3 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-joblib 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-26T15:33:24.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-01-26T15:33:24.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webtest python3-werkzeug 2020-01-26T15:33:24.519 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages will be upgraded: 2020-01-26T15:33:24.519 INFO:teuthology.orchestra.run.smithi170.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:33:24.519 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test libcephfs-dev libcephfs2 librados2 libradosstriper1 librbd1 2020-01-26T15:33:24.519 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 python3-ceph-argparse python3-cephfs python3-rados python3-rbd 2020-01-26T15:33:24.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw radosgw rbd-fuse 2020-01-26T15:33:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:22 upgraded, 75 newly installed, 3 to remove and 53 not upgraded. 2020-01-26T15:33:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 149 MB of archives. 2020-01-26T15:33:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 417 MB of additional disk space will be used. 2020-01-26T15:33:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-9766-g084f050-1bionic [333 kB] 2020-01-26T15:33:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-01-26T15:33:24.765 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-9766-g084f050-1bionic [5,513 kB] 2020-01-26T15:33:24.914 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-01-26T15:33:25.015 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-9766-g084f050-1bionic [1,396 kB] 2020-01-26T15:33:25.059 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-9766-g084f050-1bionic [5,936 kB] 2020-01-26T15:33:25.186 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-01-26T15:33:25.211 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-01-26T15:33:25.223 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:33:25.257 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-01-26T15:33:25.260 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-01-26T15:33:25.269 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-9766-g084f050-1bionic [1,829 kB] 2020-01-26T15:33:25.276 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-01-26T15:33:25.309 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-01-26T15:33:25.314 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:33:25.317 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-01-26T15:33:25.318 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-01-26T15:33:25.337 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-9766-g084f050-1bionic [3,772 B] 2020-01-26T15:33:25.337 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-9766-g084f050-1bionic [22.7 MB] 2020-01-26T15:33:25.348 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:33:25.350 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-01-26T15:33:25.350 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:33:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-01-26T15:33:25.431 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-01-26T15:33:25.433 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:33:25.439 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:33:25.461 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-01-26T15:33:25.462 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-01-26T15:33:25.626 INFO:teuthology.orchestra.run.smithi170.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:33:25.940 INFO:teuthology.orchestra.run.smithi170.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:33:26.074 INFO:teuthology.orchestra.run.smithi170.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-01-26T15:33:26.087 INFO:teuthology.orchestra.run.smithi170.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-01-26T15:33:26.090 INFO:teuthology.orchestra.run.smithi170.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-01-26T15:33:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-01-26T15:33:26.107 INFO:teuthology.orchestra.run.smithi170.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-01-26T15:33:26.145 INFO:teuthology.orchestra.run.smithi170.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-9766-g084f050-1bionic [41.6 MB] 2020-01-26T15:33:26.366 INFO:teuthology.orchestra.run.smithi170.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-01-26T15:33:26.366 INFO:teuthology.orchestra.run.smithi170.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-01-26T15:33:26.643 INFO:teuthology.orchestra.run.smithi170.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-01-26T15:33:26.688 INFO:teuthology.orchestra.run.smithi170.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-01-26T15:33:26.690 INFO:teuthology.orchestra.run.smithi170.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-01-26T15:33:26.721 INFO:teuthology.orchestra.run.smithi170.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-01-26T15:33:26.723 INFO:teuthology.orchestra.run.smithi170.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-01-26T15:33:26.724 INFO:teuthology.orchestra.run.smithi170.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-01-26T15:33:26.725 INFO:teuthology.orchestra.run.smithi170.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-01-26T15:33:26.726 INFO:teuthology.orchestra.run.smithi170.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-01-26T15:33:26.728 INFO:teuthology.orchestra.run.smithi170.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-01-26T15:33:26.729 INFO:teuthology.orchestra.run.smithi170.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-01-26T15:33:26.806 INFO:teuthology.orchestra.run.smithi170.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-01-26T15:33:26.820 INFO:teuthology.orchestra.run.smithi170.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-01-26T15:33:26.982 INFO:teuthology.orchestra.run.smithi170.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-01-26T15:33:27.425 INFO:teuthology.orchestra.run.smithi170.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-01-26T15:33:27.432 INFO:teuthology.orchestra.run.smithi170.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-01-26T15:33:27.471 INFO:teuthology.orchestra.run.smithi170.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-01-26T15:33:27.477 INFO:teuthology.orchestra.run.smithi170.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-01-26T15:33:27.480 INFO:teuthology.orchestra.run.smithi170.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-01-26T15:33:27.506 INFO:teuthology.orchestra.run.smithi170.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-01-26T15:33:27.516 INFO:teuthology.orchestra.run.smithi170.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-9766-g084f050-1bionic [5,125 kB] 2020-01-26T15:33:27.520 INFO:teuthology.orchestra.run.smithi170.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-01-26T15:33:27.551 INFO:teuthology.orchestra.run.smithi170.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-01-26T15:33:27.559 INFO:teuthology.orchestra.run.smithi170.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-01-26T15:33:27.559 INFO:teuthology.orchestra.run.smithi170.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-01-26T15:33:27.587 INFO:teuthology.orchestra.run.smithi170.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-01-26T15:33:27.595 INFO:teuthology.orchestra.run.smithi170.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-01-26T15:33:27.676 INFO:teuthology.orchestra.run.smithi170.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-9766-g084f050-1bionic [18.0 MB] 2020-01-26T15:33:27.705 INFO:teuthology.orchestra.run.smithi170.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-01-26T15:33:27.708 INFO:teuthology.orchestra.run.smithi170.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-01-26T15:33:27.710 INFO:teuthology.orchestra.run.smithi170.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-01-26T15:33:27.848 INFO:teuthology.orchestra.run.smithi170.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-01-26T15:33:27.848 INFO:teuthology.orchestra.run.smithi170.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-01-26T15:33:27.857 INFO:teuthology.orchestra.run.smithi170.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pil amd64 5.1.0-1 [328 kB] 2020-01-26T15:33:27.866 INFO:teuthology.orchestra.run.smithi170.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-01-26T15:33:27.867 INFO:teuthology.orchestra.run.smithi170.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-01-26T15:33:28.031 INFO:teuthology.orchestra.run.smithi170.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-01-26T15:33:28.215 INFO:teuthology.orchestra.run.smithi170.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-01-26T15:33:28.268 INFO:teuthology.orchestra.run.smithi170.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-9766-g084f050-1bionic [17.3 kB] 2020-01-26T15:33:28.268 INFO:teuthology.orchestra.run.smithi170.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-9766-g084f050-1bionic [118 kB] 2020-01-26T15:33:28.270 INFO:teuthology.orchestra.run.smithi170.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-9766-g084f050-1bionic [433 kB] 2020-01-26T15:33:28.284 INFO:teuthology.orchestra.run.smithi170.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-9766-g084f050-1bionic [20.5 kB] 2020-01-26T15:33:28.285 INFO:teuthology.orchestra.run.smithi170.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.0.0-9766-g084f050-1bionic [99.2 kB] 2020-01-26T15:33:28.288 INFO:teuthology.orchestra.run.smithi170.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-9766-g084f050-1bionic [331 kB] 2020-01-26T15:33:28.298 INFO:teuthology.orchestra.run.smithi170.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-9766-g084f050-1bionic [1,582 kB] 2020-01-26T15:33:28.351 INFO:teuthology.orchestra.run.smithi170.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-9766-g084f050-1bionic [4,627 kB] 2020-01-26T15:33:28.420 INFO:teuthology.orchestra.run.smithi170.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-01-26T15:33:28.452 INFO:teuthology.orchestra.run.smithi170.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-01-26T15:33:28.503 INFO:teuthology.orchestra.run.smithi170.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-9766-g084f050-1bionic [3,047 kB] 2020-01-26T15:33:28.603 INFO:teuthology.orchestra.run.smithi170.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.0.0-9766-g084f050-1bionic [18.3 kB] 2020-01-26T15:33:28.603 INFO:teuthology.orchestra.run.smithi170.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.0.0-9766-g084f050-1bionic [276 kB] 2020-01-26T15:33:28.618 INFO:teuthology.orchestra.run.smithi170.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-9766-g084f050-1bionic [513 kB] 2020-01-26T15:33:28.634 INFO:teuthology.orchestra.run.smithi170.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.0.0-9766-g084f050-1bionic [24.9 kB] 2020-01-26T15:33:28.634 INFO:teuthology.orchestra.run.smithi170.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.0.0-9766-g084f050-1bionic [22.5 kB] 2020-01-26T15:33:28.635 INFO:teuthology.orchestra.run.smithi170.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-9766-g084f050-1bionic [3,434 kB] 2020-01-26T15:33:28.745 INFO:teuthology.orchestra.run.smithi170.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-9766-g084f050-1bionic [34.1 kB] 2020-01-26T15:33:28.745 INFO:teuthology.orchestra.run.smithi170.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-9766-g084f050-1bionic [7,888 kB] 2020-01-26T15:33:29.004 INFO:teuthology.orchestra.run.smithi170.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-9766-g084f050-1bionic [3,888 B] 2020-01-26T15:33:29.004 INFO:teuthology.orchestra.run.smithi170.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-9766-g084f050-1bionic [13.4 kB] 2020-01-26T15:33:29.005 INFO:teuthology.orchestra.run.smithi170.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-9766-g084f050-1bionic [62.0 kB] 2020-01-26T15:33:29.828 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 149 MB in 4s (33.4 MB/s) 2020-01-26T15:33:30.010 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140481 files and directories currently installed.) 2020-01-26T15:33:30.014 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../0-libradosstriper1_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:30.150 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libradosstriper1 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:30.636 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../1-radosgw_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:30.764 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking radosgw (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:31.943 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../2-ceph-mgr_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:32.139 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:32.872 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../3-ceph-mon_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:32.989 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mon (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:33.967 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../4-ceph-mds_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:34.094 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mds (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:34.656 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../5-ceph_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:34.775 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:35.230 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../6-ceph-osd_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:35.414 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-osd (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:37.478 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../7-ceph-test_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:37.598 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-test (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:40.987 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../8-ceph-base_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:41.191 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-base (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:42.240 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../9-ceph-common_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:42.351 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-common (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:44.148 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140058 files and directories currently installed.) 2020-01-26T15:33:44.151 INFO:teuthology.orchestra.run.smithi170.stdout:Removing python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:44.516 INFO:teuthology.orchestra.run.smithi170.stdout:Removing python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:44.951 INFO:teuthology.orchestra.run.smithi170.stdout:Removing python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:45.514 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140037 files and directories currently installed.) 2020-01-26T15:33:45.518 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../00-libcephfs-dev_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs-dev (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:46.005 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../01-python3-cephfs_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:46.214 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cephfs (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:46.589 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../02-libcephfs2_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:46.718 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs2 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:47.105 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../03-python3-ceph-argparse_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:33:47.318 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-argparse (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:47.626 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../04-python3-rgw_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:47.738 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rgw (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:48.058 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../05-python3-rados_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:48.176 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rados (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:48.566 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../06-librbd1_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:48.701 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librbd1 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:49.221 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../07-librgw2_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librgw2 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:50.057 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../08-librados2_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:33:50.186 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librados2 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:33:50.823 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-01-26T15:33:50.835 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../09-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-01-26T15:33:50.881 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-26T15:33:51.223 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-01-26T15:33:51.237 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../10-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-01-26T15:33:51.281 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-26T15:33:51.742 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cffi-backend. 2020-01-26T15:33:51.758 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../11-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-01-26T15:33:51.801 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-01-26T15:33:52.121 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-bcrypt. 2020-01-26T15:33:52.136 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../12-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:33:52.179 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-01-26T15:33:52.458 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cherrypy3. 2020-01-26T15:33:52.474 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../13-python3-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:33:52.507 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-01-26T15:33:52.845 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jwt. 2020-01-26T15:33:52.860 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../14-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-01-26T15:33:52.903 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-01-26T15:33:53.215 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-asn1crypto. 2020-01-26T15:33:53.229 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../15-python3-asn1crypto_0.24.0-1_all.deb ... 2020-01-26T15:33:53.274 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-01-26T15:33:53.589 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cryptography. 2020-01-26T15:33:53.601 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../16-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-01-26T15:33:53.649 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-26T15:33:54.026 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-openssl. 2020-01-26T15:33:54.039 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../17-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:33:54.076 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:33:54.346 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-logutils. 2020-01-26T15:33:54.361 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../18-python3-logutils_0.3.3-5_all.deb ... 2020-01-26T15:33:54.396 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-01-26T15:33:54.708 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-markupsafe. 2020-01-26T15:33:54.723 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../19-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:33:54.766 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-01-26T15:33:55.078 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-mako. 2020-01-26T15:33:55.094 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../20-python3-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:33:55.136 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-01-26T15:33:55.456 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-simplegeneric. 2020-01-26T15:33:55.472 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../21-python3-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:33:55.515 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-01-26T15:33:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-singledispatch. 2020-01-26T15:33:55.824 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../22-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:33:55.868 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-01-26T15:33:56.179 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webob. 2020-01-26T15:33:56.193 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../23-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:33:56.238 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:33:57.587 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-bs4. 2020-01-26T15:33:57.601 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../24-python3-bs4_4.6.0-1_all.deb ... 2020-01-26T15:33:57.638 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-01-26T15:33:57.966 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-waitress. 2020-01-26T15:33:57.980 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../25-python3-waitress_1.0.1-1_all.deb ... 2020-01-26T15:33:58.025 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-01-26T15:33:58.345 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tempita. 2020-01-26T15:33:58.359 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../26-python3-tempita_0.5.2-2_all.deb ... 2020-01-26T15:33:58.403 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-01-26T15:33:58.734 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-paste. 2020-01-26T15:33:58.745 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../27-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:33:58.790 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:33:59.169 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pastedeploy. 2020-01-26T15:33:59.184 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../28-python3-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:33:59.227 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-01-26T15:33:59.533 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webtest. 2020-01-26T15:33:59.546 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../29-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:33:59.597 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:33:59.951 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pecan. 2020-01-26T15:33:59.963 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../30-python3-pecan_1.2.1-2_all.deb ... 2020-01-26T15:34:00.000 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-01-26T15:34:00.365 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-werkzeug. 2020-01-26T15:34:00.380 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../31-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:34:00.423 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:34:00.764 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-ceph-common. 2020-01-26T15:34:00.777 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../32-python3-ceph-common_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:00.822 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-common (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:01.134 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-prettytable. 2020-01-26T15:34:01.150 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../33-python3-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:34:01.192 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-01-26T15:34:01.457 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../34-python3-rbd_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:34:01.579 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rbd (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:34:02.017 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-uritemplate. 2020-01-26T15:34:02.033 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../35-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-01-26T15:34:02.083 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-01-26T15:34:02.474 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../36-ceph-fuse_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:34:02.608 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-fuse (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:34:03.200 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephadm. 2020-01-26T15:34:03.215 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../37-cephadm_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:34:03.259 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:03.612 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-01-26T15:34:03.625 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../38-ceph-mgr-cephadm_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:03.662 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:03.981 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-repoze.lru. 2020-01-26T15:34:03.998 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../39-python3-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:34:04.046 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-01-26T15:34:04.363 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-routes. 2020-01-26T15:34:04.376 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../40-python3-routes_2.4.1-1_all.deb ... 2020-01-26T15:34:04.422 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-01-26T15:34:04.747 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-01-26T15:34:04.766 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../41-ceph-mgr-dashboard_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:04.805 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-dashboard (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:05.620 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-01-26T15:34:05.634 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../42-ceph-mgr-diskprediction-cloud_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:05.687 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:06.007 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-numpy. 2020-01-26T15:34:06.022 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../43-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-01-26T15:34:06.065 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-26T15:34:06.696 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-decorator. 2020-01-26T15:34:06.713 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../44-python3-decorator_4.1.2-1_all.deb ... 2020-01-26T15:34:06.756 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-01-26T15:34:07.092 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-scipy. 2020-01-26T15:34:07.109 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../45-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-01-26T15:34:07.159 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-01-26T15:34:08.381 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-01-26T15:34:08.398 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../46-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-01-26T15:34:08.442 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-01-26T15:34:08.958 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-joblib. 2020-01-26T15:34:08.972 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../47-python3-joblib_0.11-1_all.deb ... 2020-01-26T15:34:09.010 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-joblib (0.11-1) ... 2020-01-26T15:34:09.384 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sklearn. 2020-01-26T15:34:09.398 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../48-python3-sklearn_0.19.1-3_all.deb ... 2020-01-26T15:34:09.444 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-01-26T15:34:10.019 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-01-26T15:34:10.034 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../49-ceph-mgr-diskprediction-local_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:10.071 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:11.161 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-dateutil. 2020-01-26T15:34:11.176 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../50-python3-dateutil_2.6.1-1_all.deb ... 2020-01-26T15:34:11.227 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-01-26T15:34:11.551 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-monotonic. 2020-01-26T15:34:11.565 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../51-python3-monotonic_1.1-2_all.deb ... 2020-01-26T15:34:11.609 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-01-26T15:34:11.913 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-fasteners. 2020-01-26T15:34:11.933 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../52-python3-fasteners_0.12.0-3_all.deb ... 2020-01-26T15:34:11.972 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-01-26T15:34:12.302 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-httplib2. 2020-01-26T15:34:12.316 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../53-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-01-26T15:34:12.360 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-26T15:34:12.673 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyasn1. 2020-01-26T15:34:12.688 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../54-python3-pyasn1_0.4.2-3_all.deb ... 2020-01-26T15:34:12.724 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-01-26T15:34:13.095 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-01-26T15:34:13.109 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../55-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-01-26T15:34:13.162 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-26T15:34:13.483 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rsa. 2020-01-26T15:34:13.497 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../56-python3-rsa_3.4.2-1_all.deb ... 2020-01-26T15:34:13.552 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-01-26T15:34:13.931 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-01-26T15:34:13.945 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../57-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-01-26T15:34:13.989 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-26T15:34:14.436 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-oauth2client. 2020-01-26T15:34:14.452 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../58-python3-oauth2client_4.1.2-3_all.deb ... 2020-01-26T15:34:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-01-26T15:34:14.865 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-setuptools. 2020-01-26T15:34:14.880 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../59-python3-setuptools_39.0.1-2_all.deb ... 2020-01-26T15:34:14.923 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-01-26T15:34:15.336 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-websocket. 2020-01-26T15:34:15.352 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../60-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-01-26T15:34:15.395 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-01-26T15:34:15.720 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-kubernetes. 2020-01-26T15:34:15.736 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../61-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-01-26T15:34:15.778 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-26T15:34:16.189 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-01-26T15:34:16.204 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:16.247 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:16.571 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-01-26T15:34:16.585 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../63-ceph-mgr-rook_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:34:16.629 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-rook (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:16.940 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-attr. 2020-01-26T15:34:16.956 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../64-python-attr_17.4.0-2_all.deb ... 2020-01-26T15:34:17.007 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-attr (17.4.0-2) ... 2020-01-26T15:34:17.336 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-funcsigs. 2020-01-26T15:34:17.351 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../65-python-funcsigs_1.0.2-4_all.deb ... 2020-01-26T15:34:17.392 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-01-26T15:34:17.696 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pluggy. 2020-01-26T15:34:17.712 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../66-python-pluggy_0.6.0-1_all.deb ... 2020-01-26T15:34:17.754 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-01-26T15:34:18.058 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-py. 2020-01-26T15:34:18.072 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../67-python-py_1.5.2-1_all.deb ... 2020-01-26T15:34:18.116 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-py (1.5.2-1) ... 2020-01-26T15:34:18.445 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pytest. 2020-01-26T15:34:18.460 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../68-python-pytest_3.3.2-2_all.deb ... 2020-01-26T15:34:18.495 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-01-26T15:34:18.841 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-attr. 2020-01-26T15:34:18.856 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../69-python3-attr_17.4.0-2_all.deb ... 2020-01-26T15:34:18.899 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-01-26T15:34:19.211 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cycler. 2020-01-26T15:34:19.225 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../70-python3-cycler_0.10.0-1_all.deb ... 2020-01-26T15:34:19.269 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-01-26T15:34:19.571 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webencodings. 2020-01-26T15:34:19.585 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../71-python3-webencodings_0.5-2_all.deb ... 2020-01-26T15:34:19.629 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-01-26T15:34:19.891 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-html5lib. 2020-01-26T15:34:19.905 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../72-python3-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:34:19.941 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-01-26T15:34:20.372 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-01-26T15:34:20.393 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../73-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:34:20.431 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:34:20.884 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyparsing. 2020-01-26T15:34:20.900 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../74-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-01-26T15:34:20.934 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-26T15:34:21.281 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tz. 2020-01-26T15:34:21.300 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../75-python3-tz_2018.3-2_all.deb ... 2020-01-26T15:34:21.340 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tz (2018.3-2) ... 2020-01-26T15:34:21.636 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-matplotlib. 2020-01-26T15:34:21.650 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../76-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-01-26T15:34:21.685 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-26T15:34:22.427 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-olefile. 2020-01-26T15:34:22.442 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../77-python3-olefile_0.45.1-1_all.deb ... 2020-01-26T15:34:22.483 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-01-26T15:34:22.795 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pastescript. 2020-01-26T15:34:22.809 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../78-python3-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:34:22.861 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-01-26T15:34:23.234 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pil:amd64. 2020-01-26T15:34:23.251 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../79-python3-pil_5.1.0-1_amd64.deb ... 2020-01-26T15:34:23.292 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pil:amd64 (5.1.0-1) ... 2020-01-26T15:34:23.659 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pluggy. 2020-01-26T15:34:23.667 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../80-python3-pluggy_0.6.0-1_all.deb ... 2020-01-26T15:34:23.704 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-01-26T15:34:24.017 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-py. 2020-01-26T15:34:24.033 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../81-python3-py_1.5.2-1_all.deb ... 2020-01-26T15:34:24.074 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-py (1.5.2-1) ... 2020-01-26T15:34:24.429 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyinotify. 2020-01-26T15:34:24.444 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../82-python3-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:34:24.489 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-01-26T15:34:24.801 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pytest. 2020-01-26T15:34:24.816 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../83-python3-pytest_3.3.2-2_all.deb ... 2020-01-26T15:34:24.859 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-01-26T15:34:25.213 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-simplejson. 2020-01-26T15:34:25.229 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../84-python3-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:34:25.271 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-01-26T15:34:25.607 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tk:amd64. 2020-01-26T15:34:25.618 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../85-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-01-26T15:34:25.658 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-26T15:34:25.993 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../86-rbd-fuse_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:34:26.112 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking rbd-fuse (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:34:26.444 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-01-26T15:34:26.743 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:34:27.137 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-26T15:34:27.263 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-26T15:34:27.982 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pil:amd64 (5.1.0-1) ... 2020-01-26T15:34:28.376 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-01-26T15:34:28.668 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webencodings (0.5-2) ... 2020-01-26T15:34:28.987 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-attr (17.4.0-2) ... 2020-01-26T15:34:29.171 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-01-26T15:34:29.281 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-py (1.5.2-1) ... 2020-01-26T15:34:29.616 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:34:29.943 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-01-26T15:34:30.033 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:34:30.311 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-01-26T15:34:30.596 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-argparse (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:30.872 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-01-26T15:34:31.182 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-26T15:34:32.110 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:34:32.427 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-01-26T15:34:32.730 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-py (1.5.2-1) ... 2020-01-26T15:34:32.950 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-01-26T15:34:33.293 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-01-26T15:34:33.514 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-01-26T15:34:33.789 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-26T15:34:34.082 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-01-26T15:34:34.383 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-01-26T15:34:34.734 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-01-26T15:34:35.061 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-01-26T15:34:35.379 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:35.962 INFO:teuthology.orchestra.run.smithi170.stdout:Adding system user cephadm....done 2020-01-26T15:34:36.117 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-01-26T15:34:36.414 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librados2 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:36.518 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-01-26T15:34:36.857 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-01-26T15:34:37.169 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs2 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:37.297 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-01-26T15:34:37.633 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-common (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:38.012 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-monotonic (1.1-2) ... 2020-01-26T15:34:38.325 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs-dev (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:38.443 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-01-26T15:34:38.821 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-01-26T15:34:39.109 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-26T15:34:39.406 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rados (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:39.524 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-26T15:34:39.853 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-attr (17.4.0-2) ... 2020-01-26T15:34:40.137 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-01-26T15:34:40.322 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:34:40.707 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-01-26T15:34:41.010 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-01-26T15:34:41.100 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-01-26T15:34:41.362 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-26T15:34:41.480 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-26T15:34:41.707 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-01-26T15:34:42.117 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-01-26T15:34:42.410 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tz (2018.3-2) ... 2020-01-26T15:34:42.703 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-01-26T15:34:43.013 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-01-26T15:34:43.306 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-joblib (0.11-1) ... 2020-01-26T15:34:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-routes (2.4.1-1) ... 2020-01-26T15:34:43.976 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-01-26T15:34:44.285 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-01-26T15:34:44.604 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-26T15:34:44.983 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-01-26T15:34:45.278 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-01-26T15:34:46.450 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:34:46.743 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libradosstriper1 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:46.869 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cephfs (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:47.171 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-01-26T15:34:47.514 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-01-26T15:34:47.614 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librgw2 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:47.724 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-01-26T15:34:48.092 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-fuse (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:48.510 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librbd1 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:48.636 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pytest (3.3.2-2) ... 2020-01-26T15:34:48.896 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-01-26T15:34:49.333 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-01-26T15:34:49.651 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-01-26T15:34:49.969 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:34:50.279 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-01-26T15:34:50.614 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rgw (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:50.735 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-26T15:34:51.560 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up rbd-fuse (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:51.681 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-01-26T15:34:52.525 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rbd (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:52.658 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-26T15:34:53.336 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-common (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:53.419 INFO:teuthology.orchestra.run.smithi170.stdout:Installing new version of config file /etc/bash_completion.d/rados ... 2020-01-26T15:34:53.811 INFO:teuthology.orchestra.run.smithi170.stdout:Setting system user ceph properties..usermod: no changes 2020-01-26T15:34:53.922 INFO:teuthology.orchestra.run.smithi170.stdout:..done 2020-01-26T15:34:53.940 INFO:teuthology.orchestra.run.smithi170.stdout:Fixing /var/run/ceph ownership....done 2020-01-26T15:34:54.365 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up radosgw (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:54.399 INFO:teuthology.orchestra.run.smithi170.stdout:Installing new version of config file /etc/init.d/radosgw ... 2020-01-26T15:34:54.910 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-test (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:55.036 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-base (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:55.078 INFO:teuthology.orchestra.run.smithi170.stdout:Installing new version of config file /etc/init.d/ceph ... 2020-01-26T15:34:55.573 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:55.958 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:56.107 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-osd (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:56.712 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:56.854 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:56.989 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-rook (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:57.107 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mds (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:57.500 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mon (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:57.893 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-k8sevents (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:58.019 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-dashboard (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:58.166 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:34:58.773 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:34:58.966 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:35:00.384 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:35:00.485 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:35:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:35:00.919 INFO:teuthology.orchestra.run.smithi170:> sudo lsb_release -is 2020-01-26T15:35:00.963 INFO:teuthology.orchestra.run.smithi170.stdout:Ubuntu 2020-01-26T15:35:00.967 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:35:00.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:35:01.144 INFO:teuthology.orchestra.run.smithi170:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:35:01.168 INFO:teuthology.orchestra.run.smithi170.stdout:15.0.0-9766-g084f050-1bionic 2020-01-26T15:35:01.168 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-9766-g084f050-1bionic 2020-01-26T15:35:01.169 INFO:teuthology.task.install:The correct ceph version 15.0.0-9766-g084f050-1bionic is installed. 2020-01-26T15:35:01.169 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:35:01.258 INFO:teuthology.task.print:**** done install.upgrade both hosts 2020-01-26T15:35:01.258 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-01-26T15:35:01.278 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-01-26T15:35:01.278 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:01.294 INFO:tasks.ceph.mon.a:Stopped 2020-01-26T15:35:01.294 INFO:tasks.ceph.mon.a:Restarting daemon 2020-01-26T15:35:01.295 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-01-26T15:35:01.339 INFO:tasks.ceph.mon.a:Started 2020-01-26T15:35:01.339 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-01-26T15:35:01.339 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:01.356 INFO:tasks.ceph.mon.c:Stopped 2020-01-26T15:35:01.356 INFO:tasks.ceph.mon.c:Restarting daemon 2020-01-26T15:35:01.356 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-01-26T15:35:01.403 INFO:tasks.ceph.mon.c:Started 2020-01-26T15:35:01.403 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-01-26T15:35:01.403 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:01.422 INFO:tasks.ceph.mon.b:Stopped 2020-01-26T15:35:01.422 INFO:tasks.ceph.mon.b:Restarting daemon 2020-01-26T15:35:01.422 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-01-26T15:35:01.467 INFO:tasks.ceph.mon.b:Started 2020-01-26T15:35:01.467 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-01-26T15:35:01.467 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:01.488 INFO:tasks.ceph.mgr.y:Stopped 2020-01-26T15:35:01.488 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-01-26T15:35:01.488 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-01-26T15:35:01.531 INFO:tasks.ceph.mgr.y:Started 2020-01-26T15:35:01.532 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-01-26T15:35:01.532 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:01.545 INFO:tasks.ceph.mgr.x:Stopped 2020-01-26T15:35:01.545 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-01-26T15:35:01.546 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-01-26T15:35:01.595 INFO:tasks.ceph.mgr.x:Started 2020-01-26T15:35:01.595 INFO:teuthology.run_tasks:Running task exec... 2020-01-26T15:35:01.733 INFO:teuthology.task.exec:Executing custom commands... 2020-01-26T15:35:01.733 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:35:01.734 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set global mon_warn_on_msgr2_not_enabled false' 2020-01-26T15:35:01.735 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:01.628+0000 7f9c125ee700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x5635b5c48000 0x5635b5c50000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:01.735 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:01.628+0000 7f9c12def700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6790/0 conn(0x5635b5c48900 0x5635b5c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:01.735 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:01.656+0000 7f341e08d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55feb3716900 0x55feb371e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:01.736 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:01.656+0000 7f341d88c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x55feb3716000 0x55feb371e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:01.834 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:01.832+0000 7f9c12def700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6790/0 conn(0x5635b5c48900 0x5635b5c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:01.834 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:01.832+0000 7f9c125ee700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6791/0 conn(0x5635b5c48000 0x5635b5c50000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:01.862 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:01.860+0000 7f341e08d700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6790/0 conn(0x55feb3716900 0x55feb371e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:01.862 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:01.860+0000 7f341d88c700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6791/0 conn(0x55feb3716000 0x55feb371e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:02.238 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:02.236+0000 7f9c12def700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6790/0 conn(0x5635b5c48900 0x5635b5c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:02.238 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:02.236+0000 7f9c125ee700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6791/0 conn(0x5635b5c48000 0x5635b5c50000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:02.267 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:02.264+0000 7f341e08d700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6790/0 conn(0x55feb3716900 0x55feb371e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:02.267 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:02.264+0000 7f341d88c700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6791/0 conn(0x55feb3716000 0x55feb371e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:03.042 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:03.040+0000 7f9c125ee700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6791/0 conn(0x5635b5c48000 0x5635b5c50000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:03.042 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:03.040+0000 7f9c12def700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6790/0 conn(0x5635b5c48900 0x5635b5c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:03.070 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:03.068+0000 7f341d88c700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6791/0 conn(0x55feb3716000 0x55feb371e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:03.070 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:03.068+0000 7f341e08d700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6790/0 conn(0x55feb3716900 0x55feb371e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:04.644 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:04.644+0000 7f9c12def700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6790/0 conn(0x5635b5c48900 0x5635b5c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:04.644 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:04.644+0000 7f9c125ee700 -1 --2- 172.21.15.170:0/1306685882 >> v2:172.21.15.170:6791/0 conn(0x5635b5c48000 0x5635b5c50000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:04.674 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:04.672+0000 7f341d88c700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6791/0 conn(0x55feb3716000 0x55feb371e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:04.674 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:04.672+0000 7f341e08d700 -1 --2- 172.21.15.170:0/191487586 >> v2:172.21.15.170:6790/0 conn(0x55feb3716900 0x55feb371e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.727 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:06.724+0000 7f341d88c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55feb3716480 0x55feb371eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 Processor -- start 2020-01-26T15:35:06.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 -- start start 2020-01-26T15:35:06.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:06.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:06.732 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000282f0 con 0x7f1300025d20 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1300025750 con 0x7f1300027410 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130f4ae700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1300026150 con 0x7f13000ecb60 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130ecad700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130ecad700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f1310710700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130e4ac700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1300025d20 0x7f13000e1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:49966/0 (socket says 172.21.15.170:49966) 2020-01-26T15:35:06.733 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f130e4ac700 1 -- 172.21.15.170:0/1849110378 learned_addr learned my addr 172.21.15.170:0/1849110378 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:01.984+0000 7f1310710700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.188+0000 7f130ecad700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.188+0000 7f130ecad700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.188+0000 7f1310710700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.188+0000 7f1310710700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.592+0000 7f1310710700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.734 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.592+0000 7f130ecad700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.592+0000 7f1310710700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:02.592+0000 7f130ecad700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:03.396+0000 7f1310710700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:03.396+0000 7f130ecad700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:03.396+0000 7f1310710700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:03.396+0000 7f130ecad700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-01-26T15:35:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:05.000+0000 7f130ecad700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:05.000+0000 7f1310710700 -1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:05.000+0000 7f130ecad700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-01-26T15:35:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:05.000+0000 7f1310710700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-01-26T15:35:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244420384 0 0) 0x7f13000282f0 con 0x7f1300025d20 2020-01-26T15:35:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f4003230 con 0x7f1300025d20 2020-01-26T15:35:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2512780901 0 0) 0x7f12f4003230 con 0x7f1300025d20 2020-01-26T15:35:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 msgr2=0x7f13000eefa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 msgr2=0x7f13000264f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.720+0000 7f130dcab700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.724+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300006860 con 0x7f1300025d20 2020-01-26T15:35:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.724+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f12f80016e0 con 0x7f1300025d20 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.724+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f12f8001a70 con 0x7f1300025d20 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.724+0000 7f130dcab700 1 -- 172.21.15.170:0/1849110378 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f12f80045b0 con 0x7f1300025d20 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.724+0000 7f130f4ae700 1 -- 172.21.15.170:0/1849110378 >> v1:172.21.15.170:6789/0 conn(0x7f1300025d20 legacy=0x7f13000e1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 -- 172.21.15.170:0/1849110378 shutdown_connections 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6791/0 conn(0x7f13000ecb60 0x7f13000eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 --2- 172.21.15.170:0/1849110378 >> v2:172.21.15.170:6790/0 conn(0x7f1300027410 0x7f13000264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 -- 172.21.15.170:0/1849110378 >> 172.21.15.170:0/1849110378 conn(0x7f13000389a0 msgr2=0x7f1300038dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 -- 172.21.15.170:0/1849110378 shutdown_connections 2020-01-26T15:35:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 -- 172.21.15.170:0/1849110378 wait complete. 2020-01-26T15:35:06.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 Processor -- start 2020-01-26T15:35:06.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.728+0000 7f130f4ae700 1 -- start start 2020-01-26T15:35:06.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130f4ae700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f13000e6770 0x7f13000e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:06.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130f4ae700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000e5bb0 con 0x7f13000c1820 2020-01-26T15:35:06.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130f4ae700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000ee9a0 con 0x7f13000e6cf0 2020-01-26T15:35:06.742 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130f4ae700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1300027410 con 0x7f13000e6770 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130ecad700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f13000e6cf0 0x7f13000e7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:46956/0 (socket says 172.21.15.170:46956) 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130ecad700 1 -- 172.21.15.170:0/830682032 learned_addr learned my addr 172.21.15.170:0/830682032 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130e4ac700 -1 --2- 172.21.15.170:0/830682032 >> v2:172.21.15.170:6790/0 conn(0x7f13000e6770 0x7f13000e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f130e4ac700 1 --2- 172.21.15.170:0/830682032 >> v2:172.21.15.170:6790/0 conn(0x7f13000e6770 0x7f13000e46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575912339 0 0) 0x7f13000ee9a0 con 0x7f13000e6cf0 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f0003230 con 0x7f13000e6cf0 2020-01-26T15:35:06.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014073774 0 0) 0x7f13000e5bb0 con 0x7f13000c1820 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13000ee9a0 con 0x7f13000c1820 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3090470136 0 0) 0x7f12f0003230 con 0x7f13000e6cf0 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f13000e5bb0 con 0x7f13000e6cf0 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1304002750 con 0x7f13000e6cf0 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2819286253 0 0) 0x7f13000ee9a0 con 0x7f13000c1820 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f12f0003230 con 0x7f13000c1820 2020-01-26T15:35:06.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f13080434a0 con 0x7f13000c1820 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3078829007 0 0) 0x7f12f0003230 con 0x7f13000c1820 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 >> v2:172.21.15.170:6790/0 conn(0x7f13000e6770 msgr2=0x7f13000e46a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 --2- 172.21.15.170:0/830682032 >> v2:172.21.15.170:6790/0 conn(0x7f13000e6770 0x7f13000e46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 >> v1:172.21.15.170:6790/0 conn(0x7f13000e6cf0 legacy=0x7f13000e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000e8220 con 0x7f13000c1820 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000c2450 con 0x7f13000c1820 2020-01-26T15:35:06.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000ce6b0 con 0x7f13000c1820 2020-01-26T15:35:06.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f130805e4d0 con 0x7f13000c1820 2020-01-26T15:35:06.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1308043780 con 0x7f13000c1820 2020-01-26T15:35:06.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300004bf0 con 0x7f13000c1820 2020-01-26T15:35:06.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7f1308067060 con 0x7f13000c1820 2020-01-26T15:35:06.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7f130806aa30 con 0x7f13000c1820 2020-01-26T15:35:06.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.736+0000 7f130ecad700 1 -- 172.21.15.170:0/830682032 >> v1:172.21.15.170:6800/11008 conn(0x7f12f0005ed0 legacy=0x7f12f0008310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:06.747 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f9c12def700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x5635b5c48d80 0x5635b5c51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.747 INFO:tasks.ceph.mgr.y.smithi170.stderr:2020-01-26T15:35:06.732+0000 7f9c11ded700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x5635b5c48900 0x5635b5c50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.740+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f130806fae0 con 0x7f13000c1820 2020-01-26T15:35:06.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.812+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "config set", "who": "global", "name": "mon_warn_on_msgr2_not_enabled", "value": "false"} v 0) v1 -- 0x7f1300008150 con 0x7f13000c1820 2020-01-26T15:35:06.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 10 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f130805cb90 con 0x7f13000c1820 2020-01-26T15:35:06.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f12ff7fe700 1 -- 172.21.15.170:0/830682032 <== mon.0 v1:172.21.15.170:6789/0 11 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_warn_on_msgr2_not_enabled", "value": "false"}]=0 v2) v1 ==== 134+0+0 (unknown 2256562639 0 0) 0x7f130805ce40 con 0x7f13000c1820 2020-01-26T15:35:06.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 >> v1:172.21.15.170:6800/11008 conn(0x7f12f0005ed0 legacy=0x7f12f0008310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:06.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 >> v1:172.21.15.170:6789/0 conn(0x7f13000c1820 legacy=0x7f13000c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:06.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 shutdown_connections 2020-01-26T15:35:06.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 --2- 172.21.15.170:0/830682032 >> v2:172.21.15.170:6790/0 conn(0x7f13000e6770 0x7f13000e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:06.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 >> 172.21.15.170:0/830682032 conn(0x7f13000260a0 msgr2=0x7f1300005470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:06.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 shutdown_connections 2020-01-26T15:35:06.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.816+0000 7f130f4ae700 1 -- 172.21.15.170:0/830682032 wait complete. 2020-01-26T15:35:06.833 INFO:teuthology.run_tasks:Running task ceph.healthy... 2020-01-26T15:35:06.848 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-26T15:35:06.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-26T15:35:06.848 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-26T15:35:06.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 Processor -- start 2020-01-26T15:35:06.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 -- start start 2020-01-26T15:35:06.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff0e805edd0 0x7ff0e805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:06.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff0e8149040 0x7ff0e814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:06.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e8098000 con 0x7ff0e80a6870 2020-01-26T15:35:06.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e805e050 con 0x7ff0e8149040 2020-01-26T15:35:06.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80a6ca0 con 0x7ff0e805edd0 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ed0c4700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff0e8149040 0x7ff0e814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e759e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff0e805edd0 0x7ff0e805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ed0c4700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff0e8149040 0x7ff0e814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e6d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff0e80a6870 0x7ff0e807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42094/0 (socket says 172.21.15.170:42094) 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e6d9d700 1 -- 172.21.15.170:0/3580987321 learned_addr learned my addr 172.21.15.170:0/3580987321 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e759e700 1 --2- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6791/0 conn(0x7ff0e805edd0 0x7ff0e805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:06.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792786532 0 0) 0x7ff0e8098000 con 0x7ff0e80a6870 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d0003230 con 0x7ff0e80a6870 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2190961896 0 0) 0x7ff0d0003230 con 0x7ff0e80a6870 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6791/0 conn(0x7ff0e805edd0 msgr2=0x7ff0e805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 --2- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6791/0 conn(0x7ff0e805edd0 0x7ff0e805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8149040 msgr2=0x7ff0e814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 --2- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8149040 0x7ff0e814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e814c9e0 con 0x7ff0e80a6870 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff0d80016e0 con 0x7ff0e80a6870 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff0d8001b10 con 0x7ff0e80a6870 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0e659c700 1 -- 172.21.15.170:0/3580987321 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff0d8004730 con 0x7ff0e80a6870 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.964+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3580987321 >> v1:172.21.15.170:6791/0 conn(0x7ff0e80a6870 legacy=0x7ff0e807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3580987321 shutdown_connections 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 --2- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8149040 0x7ff0e814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 --2- 172.21.15.170:0/3580987321 >> v2:172.21.15.170:6791/0 conn(0x7ff0e805edd0 0x7ff0e805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:06.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3580987321 >> 172.21.15.170:0/3580987321 conn(0x7ff0e8098e70 msgr2=0x7ff0e80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:06.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3580987321 shutdown_connections 2020-01-26T15:35:06.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3580987321 wait complete. 2020-01-26T15:35:06.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 Processor -- start 2020-01-26T15:35:06.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- start start 2020-01-26T15:35:06.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff0e8139a80 0x7ff0e813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:06.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e809e4f0 con 0x7ff0e80a4440 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80247b0 con 0x7ff0e80a2540 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80a4c90 con 0x7ff0e8139a80 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0e759e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff0e80a2540 0x7ff0e807cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42100/0 (socket says 172.21.15.170:42100) 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0e759e700 1 -- 172.21.15.170:0/3143678505 learned_addr learned my addr 172.21.15.170:0/3143678505 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ed0c4700 -1 --2- 172.21.15.170:0/3143678505 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8139a80 0x7ff0e813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ed0c4700 1 --2- 172.21.15.170:0/3143678505 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8139a80 0x7ff0e813bec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:06.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059101595 0 0) 0x7ff0e80247b0 con 0x7ff0e80a2540 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c8003230 con 0x7ff0e80a2540 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486876045 0 0) 0x7ff0e809e4f0 con 0x7ff0e80a4440 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e80247b0 con 0x7ff0e80a4440 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3897555130 0 0) 0x7ff0c8003230 con 0x7ff0e80a2540 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0e809e4f0 con 0x7ff0e80a2540 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 74891004 0 0) 0x7ff0e80247b0 con 0x7ff0e80a4440 2020-01-26T15:35:06.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0c8003230 con 0x7ff0e80a4440 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff0dc002740 con 0x7ff0e80a2540 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff0d8001cb0 con 0x7ff0e80a4440 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3562218558 0 0) 0x7ff0e809e4f0 con 0x7ff0e80a2540 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8139a80 msgr2=0x7ff0e813bec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 --2- 172.21.15.170:0/3143678505 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8139a80 0x7ff0e813bec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 >> v1:172.21.15.170:6790/0 conn(0x7ff0e80a4440 legacy=0x7ff0e8138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:06.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e805c110 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e809dfc0 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e80a4870 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff0dc000e90 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff0dc001270 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.968+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7ff0dc001aa0 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.972+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7ff0dc0078c0 con 0x7ff0e80a2540 2020-01-26T15:35:06.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.972+0000 7ff0e6d9d700 1 -- 172.21.15.170:0/3143678505 >> v1:172.21.15.170:6800/11008 conn(0x7ff0c8005ed0 legacy=0x7ff0c8008310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:06.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.976+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c0003360 con 0x7ff0e80a2540 2020-01-26T15:35:06.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:06.976+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7ff0dc001520 con 0x7ff0e80a2540 2020-01-26T15:35:07.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.072+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff0c00037e0 con 0x7ff0e80a2540 2020-01-26T15:35:07.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.072+0000 7ff0cffff700 1 -- 172.21.15.170:0/3143678505 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+2958 (unknown 481731318 0 2374674055) 0x7ff0dc001800 con 0x7ff0e80a2540 2020-01-26T15:35:07.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 >> v1:172.21.15.170:6800/11008 conn(0x7ff0c8005ed0 legacy=0x7ff0c8008310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.087 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 >> v1:172.21.15.170:6791/0 conn(0x7ff0e80a2540 legacy=0x7ff0e807cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 shutdown_connections 2020-01-26T15:35:07.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 --2- 172.21.15.170:0/3143678505 >> v2:172.21.15.170:6790/0 conn(0x7ff0e8139a80 0x7ff0e813bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 >> 172.21.15.170:0/3143678505 conn(0x7ff0e8098e10 msgr2=0x7ff0e807f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 shutdown_connections 2020-01-26T15:35:07.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.076+0000 7ff0ec8c3700 1 -- 172.21.15.170:0/3143678505 wait complete. 2020-01-26T15:35:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:07.093 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6800","nonce":11008}]},"active_addr":"172.21.15.170:6800/11008","active_change":"0.000000","active_mgr_features":0,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":0,"available_modules":[{"name":"balancer","can_run":true,"error_string":"","module_options":{}},{"name":"crash","can_run":true,"error_string":"","module_options":{}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{}},{"name":"hello","can_run":true,"error_string":"","module_options":{}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{}},{"name":"smart","can_run":true,"error_string":"","module_options":{}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{}}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"balancer","can_run":true,"error_string":"","module_options":{}},{"name":"crash","can_run":true,"error_string":"","module_options":{}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{}},{"name":"hello","can_run":true,"error_string":"","module_options":{}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{}},{"name":"smart","can_run":true,"error_string":"","module_options":{}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2020-01-26T15:35:07.094 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-26T15:35:07.094 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:35:07.094 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:07.202 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 Processor -- start 2020-01-26T15:35:07.202 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- start start 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa4480a5750 0x7fa4480a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa4480a4b50 0x7fa44805ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480a5b80 con 0x7fa44805efa0 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480a43f0 con 0x7fa4480a4b50 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480a4f80 con 0x7fa4480a5750 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44659c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa4480a4b50 0x7fa44805ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.203 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44759e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa44805efa0 0x7fa44814ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50110/0 (socket says 172.21.15.170:50110) 2020-01-26T15:35:07.204 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44759e700 1 -- 172.21.15.170:0/625647576 learned_addr learned my addr 172.21.15.170:0/625647576 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.204 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44659c700 1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6790/0 conn(0x7fa4480a4b50 0x7fa44805ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.204 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa446d9d700 -1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6791/0 conn(0x7fa4480a5750 0x7fa4480a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.204 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa446d9d700 1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6791/0 conn(0x7fa4480a5750 0x7fa4480a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.204 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011444430 0 0) 0x7fa4480a5b80 con 0x7fa44805efa0 2020-01-26T15:35:07.204 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003230 con 0x7fa44805efa0 2020-01-26T15:35:07.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4258744271 0 0) 0x7fa434003230 con 0x7fa44805efa0 2020-01-26T15:35:07.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6791/0 conn(0x7fa4480a5750 msgr2=0x7fa4480a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6791/0 conn(0x7fa4480a5750 0x7fa4480a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6790/0 conn(0x7fa4480a4b50 msgr2=0x7fa44805ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6790/0 conn(0x7fa4480a4b50 0x7fa44805ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448080440 con 0x7fa44805efa0 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4300016e0 con 0x7fa44805efa0 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa430001b10 con 0x7fa44805efa0 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa445d9b700 1 -- 172.21.15.170:0/625647576 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa430004730 con 0x7fa44805efa0 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- 172.21.15.170:0/625647576 >> v1:172.21.15.170:6789/0 conn(0x7fa44805efa0 legacy=0x7fa44814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- 172.21.15.170:0/625647576 shutdown_connections 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6791/0 conn(0x7fa4480a5750 0x7fa4480a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 --2- 172.21.15.170:0/625647576 >> v2:172.21.15.170:6790/0 conn(0x7fa4480a4b50 0x7fa44805ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- 172.21.15.170:0/625647576 >> 172.21.15.170:0/625647576 conn(0x7fa44805e050 msgr2=0x7fa448098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- 172.21.15.170:0/625647576 shutdown_connections 2020-01-26T15:35:07.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.196+0000 7fa44cfaf700 1 -- 172.21.15.170:0/625647576 wait complete. 2020-01-26T15:35:07.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 Processor -- start 2020-01-26T15:35:07.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- start start 2020-01-26T15:35:07.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa448120440 0x7fa44811e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480a2870 con 0x7fa448121360 2020-01-26T15:35:07.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44813a850 con 0x7fa44807ce30 2020-01-26T15:35:07.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480a2aa0 con 0x7fa448120440 2020-01-26T15:35:07.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44659c700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa448121360 0x7fa44811f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50112/0 (socket says 172.21.15.170:50112) 2020-01-26T15:35:07.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44659c700 1 -- 172.21.15.170:0/1477400709 learned_addr learned my addr 172.21.15.170:0/1477400709 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44759e700 -1 --2- 172.21.15.170:0/1477400709 >> v2:172.21.15.170:6790/0 conn(0x7fa448120440 0x7fa44811e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44759e700 1 --2- 172.21.15.170:0/1477400709 >> v2:172.21.15.170:6790/0 conn(0x7fa448120440 0x7fa44811e4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228033756 0 0) 0x7fa44813a850 con 0x7fa44807ce30 2020-01-26T15:35:07.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa42c003230 con 0x7fa44807ce30 2020-01-26T15:35:07.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030856216 0 0) 0x7fa4480a2870 con 0x7fa448121360 2020-01-26T15:35:07.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa44813a850 con 0x7fa448121360 2020-01-26T15:35:07.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 336319415 0 0) 0x7fa42c003230 con 0x7fa44807ce30 2020-01-26T15:35:07.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa4480a2870 con 0x7fa44807ce30 2020-01-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4400029f0 con 0x7fa44807ce30 2020-01-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1809611472 0 0) 0x7fa44813a850 con 0x7fa448121360 2020-01-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa42c003230 con 0x7fa448121360 2020-01-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4380026b0 con 0x7fa448121360 2020-01-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1711249311 0 0) 0x7fa4480a2870 con 0x7fa44807ce30 2020-01-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 >> v2:172.21.15.170:6790/0 conn(0x7fa448120440 msgr2=0x7fa44811e4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 --2- 172.21.15.170:0/1477400709 >> v2:172.21.15.170:6790/0 conn(0x7fa448120440 0x7fa44811e4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 >> v1:172.21.15.170:6789/0 conn(0x7fa448121360 legacy=0x7fa44811f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44813ba90 con 0x7fa44807ce30 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa448139840 con 0x7fa44807ce30 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa448139d10 con 0x7fa44807ce30 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa440001210 con 0x7fa44807ce30 2020-01-26T15:35:07.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa440001600 con 0x7fa44807ce30 2020-01-26T15:35:07.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7fa440001eb0 con 0x7fa44807ce30 2020-01-26T15:35:07.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7fa440007bd0 con 0x7fa44807ce30 2020-01-26T15:35:07.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44659c700 1 -- 172.21.15.170:0/1477400709 >> v1:172.21.15.170:6800/11008 conn(0x7fa42c00a2e0 legacy=0x7fa42c00c720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:07.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.200+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa448120170 con 0x7fa44807ce30 2020-01-26T15:35:07.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.204+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7fa440001930 con 0x7fa44807ce30 2020-01-26T15:35:07.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa448056600 con 0x7fa44807ce30 2020-01-26T15:35:07.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa43f7fe700 1 -- 172.21.15.170:0/1477400709 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8886 (unknown 3225238715 0 121565037) 0x7fa440001c10 con 0x7fa44807ce30 2020-01-26T15:35:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:07.283 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:32:25.428987+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":11354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":11354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":11354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":11354}]},"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":11357}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":11357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":11357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":11357}]},"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":11355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":11355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":11355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":11355}]},"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":11358}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":11358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":11358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":11358}]},"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:07.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 >> v1:172.21.15.170:6800/11008 conn(0x7fa42c00a2e0 legacy=0x7fa42c00c720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 >> v1:172.21.15.170:6791/0 conn(0x7fa44807ce30 legacy=0x7fa44811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 shutdown_connections 2020-01-26T15:35:07.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 --2- 172.21.15.170:0/1477400709 >> v2:172.21.15.170:6790/0 conn(0x7fa448120440 0x7fa44811e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 >> 172.21.15.170:0/1477400709 conn(0x7fa4480954c0 msgr2=0x7fa44807e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 shutdown_connections 2020-01-26T15:35:07.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.280+0000 7fa44cfaf700 1 -- 172.21.15.170:0/1477400709 wait complete. 2020-01-26T15:35:07.294 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:35:07.295 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:07.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.392+0000 7f4784dd7700 1 Processor -- start 2020-01-26T15:35:07.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.392+0000 7f4784dd7700 1 -- start start 2020-01-26T15:35:07.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f47800a4af0 0x7f478014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800a43f0 con 0x7f4780080440 2020-01-26T15:35:07.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800a4f20 con 0x7f47800a32d0 2020-01-26T15:35:07.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f47800a0b50 con 0x7f47800a4af0 2020-01-26T15:35:07.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477e59c700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f47800a32d0 0x7f478005f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42124/0 (socket says 172.21.15.170:42124) 2020-01-26T15:35:07.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477e59c700 1 -- 172.21.15.170:0/1393938039 learned_addr learned my addr 172.21.15.170:0/1393938039 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477f59e700 -1 --2- 172.21.15.170:0/1393938039 >> v2:172.21.15.170:6791/0 conn(0x7f47800a4af0 0x7f478014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477f59e700 1 --2- 172.21.15.170:0/1393938039 >> v2:172.21.15.170:6791/0 conn(0x7f47800a4af0 0x7f478014cc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001519849 0 0) 0x7f47740010d0 con 0x7f47800a32d0 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768003230 con 0x7f47800a32d0 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420361626 0 0) 0x7f47800a43f0 con 0x7f4780080440 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47740010d0 con 0x7f4780080440 2020-01-26T15:35:07.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2394361443 0 0) 0x7f47740010d0 con 0x7f4780080440 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 >> v2:172.21.15.170:6791/0 conn(0x7f47800a4af0 msgr2=0x7f478014cc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 --2- 172.21.15.170:0/1393938039 >> v2:172.21.15.170:6791/0 conn(0x7f47800a4af0 0x7f478014cc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 >> v1:172.21.15.170:6791/0 conn(0x7f47800a32d0 legacy=0x7f478005f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478005b180 con 0x7f4780080440 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f47700016c0 con 0x7f4780080440 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f47700019b0 con 0x7f4780080440 2020-01-26T15:35:07.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f477dd9b700 1 -- 172.21.15.170:0/1393938039 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f4770001e10 con 0x7f4780080440 2020-01-26T15:35:07.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- 172.21.15.170:0/1393938039 >> v1:172.21.15.170:6789/0 conn(0x7f4780080440 legacy=0x7f478005eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- 172.21.15.170:0/1393938039 shutdown_connections 2020-01-26T15:35:07.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 --2- 172.21.15.170:0/1393938039 >> v2:172.21.15.170:6791/0 conn(0x7f47800a4af0 0x7f478014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- 172.21.15.170:0/1393938039 >> 172.21.15.170:0/1393938039 conn(0x7f4780098160 msgr2=0x7f478005e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- 172.21.15.170:0/1393938039 shutdown_connections 2020-01-26T15:35:07.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- 172.21.15.170:0/1393938039 wait complete. 2020-01-26T15:35:07.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 Processor -- start 2020-01-26T15:35:07.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.396+0000 7f4784dd7700 1 -- start start 2020-01-26T15:35:07.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4780061310 0x7f4780062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4780060220 con 0x7f47800630c0 2020-01-26T15:35:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4780066190 con 0x7f47800634f0 2020-01-26T15:35:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4780121800 con 0x7f4780061310 2020-01-26T15:35:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f477f59e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f47800634f0 0x7f47800969b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42130/0 (socket says 172.21.15.170:42130) 2020-01-26T15:35:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f477ed9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4780061310 0x7f4780062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f477f59e700 1 -- 172.21.15.170:0/2696463379 learned_addr learned my addr 172.21.15.170:0/2696463379 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f477ed9d700 1 --2- 172.21.15.170:0/2696463379 >> v2:172.21.15.170:6790/0 conn(0x7f4780061310 0x7f4780062b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746997020 0 0) 0x7f4780060220 con 0x7f47800630c0 2020-01-26T15:35:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4764003230 con 0x7f47800630c0 2020-01-26T15:35:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81929505 0 0) 0x7f4780066190 con 0x7f47800634f0 2020-01-26T15:35:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4780060220 con 0x7f47800634f0 2020-01-26T15:35:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2928670854 0 0) 0x7f4764003230 con 0x7f47800630c0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4780066190 con 0x7f47800630c0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f4774001850 con 0x7f47800630c0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1861312445 0 0) 0x7f4780060220 con 0x7f47800634f0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4764003230 con 0x7f47800634f0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f4778002a00 con 0x7f47800634f0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3793110417 0 0) 0x7f4780066190 con 0x7f47800630c0 2020-01-26T15:35:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 >> v2:172.21.15.170:6790/0 conn(0x7f4780061310 msgr2=0x7f4780062b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 --2- 172.21.15.170:0/2696463379 >> v2:172.21.15.170:6790/0 conn(0x7f4780061310 0x7f4780062b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 >> v1:172.21.15.170:6791/0 conn(0x7f47800634f0 legacy=0x7f47800969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780120fe0 con 0x7f47800630c0 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4780139b80 con 0x7f47800630c0 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f478013a050 con 0x7f47800630c0 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f47740044f0 con 0x7f47800630c0 2020-01-26T15:35:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f47740048e0 con 0x7f47800630c0 2020-01-26T15:35:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7f4774005190 con 0x7f47800630c0 2020-01-26T15:35:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7f47800a4f20 con 0x7f47800630c0 2020-01-26T15:35:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f477ed9d700 1 -- 172.21.15.170:0/2696463379 >> v1:172.21.15.170:6800/11008 conn(0x7f4764005e40 legacy=0x7f4764008280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.400+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758003360 con 0x7f47800630c0 2020-01-26T15:35:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.404+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f4774004b60 con 0x7f47800630c0 2020-01-26T15:35:07.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.476+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47580037e0 con 0x7f47800630c0 2020-01-26T15:35:07.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.476+0000 7f476f7fe700 1 -- 172.21.15.170:0/2696463379 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8886 (unknown 3225238715 0 121565037) 0x7f4774004f40 con 0x7f47800630c0 2020-01-26T15:35:07.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 >> v1:172.21.15.170:6800/11008 conn(0x7f4764005e40 legacy=0x7f4764008280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 >> v1:172.21.15.170:6789/0 conn(0x7f47800630c0 legacy=0x7f47800961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 shutdown_connections 2020-01-26T15:35:07.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 --2- 172.21.15.170:0/2696463379 >> v2:172.21.15.170:6790/0 conn(0x7f4780061310 0x7f4780062b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 >> 172.21.15.170:0/2696463379 conn(0x7f4780066490 msgr2=0x7f47800a17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 shutdown_connections 2020-01-26T15:35:07.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.480+0000 7f4784dd7700 1 -- 172.21.15.170:0/2696463379 wait complete. 2020-01-26T15:35:07.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:07.486 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:32:25.428987+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":11354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":11354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":11354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":11354}]},"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":11357}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":11357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":11357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":11357}]},"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":11355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":11355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":11355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":11355}]},"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":11358}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":11358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":11358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":11358}]},"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:07.502 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-26T15:35:07.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcef580700 1 Processor -- start 2020-01-26T15:35:07.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcef580700 1 -- start start 2020-01-26T15:35:07.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcef580700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7efce805e5f0 0x7efce80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcef580700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce80a6dc0 con 0x7efce805edd0 2020-01-26T15:35:07.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcef580700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce805ea20 con 0x7efce8149040 2020-01-26T15:35:07.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcef580700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7efce8098000 con 0x7efce805e5f0 2020-01-26T15:35:07.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efceed7f700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7efce805edd0 0x7efce807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50134/0 (socket says 172.21.15.170:50134) 2020-01-26T15:35:07.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efceed7f700 1 -- 172.21.15.170:0/3149023012 learned_addr learned my addr 172.21.15.170:0/3149023012 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcf07e2700 1 --1- 172.21.15.170:0/3149023012 >> v1:172.21.15.170:6791/0 conn(0x7efce8149040 0x7efce814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42140/0 (socket says 172.21.15.170:42140) 2020-01-26T15:35:07.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcee57e700 -1 --2- 172.21.15.170:0/3149023012 >> v2:172.21.15.170:6791/0 conn(0x7efce805e5f0 0x7efce80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcee57e700 1 --2- 172.21.15.170:0/3149023012 >> v2:172.21.15.170:6791/0 conn(0x7efce805e5f0 0x7efce80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545096206 0 0) 0x7efce80a6dc0 con 0x7efce805edd0 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd4003230 con 0x7efce805edd0 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071546852 0 0) 0x7efce805ea20 con 0x7efce8149040 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce80a6dc0 con 0x7efce8149040 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1753283118 0 0) 0x7efcd4003230 con 0x7efce805edd0 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 >> v2:172.21.15.170:6791/0 conn(0x7efce805e5f0 msgr2=0x7efce80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 --2- 172.21.15.170:0/3149023012 >> v2:172.21.15.170:6791/0 conn(0x7efce805e5f0 0x7efce80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 >> v1:172.21.15.170:6791/0 conn(0x7efce8149040 legacy=0x7efce814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce805e050 con 0x7efce805edd0 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.608+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efce40016e0 con 0x7efce805edd0 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7efce4001a50 con 0x7efce805edd0 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcedd7d700 1 -- 172.21.15.170:0/3149023012 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efce40045b0 con 0x7efce805edd0 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- 172.21.15.170:0/3149023012 >> v1:172.21.15.170:6789/0 conn(0x7efce805edd0 legacy=0x7efce807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- 172.21.15.170:0/3149023012 shutdown_connections 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 --2- 172.21.15.170:0/3149023012 >> v2:172.21.15.170:6791/0 conn(0x7efce805e5f0 0x7efce80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- 172.21.15.170:0/3149023012 >> 172.21.15.170:0/3149023012 conn(0x7efce8098e70 msgr2=0x7efce80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- 172.21.15.170:0/3149023012 shutdown_connections 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- 172.21.15.170:0/3149023012 wait complete. 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 Processor -- start 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- start start 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7efce8079de0 0x7efce807a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7efce81366a0 0x7efce8138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce807a760 con 0x7efce807d0b0 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7efce8122200 con 0x7efce8079de0 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcef580700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7efce811eb50 con 0x7efce81366a0 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efceed7f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7efce807d0b0 0x7efce811e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47016/0 (socket says 172.21.15.170:47016) 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efceed7f700 1 -- 172.21.15.170:0/151662478 learned_addr learned my addr 172.21.15.170:0/151662478 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcf07e2700 -1 --2- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6791/0 conn(0x7efce81366a0 0x7efce8138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcee57e700 -1 --2- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6790/0 conn(0x7efce8079de0 0x7efce807a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcf07e2700 1 --2- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6791/0 conn(0x7efce81366a0 0x7efce8138ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcee57e700 1 --2- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6790/0 conn(0x7efce8079de0 0x7efce807a210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787888229 0 0) 0x7efce807a760 con 0x7efce807d0b0 2020-01-26T15:35:07.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.616+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd0003230 con 0x7efce807d0b0 2020-01-26T15:35:07.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 325857475 0 0) 0x7efcd0003230 con 0x7efce807d0b0 2020-01-26T15:35:07.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efce807a760 con 0x7efce807d0b0 2020-01-26T15:35:07.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efce40015a0 con 0x7efce807d0b0 2020-01-26T15:35:07.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1574561836 0 0) 0x7efce807a760 con 0x7efce807d0b0 2020-01-26T15:35:07.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6791/0 conn(0x7efce81366a0 msgr2=0x7efce8138ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 --2- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6791/0 conn(0x7efce81366a0 0x7efce8138ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6790/0 conn(0x7efce8079de0 msgr2=0x7efce807a210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 --2- 172.21.15.170:0/151662478 >> v2:172.21.15.170:6790/0 conn(0x7efce8079de0 0x7efce807a210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80a3450 con 0x7efce807d0b0 2020-01-26T15:35:07.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce80a4980 con 0x7efce807d0b0 2020-01-26T15:35:07.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efce807cd30 con 0x7efce807d0b0 2020-01-26T15:35:07.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7efce4004940 con 0x7efce807d0b0 2020-01-26T15:35:07.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efce4004bb0 con 0x7efce807d0b0 2020-01-26T15:35:07.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7efce40054a0 con 0x7efce807d0b0 2020-01-26T15:35:07.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7efce4007a00 con 0x7efce807d0b0 2020-01-26T15:35:07.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcee57e700 1 -- 172.21.15.170:0/151662478 >> v1:172.21.15.170:6800/11008 conn(0x7efcd0005ed0 legacy=0x7efcd0008310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:07.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6801/11354 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcc4005480 con 0x7efcc40015e0 2020-01-26T15:35:07.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.620+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== osd.0 v1:172.21.15.170:6801/11354 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7efcc4005480 con 0x7efcc40015e0 2020-01-26T15:35:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 --> v1:172.21.15.170:6801/11354 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcc4006df0 con 0x7efcc40015e0 2020-01-26T15:35:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcdf7fe700 1 -- 172.21.15.170:0/151662478 <== osd.0 v1:172.21.15.170:6801/11354 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7efcc4006df0 con 0x7efcc40015e0 2020-01-26T15:35:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 >> v1:172.21.15.170:6801/11354 conn(0x7efcc40015e0 legacy=0x7efcc4003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 >> v1:172.21.15.170:6800/11008 conn(0x7efcd0005ed0 legacy=0x7efcd0008310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 >> v1:172.21.15.170:6790/0 conn(0x7efce807d0b0 legacy=0x7efce811e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcf07e2700 1 -- 172.21.15.170:0/151662478 reap_dead start 2020-01-26T15:35:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 shutdown_connections 2020-01-26T15:35:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 >> 172.21.15.170:0/151662478 conn(0x7efce80a3660 msgr2=0x7efce807e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 shutdown_connections 2020-01-26T15:35:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.628+0000 7efcef580700 1 -- 172.21.15.170:0/151662478 wait complete. 2020-01-26T15:35:07.642 INFO:teuthology.orchestra.run.smithi170.stdout:38654705703 2020-01-26T15:35:07.643 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-26T15:35:07.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.760+0000 7fba0481d700 1 Processor -- start 2020-01-26T15:35:07.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.760+0000 7fba0481d700 1 -- start start 2020-01-26T15:35:07.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fba0005edd0 0x7fba0005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba00098000 con 0x7fba000a6870 2020-01-26T15:35:07.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0005e050 con 0x7fba00149040 2020-01-26T15:35:07.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fba000a6ca0 con 0x7fba0005edd0 2020-01-26T15:35:07.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9ff59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fba0005edd0 0x7fba0005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0501e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fba00149040 0x7fba0014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47044/0 (socket says 172.21.15.170:47044) 2020-01-26T15:35:07.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fed9d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fba000a6870 0x7fba0007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50166/0 (socket says 172.21.15.170:50166) 2020-01-26T15:35:07.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9ff59e700 1 --2- 172.21.15.170:0/839635657 >> v2:172.21.15.170:6791/0 conn(0x7fba0005edd0 0x7fba0005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0501e700 1 -- 172.21.15.170:0/839635657 learned_addr learned my addr 172.21.15.170:0/839635657 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881199693 0 0) 0x7fba00098000 con 0x7fba000a6870 2020-01-26T15:35:07.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ec003230 con 0x7fba000a6870 2020-01-26T15:35:07.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083313218 0 0) 0x7fba0005e050 con 0x7fba00149040 2020-01-26T15:35:07.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba00098000 con 0x7fba00149040 2020-01-26T15:35:07.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2994957558 0 0) 0x7fba00098000 con 0x7fba00149040 2020-01-26T15:35:07.772 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 >> v2:172.21.15.170:6791/0 conn(0x7fba0005edd0 msgr2=0x7fba0005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.773 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 --2- 172.21.15.170:0/839635657 >> v2:172.21.15.170:6791/0 conn(0x7fba0005edd0 0x7fba0005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.773 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 >> v1:172.21.15.170:6789/0 conn(0x7fba000a6870 legacy=0x7fba0007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.773 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0014ecb0 con 0x7fba00149040 2020-01-26T15:35:07.773 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb9f8001a40 con 0x7fba00149040 2020-01-26T15:35:07.773 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb9f8001d30 con 0x7fba00149040 2020-01-26T15:35:07.774 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fb9fe59c700 1 -- 172.21.15.170:0/839635657 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb9f8004930 con 0x7fba00149040 2020-01-26T15:35:07.774 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- 172.21.15.170:0/839635657 >> v1:172.21.15.170:6790/0 conn(0x7fba00149040 legacy=0x7fba0014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.774 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- 172.21.15.170:0/839635657 shutdown_connections 2020-01-26T15:35:07.774 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 --2- 172.21.15.170:0/839635657 >> v2:172.21.15.170:6791/0 conn(0x7fba0005edd0 0x7fba0005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.775 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- 172.21.15.170:0/839635657 >> 172.21.15.170:0/839635657 conn(0x7fba00098e70 msgr2=0x7fba000a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.775 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- 172.21.15.170:0/839635657 shutdown_connections 2020-01-26T15:35:07.775 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- 172.21.15.170:0/839635657 wait complete. 2020-01-26T15:35:07.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 Processor -- start 2020-01-26T15:35:07.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.764+0000 7fba0481d700 1 -- start start 2020-01-26T15:35:07.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fba000a37f0 0x7fba000a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fba00077ad0 0x7fba00077f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba00122d30 con 0x7fba00120780 2020-01-26T15:35:07.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fba0011fc80 con 0x7fba000a37f0 2020-01-26T15:35:07.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fba00121de0 con 0x7fba00077ad0 2020-01-26T15:35:07.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0501e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fba00077ad0 0x7fba00077f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9fed9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fba00120780 0x7fba00120bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47046/0 (socket says 172.21.15.170:47046) 2020-01-26T15:35:07.781 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9fed9d700 1 -- 172.21.15.170:0/2959915559 learned_addr learned my addr 172.21.15.170:0/2959915559 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0501e700 1 --2- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6791/0 conn(0x7fba00077ad0 0x7fba00077f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9ff59e700 -1 --2- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6790/0 conn(0x7fba000a37f0 0x7fba000a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9ff59e700 1 --2- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6790/0 conn(0x7fba000a37f0 0x7fba000a3c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483873522 0 0) 0x7fba00122d30 con 0x7fba00120780 2020-01-26T15:35:07.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e4003230 con 0x7fba00120780 2020-01-26T15:35:07.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2024190787 0 0) 0x7fb9e4003230 con 0x7fba00120780 2020-01-26T15:35:07.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba00122d30 con 0x7fba00120780 2020-01-26T15:35:07.783 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb9f00018a0 con 0x7fba00120780 2020-01-26T15:35:07.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3279436793 0 0) 0x7fba00122d30 con 0x7fba00120780 2020-01-26T15:35:07.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6791/0 conn(0x7fba00077ad0 msgr2=0x7fba00077f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 --2- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6791/0 conn(0x7fba00077ad0 0x7fba00077f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6790/0 conn(0x7fba000a37f0 msgr2=0x7fba000a3c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 --2- 172.21.15.170:0/2959915559 >> v2:172.21.15.170:6790/0 conn(0x7fba000a37f0 0x7fba000a3c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0011f380 con 0x7fba00120780 2020-01-26T15:35:07.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba00078450 con 0x7fba00120780 2020-01-26T15:35:07.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fba001375e0 con 0x7fba00120780 2020-01-26T15:35:07.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb9f00047a0 con 0x7fba00120780 2020-01-26T15:35:07.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb9f0004b10 con 0x7fba00120780 2020-01-26T15:35:07.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7fb9f0005340 con 0x7fba00120780 2020-01-26T15:35:07.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7fb9f0007900 con 0x7fba00120780 2020-01-26T15:35:07.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9ff59e700 1 -- 172.21.15.170:0/2959915559 >> v1:172.21.15.170:6800/11008 conn(0x7fb9e4005120 legacy=0x7fb9e4007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:07.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6809/11357 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba0007d7b0 con 0x7fba00055380 2020-01-26T15:35:07.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.768+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== osd.1 v1:172.21.15.170:6809/11357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7fba0007d7b0 con 0x7fba00055380 2020-01-26T15:35:07.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 --> v1:172.21.15.170:6809/11357 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9d8000ef0 con 0x7fba00055380 2020-01-26T15:35:07.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fb9f7fff700 1 -- 172.21.15.170:0/2959915559 <== osd.1 v1:172.21.15.170:6809/11357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7fb9d8000ef0 con 0x7fba00055380 2020-01-26T15:35:07.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 >> v1:172.21.15.170:6809/11357 conn(0x7fba00055380 legacy=0x7fba000557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 >> v1:172.21.15.170:6800/11008 conn(0x7fb9e4005120 legacy=0x7fb9e4007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 >> v1:172.21.15.170:6790/0 conn(0x7fba00120780 legacy=0x7fba00120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0501e700 1 -- 172.21.15.170:0/2959915559 reap_dead start 2020-01-26T15:35:07.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 shutdown_connections 2020-01-26T15:35:07.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 >> 172.21.15.170:0/2959915559 conn(0x7fba000a7c10 msgr2=0x7fba0007caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 shutdown_connections 2020-01-26T15:35:07.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.780+0000 7fba0481d700 1 -- 172.21.15.170:0/2959915559 wait complete. 2020-01-26T15:35:07.791 INFO:teuthology.orchestra.run.smithi170.stdout:38654705703 2020-01-26T15:35:07.796 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-26T15:35:07.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 Processor -- start 2020-01-26T15:35:07.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 -- start start 2020-01-26T15:35:07.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa4ac05e5f0 0x7fa4ac0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa4ac149040 0x7fa4ac14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0a6dc0 con 0x7fa4ac05edd0 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac05ea20 con 0x7fa4ac149040 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac098000 con 0x7fa4ac05e5f0 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b0e99700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa4ac05e5f0 0x7fa4ac0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b0e99700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa4ac05e5f0 0x7fa4ac0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b169a700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fa4ac05edd0 0x7fa4ac07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47058/0 (socket says 172.21.15.170:47058) 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b169a700 1 -- 172.21.15.170:0/1724168934 learned_addr learned my addr 172.21.15.170:0/1724168934 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b30fd700 -1 --2- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac149040 0x7fa4ac14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b30fd700 1 --2- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac149040 0x7fa4ac14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585085564 0 0) 0x7fa4ac0a6dc0 con 0x7fa4ac05edd0 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa498003230 con 0x7fa4ac05edd0 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1910062782 0 0) 0x7fa498003230 con 0x7fa4ac05edd0 2020-01-26T15:35:07.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6791/0 conn(0x7fa4ac05e5f0 msgr2=0x7fa4ac0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 --2- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6791/0 conn(0x7fa4ac05e5f0 0x7fa4ac0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac149040 msgr2=0x7fa4ac14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:07.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 --2- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac149040 0x7fa4ac14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac05e050 con 0x7fa4ac05edd0 2020-01-26T15:35:07.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4a00016e0 con 0x7fa4ac05edd0 2020-01-26T15:35:07.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa4a0001b10 con 0x7fa4ac05edd0 2020-01-26T15:35:07.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa49ffff700 1 -- 172.21.15.170:0/1724168934 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4a0004730 con 0x7fa4ac05edd0 2020-01-26T15:35:07.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1724168934 >> v1:172.21.15.170:6790/0 conn(0x7fa4ac05edd0 legacy=0x7fa4ac07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1724168934 shutdown_connections 2020-01-26T15:35:07.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 --2- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac149040 0x7fa4ac14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.896+0000 7fa4b1e9b700 1 --2- 172.21.15.170:0/1724168934 >> v2:172.21.15.170:6791/0 conn(0x7fa4ac05e5f0 0x7fa4ac0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1724168934 >> 172.21.15.170:0/1724168934 conn(0x7fa4ac098e70 msgr2=0x7fa4ac0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1724168934 shutdown_connections 2020-01-26T15:35:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1724168934 wait complete. 2020-01-26T15:35:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 Processor -- start 2020-01-26T15:35:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- start start 2020-01-26T15:35:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa4ac12d850 0x7fa4ac121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0a0e50 con 0x7fa4ac079be0 2020-01-26T15:35:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0a19c0 con 0x7fa4ac07a010 2020-01-26T15:35:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b1e9b700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac07a440 con 0x7fa4ac12d850 2020-01-26T15:35:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b0e99700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fa4ac079be0 0x7fa4ac0a0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47068/0 (socket says 172.21.15.170:47068) 2020-01-26T15:35:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b0e99700 1 -- 172.21.15.170:0/1298153278 learned_addr learned my addr 172.21.15.170:0/1298153278 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b169a700 -1 --2- 172.21.15.170:0/1298153278 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac12d850 0x7fa4ac121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:07.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa4b169a700 1 --2- 172.21.15.170:0/1298153278 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac12d850 0x7fa4ac121540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:07.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302160406 0 0) 0x7fa4ac0a0e50 con 0x7fa4ac079be0 2020-01-26T15:35:07.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa48c003230 con 0x7fa4ac079be0 2020-01-26T15:35:07.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524324420 0 0) 0x7fa4ac0a19c0 con 0x7fa4ac07a010 2020-01-26T15:35:07.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac0a0e50 con 0x7fa4ac07a010 2020-01-26T15:35:07.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2842328022 0 0) 0x7fa4ac0a0e50 con 0x7fa4ac07a010 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa4ac0a19c0 con 0x7fa4ac07a010 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4a4002950 con 0x7fa4ac07a010 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3549681627 0 0) 0x7fa48c003230 con 0x7fa4ac079be0 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa4ac0a0e50 con 0x7fa4ac079be0 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4a8002750 con 0x7fa4ac079be0 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3707981740 0 0) 0x7fa4ac0a19c0 con 0x7fa4ac07a010 2020-01-26T15:35:07.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac12d850 msgr2=0x7fa4ac121540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 --2- 172.21.15.170:0/1298153278 >> v2:172.21.15.170:6790/0 conn(0x7fa4ac12d850 0x7fa4ac121540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:07.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 >> v1:172.21.15.170:6790/0 conn(0x7fa4ac079be0 legacy=0x7fa4ac0a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac123f10 con 0x7fa4ac07a010 2020-01-26T15:35:07.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa4a4001210 con 0x7fa4ac07a010 2020-01-26T15:35:07.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.900+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fa4a4001600 con 0x7fa4ac07a010 2020-01-26T15:35:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac139a50 con 0x7fa4ac07a010 2020-01-26T15:35:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac139f20 con 0x7fa4ac07a010 2020-01-26T15:35:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7fa4a4001f00 con 0x7fa4ac07a010 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa4b169a700 1 -- 172.21.15.170:0/1298153278 >> v1:172.21.15.170:6800/11008 conn(0x7fa48c005ed0 legacy=0x7fa48c008310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7fa4a4006670 con 0x7fa4ac07a010 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6805/11355 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4ac056600 con 0x7fa4ac055380 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.904+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== osd.2 v1:172.21.15.170:6805/11355 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7fa4ac056600 con 0x7fa4ac055380 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 --> v1:172.21.15.170:6805/11355 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4ac121a90 con 0x7fa4ac055380 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa49dffb700 1 -- 172.21.15.170:0/1298153278 <== osd.2 v1:172.21.15.170:6805/11355 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7fa4ac121a90 con 0x7fa4ac055380 2020-01-26T15:35:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 >> v1:172.21.15.170:6805/11355 conn(0x7fa4ac055380 legacy=0x7fa4ac0557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 >> v1:172.21.15.170:6800/11008 conn(0x7fa48c005ed0 legacy=0x7fa48c008310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 >> v1:172.21.15.170:6791/0 conn(0x7fa4ac07a010 legacy=0x7fa4ac138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b30fd700 1 -- 172.21.15.170:0/1298153278 reap_dead start 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 shutdown_connections 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 >> 172.21.15.170:0/1298153278 conn(0x7fa4ac098e10 msgr2=0x7fa4ac097ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 shutdown_connections 2020-01-26T15:35:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:07.908+0000 7fa4b1e9b700 1 -- 172.21.15.170:0/1298153278 wait complete. 2020-01-26T15:35:07.919 INFO:teuthology.orchestra.run.smithi170.stdout:38654705703 2020-01-26T15:35:07.927 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-26T15:35:08.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 Processor -- start 2020-01-26T15:35:08.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- start start 2020-01-26T15:35:08.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7e580a5750 0x7f7e580a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:08.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7e580a4b50 0x7f7e5805ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:08.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580a5b80 con 0x7f7e5805efa0 2020-01-26T15:35:08.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f7e580a43f0 con 0x7f7e580a5750 2020-01-26T15:35:08.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7e580a4f80 con 0x7f7e580a4b50 2020-01-26T15:35:08.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5d3ed700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7e580a4b50 0x7f7e5805ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:08.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5e3ef700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f7e5805efa0 0x7f7e5814ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47078/0 (socket says 172.21.15.170:47078) 2020-01-26T15:35:08.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5dbee700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7e580a5750 0x7f7e580a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:08.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5e3ef700 1 -- 172.21.15.170:0/2151903178 learned_addr learned my addr 172.21.15.170:0/2151903178 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:08.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5d3ed700 1 --2- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6791/0 conn(0x7f7e580a4b50 0x7f7e5805ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5dbee700 1 --2- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6790/0 conn(0x7f7e580a5750 0x7f7e580a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496578148 0 0) 0x7f7e580a5b80 con 0x7f7e5805efa0 2020-01-26T15:35:08.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e40003230 con 0x7f7e5805efa0 2020-01-26T15:35:08.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 871384789 0 0) 0x7f7e40003230 con 0x7f7e5805efa0 2020-01-26T15:35:08.032 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6791/0 conn(0x7f7e580a4b50 msgr2=0x7f7e5805ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 --2- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6791/0 conn(0x7f7e580a4b50 0x7f7e5805ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6790/0 conn(0x7f7e580a5750 msgr2=0x7f7e580a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 --2- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6790/0 conn(0x7f7e580a5750 0x7f7e580a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58080440 con 0x7f7e5805efa0 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7e500016e0 con 0x7f7e5805efa0 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7e50001b10 con 0x7f7e5805efa0 2020-01-26T15:35:08.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- 172.21.15.170:0/2151903178 >> v1:172.21.15.170:6790/0 conn(0x7f7e5805efa0 legacy=0x7f7e5814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5cbec700 1 -- 172.21.15.170:0/2151903178 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7e50004730 con 0x7f7e5805efa0 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- 172.21.15.170:0/2151903178 shutdown_connections 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 --2- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6790/0 conn(0x7f7e580a5750 0x7f7e580a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 --2- 172.21.15.170:0/2151903178 >> v2:172.21.15.170:6791/0 conn(0x7f7e580a4b50 0x7f7e5805ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- 172.21.15.170:0/2151903178 >> 172.21.15.170:0/2151903178 conn(0x7f7e5805e050 msgr2=0x7f7e58098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- 172.21.15.170:0/2151903178 shutdown_connections 2020-01-26T15:35:08.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.024+0000 7f7e5f651700 1 -- 172.21.15.170:0/2151903178 wait complete. 2020-01-26T15:35:08.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 Processor -- start 2020-01-26T15:35:08.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- start start 2020-01-26T15:35:08.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7e5811cbb0 0x7f7e5811d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7e581363e0 0x7f7e58138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580a5630 con 0x7f7e5811de20 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f7e580a0de0 con 0x7f7e5811cbb0 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5807d4e0 con 0x7f7e581363e0 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5dbee700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7e5811cbb0 0x7f7e5811d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5e3ef700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7e581363e0 0x7f7e58138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:08.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5d3ed700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f7e5811de20 0x7f7e58131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42206/0 (socket says 172.21.15.170:42206) 2020-01-26T15:35:08.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5d3ed700 1 -- 172.21.15.170:0/3460828826 learned_addr learned my addr 172.21.15.170:0/3460828826 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:08.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5dbee700 1 --2- 172.21.15.170:0/3460828826 >> v2:172.21.15.170:6790/0 conn(0x7f7e5811cbb0 0x7f7e5811d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5e3ef700 1 --2- 172.21.15.170:0/3460828826 >> v2:172.21.15.170:6791/0 conn(0x7f7e581363e0 0x7f7e58138820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923016536 0 0) 0x7f7e580a5630 con 0x7f7e5811de20 2020-01-26T15:35:08.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e38003230 con 0x7f7e5811de20 2020-01-26T15:35:08.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2766570286 0 0) 0x7f7e38003230 con 0x7f7e5811de20 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7e580a5630 con 0x7f7e5811de20 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7e4c0026f0 con 0x7f7e5811de20 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1295625066 0 0) 0x7f7e580a5630 con 0x7f7e5811de20 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 >> v2:172.21.15.170:6791/0 conn(0x7f7e581363e0 msgr2=0x7f7e58138820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 --2- 172.21.15.170:0/3460828826 >> v2:172.21.15.170:6791/0 conn(0x7f7e581363e0 0x7f7e58138820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 >> v2:172.21.15.170:6790/0 conn(0x7f7e5811cbb0 msgr2=0x7f7e5811d8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:08.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 --2- 172.21.15.170:0/3460828826 >> v2:172.21.15.170:6790/0 conn(0x7f7e5811cbb0 0x7f7e5811d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58130fa0 con 0x7f7e5811de20 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e580a2af0 con 0x7f7e5811de20 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e58131c70 con 0x7f7e5811de20 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7e4c000f10 con 0x7f7e5811de20 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7e4c0012f0 con 0x7f7e5811de20 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7f7e4c005780 con 0x7f7e5811de20 2020-01-26T15:35:08.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7f7e4c007a60 con 0x7f7e5811de20 2020-01-26T15:35:08.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5dbee700 1 -- 172.21.15.170:0/3460828826 >> v1:172.21.15.170:6800/11008 conn(0x7f7e38005170 legacy=0x7f7e38007f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:08.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6813/11358 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e34005480 con 0x7f7e340015e0 2020-01-26T15:35:08.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.028+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== osd.3 v1:172.21.15.170:6813/11358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7f7e34005480 con 0x7f7e340015e0 2020-01-26T15:35:08.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 --> v1:172.21.15.170:6813/11358 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e34006df0 con 0x7f7e340015e0 2020-01-26T15:35:08.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e567fc700 1 -- 172.21.15.170:0/3460828826 <== osd.3 v1:172.21.15.170:6813/11358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7f7e34006df0 con 0x7f7e340015e0 2020-01-26T15:35:08.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 >> v1:172.21.15.170:6813/11358 conn(0x7f7e340015e0 legacy=0x7f7e34003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:08.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 >> v1:172.21.15.170:6800/11008 conn(0x7f7e38005170 legacy=0x7f7e38007f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:08.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 >> v1:172.21.15.170:6791/0 conn(0x7f7e5811de20 legacy=0x7f7e58131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:08.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5e3ef700 1 -- 172.21.15.170:0/3460828826 reap_dead start 2020-01-26T15:35:08.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 shutdown_connections 2020-01-26T15:35:08.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 >> 172.21.15.170:0/3460828826 conn(0x7f7e580979c0 msgr2=0x7f7e5805f240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:08.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 shutdown_connections 2020-01-26T15:35:08.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.036+0000 7f7e5f651700 1 -- 172.21.15.170:0/3460828826 wait complete. 2020-01-26T15:35:08.046 INFO:teuthology.orchestra.run.smithi170.stdout:38654705703 2020-01-26T15:35:08.049 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:08.150 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 Processor -- start 2020-01-26T15:35:08.150 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- start start 2020-01-26T15:35:08.150 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fb5dc146c30 0x7fb5dc149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:08.150 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0a5b80 con 0x7fb5dc1495c0 2020-01-26T15:35:08.150 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc080440 con 0x7fb5dc0a5750 2020-01-26T15:35:08.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0a43f0 con 0x7fb5dc146c30 2020-01-26T15:35:08.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e1f70700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fb5dc146c30 0x7fb5dc149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:08.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e2771700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fb5dc0a5750 0x7fb5dc0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47090/0 (socket says 172.21.15.170:47090) 2020-01-26T15:35:08.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e2771700 1 -- 172.21.15.170:0/155566148 learned_addr learned my addr 172.21.15.170:0/155566148 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:08.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e1f70700 1 --2- 172.21.15.170:0/155566148 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc146c30 0x7fb5dc149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779572004 0 0) 0x7fb5dc080440 con 0x7fb5dc0a5750 2020-01-26T15:35:08.152 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c4003230 con 0x7fb5dc0a5750 2020-01-26T15:35:08.162 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148441258 0 0) 0x7fb5dc0a5b80 con 0x7fb5dc1495c0 2020-01-26T15:35:08.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5dc080440 con 0x7fb5dc1495c0 2020-01-26T15:35:08.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 225648819 0 0) 0x7fb5c4003230 con 0x7fb5dc0a5750 2020-01-26T15:35:08.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc146c30 msgr2=0x7fb5dc149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:08.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 --2- 172.21.15.170:0/155566148 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc146c30 0x7fb5dc149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:08.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 >> v1:172.21.15.170:6789/0 conn(0x7fb5dc1495c0 legacy=0x7fb5dc14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0a4e00 con 0x7fb5dc0a5750 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb5d40016e0 con 0x7fb5dc0a5750 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb5d4001a50 con 0x7fb5dc0a5750 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e176f700 1 -- 172.21.15.170:0/155566148 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb5d40045b0 con 0x7fb5dc0a5750 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- 172.21.15.170:0/155566148 >> v1:172.21.15.170:6790/0 conn(0x7fb5dc0a5750 legacy=0x7fb5dc0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- 172.21.15.170:0/155566148 shutdown_connections 2020-01-26T15:35:08.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 --2- 172.21.15.170:0/155566148 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc146c30 0x7fb5dc149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:08.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- 172.21.15.170:0/155566148 >> 172.21.15.170:0/155566148 conn(0x7fb5dc05e050 msgr2=0x7fb5dc098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:08.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- 172.21.15.170:0/155566148 shutdown_connections 2020-01-26T15:35:08.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.144+0000 7fb5e41d4700 1 -- 172.21.15.170:0/155566148 wait complete. 2020-01-26T15:35:08.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 Processor -- start 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 -- start start 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fb5dc096970 0x7fb5dc136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fb5dc07a6c0 0x7fb5dc138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0a1220 con 0x7fb5dc096540 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc11fab0 con 0x7fb5dc07a6c0 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc095f40 con 0x7fb5dc096970 2020-01-26T15:35:08.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e1f70700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fb5dc096970 0x7fb5dc136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:08.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e2f72700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fb5dc07a6c0 0x7fb5dc138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:08.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e1f70700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fb5dc096970 0x7fb5dc136610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e2f72700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fb5dc07a6c0 0x7fb5dc138b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:08.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e2771700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fb5dc096540 0x7fb5dc079ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47096/0 (socket says 172.21.15.170:47096) 2020-01-26T15:35:08.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e2771700 1 -- 172.21.15.170:0/1774094230 learned_addr learned my addr 172.21.15.170:0/1774094230 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:08.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371377507 0 0) 0x7fb5dc0a1220 con 0x7fb5dc096540 2020-01-26T15:35:08.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5bc003230 con 0x7fb5dc096540 2020-01-26T15:35:08.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1651258013 0 0) 0x7fb5bc003230 con 0x7fb5dc096540 2020-01-26T15:35:08.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5dc0a1220 con 0x7fb5dc096540 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb5d4001660 con 0x7fb5dc096540 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3644537399 0 0) 0x7fb5dc0a1220 con 0x7fb5dc096540 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 >> v2:172.21.15.170:6791/0 conn(0x7fb5dc096970 msgr2=0x7fb5dc136610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 --2- 172.21.15.170:0/1774094230 >> v2:172.21.15.170:6791/0 conn(0x7fb5dc096970 0x7fb5dc136610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc07a6c0 msgr2=0x7fb5dc138b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 --2- 172.21.15.170:0/1774094230 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc07a6c0 0x7fb5dc138b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:08.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc095760 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc0602c0 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc066160 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb5d40049d0 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fb5d4004db0 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7fb5d40055e0 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7fb5d4007ab0 con 0x7fb5dc096540 2020-01-26T15:35:08.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.148+0000 7fb5e1f70700 1 -- 172.21.15.170:0/1774094230 >> v1:172.21.15.170:6800/11008 conn(0x7fb5bc0050d0 legacy=0x7fb5bc007ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:08.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.152+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b8003360 con 0x7fb5dc096540 2020-01-26T15:35:08.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.156+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7fb5d4004fb0 con 0x7fb5dc096540 2020-01-26T15:35:08.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.228+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5b80037e0 con 0x7fb5dc096540 2020-01-26T15:35:08.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5daffd700 1 -- 172.21.15.170:0/1774094230 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 57899951) 0x7fb5d4005270 con 0x7fb5dc096540 2020-01-26T15:35:08.234 INFO:teuthology.orchestra.run.smithi170.stdout:38654705702 2020-01-26T15:35:08.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 >> v1:172.21.15.170:6800/11008 conn(0x7fb5bc0050d0 legacy=0x7fb5bc007ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:08.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 >> v1:172.21.15.170:6790/0 conn(0x7fb5dc096540 legacy=0x7fb5dc079ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:08.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 shutdown_connections 2020-01-26T15:35:08.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 --2- 172.21.15.170:0/1774094230 >> v2:172.21.15.170:6790/0 conn(0x7fb5dc07a6c0 0x7fb5dc138b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:08.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 --2- 172.21.15.170:0/1774094230 >> v2:172.21.15.170:6791/0 conn(0x7fb5dc096970 0x7fb5dc136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:08.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 >> 172.21.15.170:0/1774094230 conn(0x7fb5dc0a3210 msgr2=0x7fb5dc0a65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:08.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 shutdown_connections 2020-01-26T15:35:08.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:08.232+0000 7fb5e41d4700 1 -- 172.21.15.170:0/1774094230 wait complete. 2020-01-26T15:35:08.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2020-01-26T15:35:09.252 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:09.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 Processor -- start 2020-01-26T15:35:09.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 -- start start 2020-01-26T15:35:09.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f658405edd0 0x7f658405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:09.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6584149040 0x7f658414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:09.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6584098000 con 0x7f65840a6870 2020-01-26T15:35:09.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f658405e050 con 0x7f6584149040 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f65840a6ca0 con 0x7f658405edd0 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f657bfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f65840a6870 0x7f658407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50232/0 (socket says 172.21.15.170:50232) 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f657bfff700 1 -- 172.21.15.170:0/3610916911 learned_addr learned my addr 172.21.15.170:0/3610916911 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f6582d9d700 -1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6791/0 conn(0x7f658405edd0 0x7f658405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f6582d9d700 1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6791/0 conn(0x7f658405edd0 0x7f658405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f6588eb9700 -1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6790/0 conn(0x7f6584149040 0x7f658414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:09.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f6588eb9700 1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6790/0 conn(0x7f6584149040 0x7f658414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:09.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563181403 0 0) 0x7f6584098000 con 0x7f65840a6870 2020-01-26T15:35:09.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6570003230 con 0x7f65840a6870 2020-01-26T15:35:09.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2295872934 0 0) 0x7f6570003230 con 0x7f65840a6870 2020-01-26T15:35:09.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6791/0 conn(0x7f658405edd0 msgr2=0x7f658405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6791/0 conn(0x7f658405edd0 0x7f658405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6790/0 conn(0x7f6584149040 msgr2=0x7f658414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6790/0 conn(0x7f6584149040 0x7f658414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658414c9e0 con 0x7f65840a6870 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f656c0016e0 con 0x7f65840a6870 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f656c001b10 con 0x7f65840a6870 2020-01-26T15:35:09.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658259c700 1 -- 172.21.15.170:0/3610916911 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f656c004730 con 0x7f65840a6870 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.356+0000 7f658359e700 1 -- 172.21.15.170:0/3610916911 >> v1:172.21.15.170:6789/0 conn(0x7f65840a6870 legacy=0x7f658407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- 172.21.15.170:0/3610916911 shutdown_connections 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6790/0 conn(0x7f6584149040 0x7f658414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 --2- 172.21.15.170:0/3610916911 >> v2:172.21.15.170:6791/0 conn(0x7f658405edd0 0x7f658405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- 172.21.15.170:0/3610916911 >> 172.21.15.170:0/3610916911 conn(0x7f6584098e70 msgr2=0x7f65840a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- 172.21.15.170:0/3610916911 shutdown_connections 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- 172.21.15.170:0/3610916911 wait complete. 2020-01-26T15:35:09.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 Processor -- start 2020-01-26T15:35:09.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- start start 2020-01-26T15:35:09.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f658412c700 0x7f658412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:09.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658412d4b0 con 0x7f658411e6d0 2020-01-26T15:35:09.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65841226d0 con 0x7f658412d080 2020-01-26T15:35:09.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f658359e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f658411eb00 con 0x7f658412c700 2020-01-26T15:35:09.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f657bfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f658412c700 0x7f658412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:09.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f6588eb9700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f658412d080 0x7f658413a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47118/0 (socket says 172.21.15.170:47118) 2020-01-26T15:35:09.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f657bfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f658412c700 0x7f658412cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:09.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f6588eb9700 1 -- 172.21.15.170:0/3005609310 learned_addr learned my addr 172.21.15.170:0/3005609310 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:09.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357757641 0 0) 0x7f658412d4b0 con 0x7f658411e6d0 2020-01-26T15:35:09.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6568003230 con 0x7f658411e6d0 2020-01-26T15:35:09.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019606410 0 0) 0x7f65841226d0 con 0x7f658412d080 2020-01-26T15:35:09.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.360+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f658412d4b0 con 0x7f658412d080 2020-01-26T15:35:09.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2627208425 0 0) 0x7f6568003230 con 0x7f658411e6d0 2020-01-26T15:35:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f65841226d0 con 0x7f658411e6d0 2020-01-26T15:35:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 11802226 0 0) 0x7f658412d4b0 con 0x7f658412d080 2020-01-26T15:35:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6568003230 con 0x7f658412d080 2020-01-26T15:35:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f65740025f0 con 0x7f658411e6d0 2020-01-26T15:35:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f657c001930 con 0x7f658412d080 2020-01-26T15:35:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3550632936 0 0) 0x7f65841226d0 con 0x7f658411e6d0 2020-01-26T15:35:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 >> v2:172.21.15.170:6790/0 conn(0x7f658412c700 msgr2=0x7f658412cb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:09.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 --2- 172.21.15.170:0/3005609310 >> v2:172.21.15.170:6790/0 conn(0x7f658412c700 0x7f658412cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:09.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 >> v1:172.21.15.170:6790/0 conn(0x7f658412d080 legacy=0x7f658413a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:09.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584122d40 con 0x7f658411e6d0 2020-01-26T15:35:09.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658411e310 con 0x7f658411e6d0 2020-01-26T15:35:09.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f658411f350 con 0x7f658411e6d0 2020-01-26T15:35:09.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f6574002d30 con 0x7f658411e6d0 2020-01-26T15:35:09.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f65740010d0 con 0x7f658411e6d0 2020-01-26T15:35:09.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7f65740019c0 con 0x7f658411e6d0 2020-01-26T15:35:09.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7f65740076e0 con 0x7f658411e6d0 2020-01-26T15:35:09.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f657bfff700 1 -- 172.21.15.170:0/3005609310 >> v1:172.21.15.170:6800/11008 conn(0x7f6568006060 legacy=0x7f65680084d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:09.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.364+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c003360 con 0x7f658411e6d0 2020-01-26T15:35:09.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.368+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f6574007a60 con 0x7f658411e6d0 2020-01-26T15:35:09.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f655c0037e0 con 0x7f658411e6d0 2020-01-26T15:35:09.454 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f657b7fe700 1 -- 172.21.15.170:0/3005609310 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 57899951) 0x7f6574001390 con 0x7f658411e6d0 2020-01-26T15:35:09.454 INFO:teuthology.orchestra.run.smithi170.stdout:38654705702 2020-01-26T15:35:09.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 >> v1:172.21.15.170:6800/11008 conn(0x7f6568006060 legacy=0x7f65680084d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:09.455 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 >> v1:172.21.15.170:6789/0 conn(0x7f658411e6d0 legacy=0x7f658411ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:09.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 shutdown_connections 2020-01-26T15:35:09.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 --2- 172.21.15.170:0/3005609310 >> v2:172.21.15.170:6790/0 conn(0x7f658412c700 0x7f658412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:09.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 >> 172.21.15.170:0/3005609310 conn(0x7f65840a5520 msgr2=0x7f658407f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:09.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 shutdown_connections 2020-01-26T15:35:09.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:09.452+0000 7f658359e700 1 -- 172.21.15.170:0/3005609310 wait complete. 2020-01-26T15:35:09.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2020-01-26T15:35:10.471 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:10.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc420f44700 1 Processor -- start 2020-01-26T15:35:10.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc420f44700 1 -- start start 2020-01-26T15:35:10.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc420f44700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fc41c0a5750 0x7fc41c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:10.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc420f44700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0a5b80 con 0x7fc41c05f250 2020-01-26T15:35:10.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc420f44700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c080440 con 0x7fc41c0a4b50 2020-01-26T15:35:10.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc420f44700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c0a43f0 con 0x7fc41c0a5750 2020-01-26T15:35:10.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc41b59e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fc41c05f250 0x7fc41c14bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47126/0 (socket says 172.21.15.170:47126) 2020-01-26T15:35:10.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc41b59e700 1 -- 172.21.15.170:0/80534998 learned_addr learned my addr 172.21.15.170:0/80534998 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:10.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.568+0000 7fc41ad9d700 -1 --2- 172.21.15.170:0/80534998 >> v2:172.21.15.170:6790/0 conn(0x7fc41c0a5750 0x7fc41c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc41ad9d700 1 --2- 172.21.15.170:0/80534998 >> v2:172.21.15.170:6790/0 conn(0x7fc41c0a5750 0x7fc41c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927330926 0 0) 0x7fc41c080440 con 0x7fc41c0a4b50 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc404003230 con 0x7fc41c0a4b50 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779629125 0 0) 0x7fc41c0a5b80 con 0x7fc41c05f250 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc41c080440 con 0x7fc41c05f250 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4163084192 0 0) 0x7fc404003230 con 0x7fc41c0a4b50 2020-01-26T15:35:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 >> v2:172.21.15.170:6790/0 conn(0x7fc41c0a5750 msgr2=0x7fc41c0a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 --2- 172.21.15.170:0/80534998 >> v2:172.21.15.170:6790/0 conn(0x7fc41c0a5750 0x7fc41c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 >> v1:172.21.15.170:6790/0 conn(0x7fc41c05f250 legacy=0x7fc41c14bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0a3210 con 0x7fc41c0a4b50 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fc4100016e0 con 0x7fc41c0a4b50 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fc410001980 con 0x7fc41c0a4b50 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc419d9b700 1 -- 172.21.15.170:0/80534998 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fc410001ec0 con 0x7fc41c0a4b50 2020-01-26T15:35:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- 172.21.15.170:0/80534998 >> v1:172.21.15.170:6791/0 conn(0x7fc41c0a4b50 legacy=0x7fc41c05ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:10.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- 172.21.15.170:0/80534998 shutdown_connections 2020-01-26T15:35:10.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 --2- 172.21.15.170:0/80534998 >> v2:172.21.15.170:6790/0 conn(0x7fc41c0a5750 0x7fc41c0a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:10.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- 172.21.15.170:0/80534998 >> 172.21.15.170:0/80534998 conn(0x7fc41c05e050 msgr2=0x7fc41c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:10.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- 172.21.15.170:0/80534998 shutdown_connections 2020-01-26T15:35:10.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- 172.21.15.170:0/80534998 wait complete. 2020-01-26T15:35:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 Processor -- start 2020-01-26T15:35:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- start start 2020-01-26T15:35:10.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc41c120d60 0x7fc41c143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:10.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c096bf0 con 0x7fc41c120650 2020-01-26T15:35:10.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c120a80 con 0x7fc41c143fb0 2020-01-26T15:35:10.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc420f44700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c096710 con 0x7fc41c120d60 2020-01-26T15:35:10.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc41b59e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fc41c143fb0 0x7fc41c075b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47132/0 (socket says 172.21.15.170:47132) 2020-01-26T15:35:10.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc41b59e700 1 -- 172.21.15.170:0/1193384871 learned_addr learned my addr 172.21.15.170:0/1193384871 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc41a59c700 -1 --2- 172.21.15.170:0/1193384871 >> v2:172.21.15.170:6791/0 conn(0x7fc41c120d60 0x7fc41c143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc41a59c700 1 --2- 172.21.15.170:0/1193384871 >> v2:172.21.15.170:6791/0 conn(0x7fc41c120d60 0x7fc41c143a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406143496 0 0) 0x7fc41c096bf0 con 0x7fc41c120650 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc400003230 con 0x7fc41c120650 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073916173 0 0) 0x7fc41c080440 con 0x7fc41c143fb0 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc41c096bf0 con 0x7fc41c143fb0 2020-01-26T15:35:10.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1390872596 0 0) 0x7fc400003230 con 0x7fc41c120650 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc41c080440 con 0x7fc41c120650 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.572+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fc40c0026c0 con 0x7fc41c120650 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2545599115 0 0) 0x7fc41c096bf0 con 0x7fc41c143fb0 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc400003230 con 0x7fc41c143fb0 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fc414001a50 con 0x7fc41c143fb0 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 521074462 0 0) 0x7fc41c080440 con 0x7fc41c120650 2020-01-26T15:35:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 >> v2:172.21.15.170:6791/0 conn(0x7fc41c120d60 msgr2=0x7fc41c143a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 --2- 172.21.15.170:0/1193384871 >> v2:172.21.15.170:6791/0 conn(0x7fc41c120d60 0x7fc41c143a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 >> v1:172.21.15.170:6790/0 conn(0x7fc41c143fb0 legacy=0x7fc41c075b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c121190 con 0x7fc41c120650 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c0658f0 con 0x7fc41c120650 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c096250 con 0x7fc41c120650 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fc40c000fa0 con 0x7fc41c120650 2020-01-26T15:35:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fc40c001350 con 0x7fc41c120650 2020-01-26T15:35:10.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 5) v1 ==== 1474+0+0 (unknown 968816104 0 0) 0x7fc40c001c40 con 0x7fc41c120650 2020-01-26T15:35:10.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c056600 con 0x7fc41c120650 2020-01-26T15:35:10.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2811+0+0 (unknown 4024184856 0 0) 0x7fc40c0077c0 con 0x7fc41c120650 2020-01-26T15:35:10.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.576+0000 7fc41a59c700 1 -- 172.21.15.170:0/1193384871 >> v1:172.21.15.170:6800/11008 conn(0x7fc4000061a0 legacy=0x7fc4000085e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.170:6800/11008 2020-01-26T15:35:10.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.580+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7fc40c007bb0 con 0x7fc41c120650 2020-01-26T15:35:10.654 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc41c05cc60 con 0x7fc41c120650 2020-01-26T15:35:10.655 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc40b7fe700 1 -- 172.21.15.170:0/1193384871 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 57899951) 0x7fc40c0016c0 con 0x7fc41c120650 2020-01-26T15:35:10.655 INFO:teuthology.orchestra.run.smithi170.stdout:38654705702 2020-01-26T15:35:10.656 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 >> v1:172.21.15.170:6800/11008 conn(0x7fc4000061a0 legacy=0x7fc4000085e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:10.656 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 >> v1:172.21.15.170:6789/0 conn(0x7fc41c120650 legacy=0x7fc41c11ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:10.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 shutdown_connections 2020-01-26T15:35:10.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 --2- 172.21.15.170:0/1193384871 >> v2:172.21.15.170:6791/0 conn(0x7fc41c120d60 0x7fc41c143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:10.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 >> 172.21.15.170:0/1193384871 conn(0x7fc41c0979c0 msgr2=0x7fc41c0a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:10.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 shutdown_connections 2020-01-26T15:35:10.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:10.652+0000 7fc420f44700 1 -- 172.21.15.170:0/1193384871 wait complete. 2020-01-26T15:35:10.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2020-01-26T15:35:10.759 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.756+0000 7f341d08b700 -1 --2- 172.21.15.170:0/720531461 >> v2:172.21.15.170:6791/0 conn(0x55feb7c12880 0x55feb7d94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:10.762 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.760+0000 7f341d08b700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55feb7c12d00 0x55feb7d94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:10.766 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.764+0000 7f3404523700 -1 librbd::api::Namespace: list: error listing namespaces: (95) Operation not supported 2020-01-26T15:35:10.772 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.768+0000 7f341e08d700 -1 --2- 172.21.15.170:0/3795618520 >> v2:172.21.15.170:6790/0 conn(0x55feb7dd7200 0x55feb7d94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:10.788 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.784+0000 7f341e08d700 -1 --2- 172.21.15.170:0/3675662826 >> v2:172.21.15.170:6791/0 conn(0x55feb7dd7200 0x55feb7d94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:10.795 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.792+0000 7f341e08d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55feb7eba000 0x55feb7d95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:10.795 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.792+0000 7f341d08b700 -1 --2- 172.21.15.170:0/2977419387 >> v2:172.21.15.170:6791/0 conn(0x55feb7eba900 0x55feb7d95600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:10.798 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.796+0000 7f33f2d00700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:35:10.798 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.796+0000 7f33f2d00700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:35:10.799 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.796+0000 7f33f2d00700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:35:10.799 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.796+0000 7f33f2d00700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:35:10.799 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.796+0000 7f33f2d00700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:35:10.799 INFO:tasks.ceph.mgr.x.smithi170.stderr:2020-01-26T15:35:10.796+0000 7f341e08d700 -1 --2- 172.21.15.170:0/4202748683 >> v2:172.21.15.170:6791/0 conn(0x55feb7f19600 0x55feb7d95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:11.667 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.780+0000 7f1ac8f0a700 1 Processor -- start 2020-01-26T15:35:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.780+0000 7f1ac8f0a700 1 -- start start 2020-01-26T15:35:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.780+0000 7f1ac8f0a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40a5b80 con 0x7f1ac414a880 2020-01-26T15:35:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.780+0000 7f1ac8f0a700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac4080440 con 0x7f1ac4146c30 2020-01-26T15:35:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.780+0000 7f1ac8f0a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40a4e00 con 0x7f1ac40a5750 2020-01-26T15:35:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac2d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f1ac40a5750 0x7f1ac40a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42338/0 (socket says 172.21.15.170:42338) 2020-01-26T15:35:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac2d9d700 1 -- 172.21.15.170:0/3549439211 learned_addr learned my addr 172.21.15.170:0/3549439211 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541227665 0 0) 0x7f1ac4080440 con 0x7f1ac4146c30 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab0003230 con 0x7f1ac4146c30 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064846048 0 0) 0x7f1ac40a5b80 con 0x7f1ac414a880 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac4080440 con 0x7f1ac414a880 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244776265 0 0) 0x7f1ac40a4e00 con 0x7f1ac40a5750 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac40a5b80 con 0x7f1ac40a5750 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 798487050 0 0) 0x7f1ab0003230 con 0x7f1ac4146c30 2020-01-26T15:35:11.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 >> v1:172.21.15.170:6791/0 conn(0x7f1ac40a5750 legacy=0x7f1ac40a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 >> v1:172.21.15.170:6789/0 conn(0x7f1ac414a880 legacy=0x7f1ac414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40a3210 con 0x7f1ac4146c30 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1aac0016e0 con 0x7f1ac4146c30 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f1aac001a50 con 0x7f1ac4146c30 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac259c700 1 -- 172.21.15.170:0/3549439211 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1aac001ec0 con 0x7f1ac4146c30 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/3549439211 >> v1:172.21.15.170:6790/0 conn(0x7f1ac4146c30 legacy=0x7f1ac4149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:11.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/3549439211 shutdown_connections 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/3549439211 >> 172.21.15.170:0/3549439211 conn(0x7f1ac405e050 msgr2=0x7f1ac4098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/3549439211 shutdown_connections 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/3549439211 wait complete. 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 Processor -- start 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- start start 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1ac41352f0 0x7f1ac411f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac411fb80 con 0x7f1ac41305b0 2020-01-26T15:35:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac4093840 con 0x7f1ac408f390 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac8f0a700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac4095500 con 0x7f1ac41352f0 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac359e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1ac41305b0 0x7f1ac41309e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50346/0 (socket says 172.21.15.170:50346) 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.784+0000 7f1ac2d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f1ac408f390 0x7f1ac4134af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42344/0 (socket says 172.21.15.170:42344) 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1ac359e700 1 -- 172.21.15.170:0/751838903 learned_addr learned my addr 172.21.15.170:0/751838903 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abbfff700 -1 --2- 172.21.15.170:0/751838903 >> v2:172.21.15.170:6791/0 conn(0x7f1ac41352f0 0x7f1ac411f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abbfff700 1 --2- 172.21.15.170:0/751838903 >> v2:172.21.15.170:6791/0 conn(0x7f1ac41352f0 0x7f1ac411f630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:11.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478177616 0 0) 0x7f1ac411fb80 con 0x7f1ac41305b0 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa8003230 con 0x7f1ac41305b0 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135886629 0 0) 0x7f1ac4093840 con 0x7f1ac408f390 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac411fb80 con 0x7f1ac408f390 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2803984780 0 0) 0x7f1ac411fb80 con 0x7f1ac408f390 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ac4093840 con 0x7f1ac408f390 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1ab40016a0 con 0x7f1ac408f390 2020-01-26T15:35:11.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3424046992 0 0) 0x7f1aa8003230 con 0x7f1ac41305b0 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ac411fb80 con 0x7f1ac41305b0 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1abc002bd0 con 0x7f1ac41305b0 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1862782647 0 0) 0x7f1ac4093840 con 0x7f1ac408f390 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 >> v2:172.21.15.170:6791/0 conn(0x7f1ac41352f0 msgr2=0x7f1ac411f630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 --2- 172.21.15.170:0/751838903 >> v2:172.21.15.170:6791/0 conn(0x7f1ac41352f0 0x7f1ac411f630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 >> v1:172.21.15.170:6789/0 conn(0x7f1ac41305b0 legacy=0x7f1ac41309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:11.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac407f7d0 con 0x7f1ac408f390 2020-01-26T15:35:11.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac4134770 con 0x7f1ac408f390 2020-01-26T15:35:11.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac41208b0 con 0x7f1ac408f390 2020-01-26T15:35:11.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f1ab40044f0 con 0x7f1ac408f390 2020-01-26T15:35:11.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f1ab4004910 con 0x7f1ac408f390 2020-01-26T15:35:11.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c003360 con 0x7f1ac408f390 2020-01-26T15:35:11.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 7) v1 ==== 47035+0+0 (unknown 1558991138 0 0) 0x7f1ab4004b10 con 0x7f1ac408f390 2020-01-26T15:35:11.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.788+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f1ab404b570 con 0x7f1ac408f390 2020-01-26T15:35:11.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.792+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1ab4030de0 con 0x7f1ac408f390 2020-01-26T15:35:11.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.908+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a9c0021f0 con 0x7f1ac408f390 2020-01-26T15:35:11.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.908+0000 7f1abb7fe700 1 -- 172.21.15.170:0/751838903 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 57899951) 0x7f1ab404a530 con 0x7f1ac408f390 2020-01-26T15:35:11.914 INFO:teuthology.orchestra.run.smithi170.stdout:38654705702 2020-01-26T15:35:11.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 >> v1:172.21.15.170:6800/17396 conn(0x7f1aa803e2c0 legacy=0x7f1aa80407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:11.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 >> v1:172.21.15.170:6791/0 conn(0x7f1ac408f390 legacy=0x7f1ac4134af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:11.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 shutdown_connections 2020-01-26T15:35:11.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 --2- 172.21.15.170:0/751838903 >> v2:172.21.15.170:6791/0 conn(0x7f1ac41352f0 0x7f1ac411f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:11.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 >> 172.21.15.170:0/751838903 conn(0x7f1ac40979c0 msgr2=0x7f1ac405ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:11.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 shutdown_connections 2020-01-26T15:35:11.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:11.912+0000 7f1ac8f0a700 1 -- 172.21.15.170:0/751838903 wait complete. 2020-01-26T15:35:11.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2020-01-26T15:35:12.927 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:13.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.044+0000 7f2ec9357700 1 Processor -- start 2020-01-26T15:35:13.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.044+0000 7f2ec9357700 1 -- start start 2020-01-26T15:35:13.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2ec405edd0 0x7f2ec405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:13.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2ec4149040 0x7f2ec414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec4098000 con 0x7f2ec40a6870 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec405e050 con 0x7f2ec4149040 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40a6ca0 con 0x7f2ec405edd0 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec3fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2ec40a6870 0x7f2ec407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50352/0 (socket says 172.21.15.170:50352) 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec8b56700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2ec405edd0 0x7f2ec405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec3fff700 1 -- 172.21.15.170:0/1824131840 learned_addr learned my addr 172.21.15.170:0/1824131840 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec8b56700 1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6791/0 conn(0x7f2ec405edd0 0x7f2ec405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2eca5b9700 -1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6790/0 conn(0x7f2ec4149040 0x7f2ec414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2eca5b9700 1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6790/0 conn(0x7f2ec4149040 0x7f2ec414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717273930 0 0) 0x7f2ec4098000 con 0x7f2ec40a6870 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac003230 con 0x7f2ec40a6870 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2216109128 0 0) 0x7f2eac003230 con 0x7f2ec40a6870 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6791/0 conn(0x7f2ec405edd0 msgr2=0x7f2ec405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:13.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6791/0 conn(0x7f2ec405edd0 0x7f2ec405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6790/0 conn(0x7f2ec4149040 msgr2=0x7f2ec414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6790/0 conn(0x7f2ec4149040 0x7f2ec414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec414c9e0 con 0x7f2ec40a6870 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f2eb80016e0 con 0x7f2ec40a6870 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f2eb8001b10 con 0x7f2ec40a6870 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec37fe700 1 -- 172.21.15.170:0/1824131840 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f2eb8004730 con 0x7f2ec40a6870 2020-01-26T15:35:13.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- 172.21.15.170:0/1824131840 >> v1:172.21.15.170:6789/0 conn(0x7f2ec40a6870 legacy=0x7f2ec407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- 172.21.15.170:0/1824131840 shutdown_connections 2020-01-26T15:35:13.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6790/0 conn(0x7f2ec4149040 0x7f2ec414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 --2- 172.21.15.170:0/1824131840 >> v2:172.21.15.170:6791/0 conn(0x7f2ec405edd0 0x7f2ec405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- 172.21.15.170:0/1824131840 >> 172.21.15.170:0/1824131840 conn(0x7f2ec4098e70 msgr2=0x7f2ec40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- 172.21.15.170:0/1824131840 shutdown_connections 2020-01-26T15:35:13.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- 172.21.15.170:0/1824131840 wait complete. 2020-01-26T15:35:13.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 Processor -- start 2020-01-26T15:35:13.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.048+0000 7f2ec9357700 1 -- start start 2020-01-26T15:35:13.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2ec411f560 0x7f2ec4133050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:13.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec411e3f0 con 0x7f2ec41335a0 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec411ea40 con 0x7f2ec409f580 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec411fcc0 con 0x7f2ec411f560 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec8b56700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2ec411f560 0x7f2ec4133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec8b56700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2ec411f560 0x7f2ec4133050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2eca5b9700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f2ec409f580 0x7f2ec413a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42360/0 (socket says 172.21.15.170:42360) 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2eca5b9700 1 -- 172.21.15.170:0/2162178029 learned_addr learned my addr 172.21.15.170:0/2162178029 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376736578 0 0) 0x7f2ec411ea40 con 0x7f2ec409f580 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea4003230 con 0x7f2ec409f580 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669848458 0 0) 0x7f2ec411e3f0 con 0x7f2ec41335a0 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec411ea40 con 0x7f2ec41335a0 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 380430922 0 0) 0x7f2ec411ea40 con 0x7f2ec41335a0 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2ec411e3f0 con 0x7f2ec41335a0 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f2eb8001420 con 0x7f2ec41335a0 2020-01-26T15:35:13.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3194226151 0 0) 0x7f2ea4003230 con 0x7f2ec409f580 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2ec411ea40 con 0x7f2ec409f580 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f2ebc001970 con 0x7f2ec409f580 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2750092968 0 0) 0x7f2ec411e3f0 con 0x7f2ec41335a0 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 >> v2:172.21.15.170:6790/0 conn(0x7f2ec411f560 msgr2=0x7f2ec4133050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 --2- 172.21.15.170:0/2162178029 >> v2:172.21.15.170:6790/0 conn(0x7f2ec411f560 0x7f2ec4133050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 >> v1:172.21.15.170:6791/0 conn(0x7f2ec409f580 legacy=0x7f2ec413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec409e250 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec409f9b0 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec411f260 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.052+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec4056600 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.056+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f2eb8001230 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.056+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f2eb8004b00 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.056+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f2eb8010540 con 0x7f2ec41335a0 2020-01-26T15:35:13.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.056+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f2eb804b6a0 con 0x7f2ec41335a0 2020-01-26T15:35:13.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.064+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f2eb8030b80 con 0x7f2ec41335a0 2020-01-26T15:35:13.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ec405cc60 con 0x7f2ec41335a0 2020-01-26T15:35:13.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec17fa700 1 -- 172.21.15.170:0/2162178029 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 1790716573) 0x7f2eb8030de0 con 0x7f2ec41335a0 2020-01-26T15:35:13.183 INFO:teuthology.orchestra.run.smithi170.stdout:38654705704 2020-01-26T15:35:13.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 >> v1:172.21.15.170:6800/17396 conn(0x7f2ea403e4e0 legacy=0x7f2ea40409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 >> v1:172.21.15.170:6790/0 conn(0x7f2ec41335a0 legacy=0x7f2ec409ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 shutdown_connections 2020-01-26T15:35:13.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 --2- 172.21.15.170:0/2162178029 >> v2:172.21.15.170:6790/0 conn(0x7f2ec411f560 0x7f2ec4133050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 >> 172.21.15.170:0/2162178029 conn(0x7f2ec40a5520 msgr2=0x7f2ec407f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 shutdown_connections 2020-01-26T15:35:13.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.180+0000 7f2ec9357700 1 -- 172.21.15.170:0/2162178029 wait complete. 2020-01-26T15:35:13.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.0 2020-01-26T15:35:13.195 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:35:13.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.300+0000 7fdf71268700 1 Processor -- start 2020-01-26T15:35:13.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.300+0000 7fdf71268700 1 -- start start 2020-01-26T15:35:13.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdf6c146c30 0x7fdf6c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:13.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c0a5b80 con 0x7fdf6c1495c0 2020-01-26T15:35:13.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c080440 con 0x7fdf6c0a5750 2020-01-26T15:35:13.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0a43f0 con 0x7fdf6c146c30 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6affd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdf6c146c30 0x7fdf6c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6b7fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fdf6c0a5750 0x7fdf6c0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42366/0 (socket says 172.21.15.170:42366) 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6b7fe700 1 -- 172.21.15.170:0/4088430246 learned_addr learned my addr 172.21.15.170:0/4088430246 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6affd700 1 --2- 172.21.15.170:0/4088430246 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c146c30 0x7fdf6c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6bfff700 1 --1- 172.21.15.170:0/4088430246 >> v1:172.21.15.170:6789/0 conn(0x7fdf6c1495c0 0x7fdf6c14ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50368/0 (socket says 172.21.15.170:50368) 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659683534 0 0) 0x7fdf6c080440 con 0x7fdf6c0a5750 2020-01-26T15:35:13.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf54003230 con 0x7fdf6c0a5750 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177936937 0 0) 0x7fdf6c0a5b80 con 0x7fdf6c1495c0 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf6c080440 con 0x7fdf6c1495c0 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3778273648 0 0) 0x7fdf54003230 con 0x7fdf6c0a5750 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c146c30 msgr2=0x7fdf6c149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 --2- 172.21.15.170:0/4088430246 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c146c30 0x7fdf6c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 >> v1:172.21.15.170:6789/0 conn(0x7fdf6c1495c0 legacy=0x7fdf6c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0a4e00 con 0x7fdf6c0a5750 2020-01-26T15:35:13.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdf5c001a60 con 0x7fdf6c0a5750 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdf5c001dd0 con 0x7fdf6c0a5750 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf6a7fc700 1 -- 172.21.15.170:0/4088430246 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdf5c004930 con 0x7fdf6c0a5750 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- 172.21.15.170:0/4088430246 >> v1:172.21.15.170:6791/0 conn(0x7fdf6c0a5750 legacy=0x7fdf6c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- 172.21.15.170:0/4088430246 shutdown_connections 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 --2- 172.21.15.170:0/4088430246 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c146c30 0x7fdf6c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- 172.21.15.170:0/4088430246 >> 172.21.15.170:0/4088430246 conn(0x7fdf6c05e050 msgr2=0x7fdf6c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- 172.21.15.170:0/4088430246 shutdown_connections 2020-01-26T15:35:13.313 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.304+0000 7fdf71268700 1 -- 172.21.15.170:0/4088430246 wait complete. 2020-01-26T15:35:13.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 Processor -- start 2020-01-26T15:35:13.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 -- start start 2020-01-26T15:35:13.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdf6c1208e0 0x7fdf6c122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:13.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fdf6c07a1b0 0x7fdf6c137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:13.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c120e60 con 0x7fdf6c123370 2020-01-26T15:35:13.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c11f110 con 0x7fdf6c07a1b0 2020-01-26T15:35:13.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c120600 con 0x7fdf6c1208e0 2020-01-26T15:35:13.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf6bfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fdf6c07a1b0 0x7fdf6c137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:13.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf6b7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdf6c1208e0 0x7fdf6c122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:13.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf6bfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fdf6c07a1b0 0x7fdf6c137780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf6b7fe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdf6c1208e0 0x7fdf6c122e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf6affd700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fdf6c123370 0x7fdf6c0799b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50374/0 (socket says 172.21.15.170:50374) 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf6affd700 1 -- 172.21.15.170:0/3746705571 learned_addr learned my addr 172.21.15.170:0/3746705571 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010177084 0 0) 0x7fdf6c120e60 con 0x7fdf6c123370 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf4c003230 con 0x7fdf6c123370 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3049527530 0 0) 0x7fdf4c003230 con 0x7fdf6c123370 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf6c120e60 con 0x7fdf6c123370 2020-01-26T15:35:13.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdf60002710 con 0x7fdf6c123370 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2418742691 0 0) 0x7fdf6c120e60 con 0x7fdf6c123370 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c1208e0 msgr2=0x7fdf6c122e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 --2- 172.21.15.170:0/3746705571 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c1208e0 0x7fdf6c122e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 >> v2:172.21.15.170:6790/0 conn(0x7fdf6c07a1b0 msgr2=0x7fdf6c137780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 --2- 172.21.15.170:0/3746705571 >> v2:172.21.15.170:6790/0 conn(0x7fdf6c07a1b0 0x7fdf6c137780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c1228e0 con 0x7fdf6c123370 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c121940 con 0x7fdf6c123370 2020-01-26T15:35:13.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c0a68f0 con 0x7fdf6c123370 2020-01-26T15:35:13.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdf60000f10 con 0x7fdf6c123370 2020-01-26T15:35:13.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.308+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdf600012b0 con 0x7fdf6c123370 2020-01-26T15:35:13.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.312+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44003360 con 0x7fdf6c123370 2020-01-26T15:35:13.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.312+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fdf600014b0 con 0x7fdf6c123370 2020-01-26T15:35:13.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.312+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7fdf6004ba90 con 0x7fdf6c123370 2020-01-26T15:35:13.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.316+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fdf6c0a68f0 con 0x7fdf6c123370 2020-01-26T15:35:13.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdf440021f0 con 0x7fdf6c123370 2020-01-26T15:35:13.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf53fff700 1 -- 172.21.15.170:0/3746705571 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 1790716573) 0x7fdf60031170 con 0x7fdf6c123370 2020-01-26T15:35:13.439 INFO:teuthology.orchestra.run.smithi170.stdout:38654705704 2020-01-26T15:35:13.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 >> v1:172.21.15.170:6800/17396 conn(0x7fdf4c03dfe0 legacy=0x7fdf4c0404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 >> v1:172.21.15.170:6789/0 conn(0x7fdf6c123370 legacy=0x7fdf6c0799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 shutdown_connections 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 --2- 172.21.15.170:0/3746705571 >> v2:172.21.15.170:6790/0 conn(0x7fdf6c07a1b0 0x7fdf6c137780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 --2- 172.21.15.170:0/3746705571 >> v2:172.21.15.170:6791/0 conn(0x7fdf6c1208e0 0x7fdf6c122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 >> 172.21.15.170:0/3746705571 conn(0x7fdf6c0a4110 msgr2=0x7fdf6c07e280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 shutdown_connections 2020-01-26T15:35:13.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.436+0000 7fdf71268700 1 -- 172.21.15.170:0/3746705571 wait complete. 2020-01-26T15:35:13.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.1 2020-01-26T15:35:13.452 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-26T15:35:13.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 Processor -- start 2020-01-26T15:35:13.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 -- start start 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f27e805edd0 0x7f27e805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e8098000 con 0x7f27e80a6870 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e805e050 con 0x7f27e8149040 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f27e80a6ca0 con 0x7f27e805edd0 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27edd04700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f27e80a6870 0x7f27e807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47258/0 (socket says 172.21.15.170:47258) 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27edd04700 1 -- 172.21.15.170:0/4165431846 learned_addr learned my addr 172.21.15.170:0/4165431846 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eff68700 1 --1- 172.21.15.170:0/4165431846 >> v1:172.21.15.170:6791/0 conn(0x7f27e8149040 0x7f27e814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42382/0 (socket says 172.21.15.170:42382) 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ee505700 -1 --2- 172.21.15.170:0/4165431846 >> v2:172.21.15.170:6791/0 conn(0x7f27e805edd0 0x7f27e805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ee505700 1 --2- 172.21.15.170:0/4165431846 >> v2:172.21.15.170:6791/0 conn(0x7f27e805edd0 0x7f27e805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879810446 0 0) 0x7f27e805e050 con 0x7f27e8149040 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d4003230 con 0x7f27e8149040 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546450427 0 0) 0x7f27e8098000 con 0x7f27e80a6870 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e805e050 con 0x7f27e80a6870 2020-01-26T15:35:13.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3291518001 0 0) 0x7f27d4003230 con 0x7f27e8149040 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 >> v2:172.21.15.170:6791/0 conn(0x7f27e805edd0 msgr2=0x7f27e805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 --2- 172.21.15.170:0/4165431846 >> v2:172.21.15.170:6791/0 conn(0x7f27e805edd0 0x7f27e805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 >> v1:172.21.15.170:6790/0 conn(0x7f27e80a6870 legacy=0x7f27e807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e814ecb0 con 0x7f27e8149040 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f27e40016e0 con 0x7f27e8149040 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f27e4001a50 con 0x7f27e8149040 2020-01-26T15:35:13.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27ed503700 1 -- 172.21.15.170:0/4165431846 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f27e40044f0 con 0x7f27e8149040 2020-01-26T15:35:13.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.560+0000 7f27eed06700 1 -- 172.21.15.170:0/4165431846 >> v1:172.21.15.170:6791/0 conn(0x7f27e8149040 legacy=0x7f27e814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- 172.21.15.170:0/4165431846 shutdown_connections 2020-01-26T15:35:13.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 --2- 172.21.15.170:0/4165431846 >> v2:172.21.15.170:6791/0 conn(0x7f27e805edd0 0x7f27e805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- 172.21.15.170:0/4165431846 >> 172.21.15.170:0/4165431846 conn(0x7f27e8098e70 msgr2=0x7f27e80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- 172.21.15.170:0/4165431846 shutdown_connections 2020-01-26T15:35:13.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- 172.21.15.170:0/4165431846 wait complete. 2020-01-26T15:35:13.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 Processor -- start 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- start start 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f27e81214c0 0x7f27e807b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e81219d0 con 0x7f27e807bf20 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e81202d0 con 0x7f27e8121090 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.564+0000 7f27eed06700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f27e8099c60 con 0x7f27e81214c0 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27ee505700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f27e8121090 0x7f27e809e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47260/0 (socket says 172.21.15.170:47260) 2020-01-26T15:35:13.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27ee505700 1 -- 172.21.15.170:0/3841944407 learned_addr learned my addr 172.21.15.170:0/3841944407 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27edd04700 -1 --2- 172.21.15.170:0/3841944407 >> v2:172.21.15.170:6790/0 conn(0x7f27e81214c0 0x7f27e807b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27edd04700 1 --2- 172.21.15.170:0/3841944407 >> v2:172.21.15.170:6790/0 conn(0x7f27e81214c0 0x7f27e807b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602571919 0 0) 0x7f27e81202d0 con 0x7f27e8121090 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d0003230 con 0x7f27e8121090 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518883767 0 0) 0x7f27e81219d0 con 0x7f27e807bf20 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e81202d0 con 0x7f27e807bf20 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3031786427 0 0) 0x7f27d0003230 con 0x7f27e8121090 2020-01-26T15:35:13.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27e81219d0 con 0x7f27e8121090 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f27e0002ad0 con 0x7f27e8121090 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1266399150 0 0) 0x7f27e81202d0 con 0x7f27e807bf20 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27d0003230 con 0x7f27e807bf20 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f27e4001420 con 0x7f27e807bf20 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1191608963 0 0) 0x7f27e81219d0 con 0x7f27e8121090 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 >> v2:172.21.15.170:6790/0 conn(0x7f27e81214c0 msgr2=0x7f27e807b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:13.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 --2- 172.21.15.170:0/3841944407 >> v2:172.21.15.170:6790/0 conn(0x7f27e81214c0 0x7f27e807b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 >> v1:172.21.15.170:6789/0 conn(0x7f27e807bf20 legacy=0x7f27e81385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e809e800 con 0x7f27e8121090 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e8122dd0 con 0x7f27e8121090 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e807c570 con 0x7f27e8121090 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f27e0001210 con 0x7f27e8121090 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f27e00015b0 con 0x7f27e8121090 2020-01-26T15:35:13.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f27e00017b0 con 0x7f27e8121090 2020-01-26T15:35:13.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e8056600 con 0x7f27e8121090 2020-01-26T15:35:13.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.568+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f27e004bbf0 con 0x7f27e8121090 2020-01-26T15:35:13.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.576+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f27e00313e0 con 0x7f27e8121090 2020-01-26T15:35:13.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.692+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27e809ea10 con 0x7f27e8121090 2020-01-26T15:35:13.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27deffd700 1 -- 172.21.15.170:0/3841944407 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 1790716573) 0x7f27e002fca0 con 0x7f27e8121090 2020-01-26T15:35:13.698 INFO:teuthology.orchestra.run.smithi170.stdout:38654705704 2020-01-26T15:35:13.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 >> v1:172.21.15.170:6800/17396 conn(0x7f27d003e3c0 legacy=0x7f27d00408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 >> v1:172.21.15.170:6790/0 conn(0x7f27e8121090 legacy=0x7f27e809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 shutdown_connections 2020-01-26T15:35:13.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 --2- 172.21.15.170:0/3841944407 >> v2:172.21.15.170:6790/0 conn(0x7f27e81214c0 0x7f27e807b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 >> 172.21.15.170:0/3841944407 conn(0x7f27e805c180 msgr2=0x7f27e80a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 shutdown_connections 2020-01-26T15:35:13.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.696+0000 7f27eed06700 1 -- 172.21.15.170:0/3841944407 wait complete. 2020-01-26T15:35:13.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.2 2020-01-26T15:35:13.717 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-26T15:35:13.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 Processor -- start 2020-01-26T15:35:13.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- start start 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f403414a880 0x7f403414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340a5b80 con 0x7f4034146c30 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4034080440 con 0x7f40340a5750 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f40340a43f0 con 0x7f403414a880 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f4033fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4034146c30 0x7f4034149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50392/0 (socket says 172.21.15.170:50392) 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f4033fff700 1 -- 172.21.15.170:0/3229389827 learned_addr learned my addr 172.21.15.170:0/3229389827 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f4039283700 -1 --2- 172.21.15.170:0/3229389827 >> v2:172.21.15.170:6791/0 conn(0x7f403414a880 0x7f403414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:13.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f4039283700 1 --2- 172.21.15.170:0/3229389827 >> v2:172.21.15.170:6791/0 conn(0x7f403414a880 0x7f403414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606105439 0 0) 0x7f40340a5b80 con 0x7f4034146c30 2020-01-26T15:35:13.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4020003230 con 0x7f4034146c30 2020-01-26T15:35:13.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591420258 0 0) 0x7f4034080440 con 0x7f40340a5750 2020-01-26T15:35:13.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40340a5b80 con 0x7f40340a5750 2020-01-26T15:35:13.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1111575343 0 0) 0x7f4020003230 con 0x7f4034146c30 2020-01-26T15:35:13.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 >> v2:172.21.15.170:6791/0 conn(0x7f403414a880 msgr2=0x7f403414ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:13.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 --2- 172.21.15.170:0/3229389827 >> v2:172.21.15.170:6791/0 conn(0x7f403414a880 0x7f403414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 >> v1:172.21.15.170:6791/0 conn(0x7f40340a5750 legacy=0x7f40340a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340a4e00 con 0x7f4034146c30 2020-01-26T15:35:13.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f40240016e0 con 0x7f4034146c30 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f4024001980 con 0x7f4034146c30 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f40337fe700 1 -- 172.21.15.170:0/3229389827 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f40240045b0 con 0x7f4034146c30 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- 172.21.15.170:0/3229389827 >> v1:172.21.15.170:6789/0 conn(0x7f4034146c30 legacy=0x7f4034149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- 172.21.15.170:0/3229389827 shutdown_connections 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 --2- 172.21.15.170:0/3229389827 >> v2:172.21.15.170:6791/0 conn(0x7f403414a880 0x7f403414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- 172.21.15.170:0/3229389827 >> 172.21.15.170:0/3229389827 conn(0x7f403405e050 msgr2=0x7f4034098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- 172.21.15.170:0/3229389827 shutdown_connections 2020-01-26T15:35:13.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.828+0000 7f403a4e5700 1 -- 172.21.15.170:0/3229389827 wait complete. 2020-01-26T15:35:13.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 Processor -- start 2020-01-26T15:35:13.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 -- start start 2020-01-26T15:35:13.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f40340937c0 0x7f4034138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:13.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4034092470 con 0x7f403407fa60 2020-01-26T15:35:13.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4034092780 con 0x7f4034093390 2020-01-26T15:35:13.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4034090580 con 0x7f40340937c0 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f4039283700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f40340937c0 0x7f4034138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f4038a82700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f4034093390 0x7f403407f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47274/0 (socket says 172.21.15.170:47274) 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f4033fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f403407fa60 0x7f40341353d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50400/0 (socket says 172.21.15.170:50400) 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f4038a82700 1 -- 172.21.15.170:0/3653463103 learned_addr learned my addr 172.21.15.170:0/3653463103 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f4039283700 1 --2- 172.21.15.170:0/3653463103 >> v2:172.21.15.170:6790/0 conn(0x7f40340937c0 0x7f4034138bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839122410 0 0) 0x7f4034092780 con 0x7f4034093390 2020-01-26T15:35:13.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4018003230 con 0x7f4034093390 2020-01-26T15:35:13.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790565904 0 0) 0x7f4034092470 con 0x7f403407fa60 2020-01-26T15:35:13.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4034092780 con 0x7f403407fa60 2020-01-26T15:35:13.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 266334380 0 0) 0x7f4034092780 con 0x7f403407fa60 2020-01-26T15:35:13.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4034092470 con 0x7f403407fa60 2020-01-26T15:35:13.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f4024001830 con 0x7f403407fa60 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 469381787 0 0) 0x7f4018003230 con 0x7f4034093390 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4034092780 con 0x7f4034093390 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f401c002930 con 0x7f4034093390 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2955607089 0 0) 0x7f4034092780 con 0x7f4034093390 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 >> v2:172.21.15.170:6790/0 conn(0x7f40340937c0 msgr2=0x7f4034138bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 --2- 172.21.15.170:0/3653463103 >> v2:172.21.15.170:6790/0 conn(0x7f40340937c0 0x7f4034138bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 >> v1:172.21.15.170:6789/0 conn(0x7f403407fa60 legacy=0x7f40341353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403405e050 con 0x7f4034093390 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40340954c0 con 0x7f4034093390 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4034091e50 con 0x7f4034093390 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f401c001330 con 0x7f4034093390 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f401c0016e0 con 0x7f4034093390 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.832+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f401c0018e0 con 0x7f4034093390 2020-01-26T15:35:13.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.836+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4034056600 con 0x7f4034093390 2020-01-26T15:35:13.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.836+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f401c04b800 con 0x7f4034093390 2020-01-26T15:35:13.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.840+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f401c030ee0 con 0x7f4034093390 2020-01-26T15:35:13.961 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4034065fd0 con 0x7f4034093390 2020-01-26T15:35:13.962 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f40317fa700 1 -- 172.21.15.170:0/3653463103 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 1790716573) 0x7f401c04a690 con 0x7f4034093390 2020-01-26T15:35:13.962 INFO:teuthology.orchestra.run.smithi170.stdout:38654705704 2020-01-26T15:35:13.963 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 >> v1:172.21.15.170:6800/17396 conn(0x7f401803e450 legacy=0x7f4018040960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 >> v1:172.21.15.170:6790/0 conn(0x7f4034093390 legacy=0x7f403407f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 shutdown_connections 2020-01-26T15:35:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 --2- 172.21.15.170:0/3653463103 >> v2:172.21.15.170:6790/0 conn(0x7f40340937c0 0x7f4034138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 >> 172.21.15.170:0/3653463103 conn(0x7f403405f4e0 msgr2=0x7f40340a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 shutdown_connections 2020-01-26T15:35:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:13.960+0000 7f403a4e5700 1 -- 172.21.15.170:0/3653463103 wait complete. 2020-01-26T15:35:13.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.3 2020-01-26T15:35:13.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-26T15:35:13.975 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:35:14.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 Processor -- start 2020-01-26T15:35:14.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 -- start start 2020-01-26T15:35:14.088 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f553405e5f0 0x7f55340a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f5534149040 0x7f553414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55340a6dc0 con 0x7f553405edd0 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f553405ea20 con 0x7f553405e5f0 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f5534098000 con 0x7f5534149040 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f553962a700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f553405edd0 0x7f553407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50406/0 (socket says 172.21.15.170:50406) 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f553962a700 1 -- 172.21.15.170:0/1189728259 learned_addr learned my addr 172.21.15.170:0/1189728259 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5538e29700 -1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6790/0 conn(0x7f553405e5f0 0x7f55340a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:14.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f553b08d700 -1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6791/0 conn(0x7f5534149040 0x7f553414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:14.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f553b08d700 1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6791/0 conn(0x7f5534149040 0x7f553414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5538e29700 1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6790/0 conn(0x7f553405e5f0 0x7f55340a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112551804 0 0) 0x7f55340a6dc0 con 0x7f553405edd0 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5520003230 con 0x7f553405edd0 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2888116811 0 0) 0x7f5520003230 con 0x7f553405edd0 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6791/0 conn(0x7f5534149040 msgr2=0x7f553414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6791/0 conn(0x7f5534149040 0x7f553414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6790/0 conn(0x7f553405e5f0 msgr2=0x7f55340a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6790/0 conn(0x7f553405e5f0 0x7f55340a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553405e050 con 0x7f553405edd0 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f552c0016e0 con 0x7f553405edd0 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f552c001b10 con 0x7f553405edd0 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5533fff700 1 -- 172.21.15.170:0/1189728259 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f552c004730 con 0x7f553405edd0 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.080+0000 7f5539e2b700 1 -- 172.21.15.170:0/1189728259 >> v1:172.21.15.170:6789/0 conn(0x7f553405edd0 legacy=0x7f553407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 -- 172.21.15.170:0/1189728259 shutdown_connections 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6791/0 conn(0x7f5534149040 0x7f553414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 --2- 172.21.15.170:0/1189728259 >> v2:172.21.15.170:6790/0 conn(0x7f553405e5f0 0x7f55340a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 -- 172.21.15.170:0/1189728259 >> 172.21.15.170:0/1189728259 conn(0x7f5534098e70 msgr2=0x7f55340a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 -- 172.21.15.170:0/1189728259 shutdown_connections 2020-01-26T15:35:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 -- 172.21.15.170:0/1189728259 wait complete. 2020-01-26T15:35:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 Processor -- start 2020-01-26T15:35:14.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.084+0000 7f5539e2b700 1 -- start start 2020-01-26T15:35:14.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5539e2b700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f5534099a00 0x7f5534099e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:14.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5539e2b700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55340a2710 con 0x7f55340a3d00 2020-01-26T15:35:14.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5539e2b700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553409a380 con 0x7f5534135240 2020-01-26T15:35:14.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5539e2b700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f55340a2240 con 0x7f5534099a00 2020-01-26T15:35:14.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5538e29700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f5534099a00 0x7f5534099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f553b08d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f5534135240 0x7f5534137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42416/0 (socket says 172.21.15.170:42416) 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f553b08d700 1 -- 172.21.15.170:0/2002741125 learned_addr learned my addr 172.21.15.170:0/2002741125 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f553962a700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f55340a3d00 0x7f553407ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50410/0 (socket says 172.21.15.170:50410) 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5538e29700 1 --2- 172.21.15.170:0/2002741125 >> v2:172.21.15.170:6791/0 conn(0x7f5534099a00 0x7f5534099e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359813695 0 0) 0x7f553409a380 con 0x7f5534135240 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5518003230 con 0x7f5534135240 2020-01-26T15:35:14.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951675178 0 0) 0x7f55340a2710 con 0x7f55340a3d00 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f553409a380 con 0x7f55340a3d00 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 52450637 0 0) 0x7f5518003230 con 0x7f5534135240 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55340a2710 con 0x7f5534135240 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f551c0015f0 con 0x7f5534135240 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 853091150 0 0) 0x7f553409a380 con 0x7f55340a3d00 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5518003230 con 0x7f55340a3d00 2020-01-26T15:35:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f552c001c30 con 0x7f55340a3d00 2020-01-26T15:35:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4204691369 0 0) 0x7f55340a2710 con 0x7f5534135240 2020-01-26T15:35:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 >> v2:172.21.15.170:6791/0 conn(0x7f5534099a00 msgr2=0x7f5534099e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 --2- 172.21.15.170:0/2002741125 >> v2:172.21.15.170:6791/0 conn(0x7f5534099a00 0x7f5534099e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 >> v1:172.21.15.170:6789/0 conn(0x7f55340a3d00 legacy=0x7f553407ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340a2d50 con 0x7f5534135240 2020-01-26T15:35:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553407d260 con 0x7f5534135240 2020-01-26T15:35:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f551c001ec0 con 0x7f5534135240 2020-01-26T15:35:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5534121a50 con 0x7f5534135240 2020-01-26T15:35:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.088+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f551c002320 con 0x7f5534135240 2020-01-26T15:35:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.092+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c003360 con 0x7f5534135240 2020-01-26T15:35:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.092+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f551c0025a0 con 0x7f5534135240 2020-01-26T15:35:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.092+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f551c04b760 con 0x7f5534135240 2020-01-26T15:35:14.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.096+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f551c030f60 con 0x7f5534135240 2020-01-26T15:35:14.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.208+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 --> v1:172.21.15.170:6800/17396 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f550c0021c0 con 0x7f5518042840 2020-01-26T15:35:14.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5531ffb700 1 -- 172.21.15.170:0/2002741125 <== mgr.64101 v1:172.21.15.170:6800/17396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63258 (unknown 2965378022 0 2077888211) 0x7f550c0021c0 con 0x7f5518042840 2020-01-26T15:35:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:14.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 >> v1:172.21.15.170:6800/17396 conn(0x7f5518042840 legacy=0x7f5518044d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 >> v1:172.21.15.170:6791/0 conn(0x7f5534135240 legacy=0x7f5534137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 shutdown_connections 2020-01-26T15:35:14.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 --2- 172.21.15.170:0/2002741125 >> v2:172.21.15.170:6791/0 conn(0x7f5534099a00 0x7f5534099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 >> 172.21.15.170:0/2002741125 conn(0x7f5534098e10 msgr2=0x7f5534097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 shutdown_connections 2020-01-26T15:35:14.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.212+0000 7f5539e2b700 1 -- 172.21.15.170:0/2002741125 wait complete. 2020-01-26T15:35:14.218 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2020-01-26T15:35:14.229 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2020-01-26T15:35:12.746871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4197184,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290176,"statfs":{"total":386547056640,"available":382249140224,"internally_reserved":0,"allocated":2883584,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.991810"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789798+0000","last_change":"2020-01-26T15:32:15.388125+0000","last_active":"2020-01-26T15:32:25.789798+0000","last_peered":"2020-01-26T15:32:25.789798+0000","last_clean":"2020-01-26T15:32:25.789798+0000","last_became_active":"2020-01-26T15:32:15.387793+0000","last_became_peered":"2020-01-26T15:32:15.387793+0000","last_unstale":"2020-01-26T15:32:25.789798+0000","last_undegraded":"2020-01-26T15:32:25.789798+0000","last_fullsized":"2020-01-26T15:32:25.789798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438483+0000","last_change":"2020-01-26T15:32:13.141863+0000","last_active":"2020-01-26T15:32:25.438483+0000","last_peered":"2020-01-26T15:32:25.438483+0000","last_clean":"2020-01-26T15:32:25.438483+0000","last_became_active":"2020-01-26T15:32:13.141432+0000","last_became_peered":"2020-01-26T15:32:13.141432+0000","last_unstale":"2020-01-26T15:32:25.438483+0000","last_undegraded":"2020-01-26T15:32:25.438483+0000","last_fullsized":"2020-01-26T15:32:25.438483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'8","reported_seq":"21","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:42.509755+0000","last_change":"2020-01-26T15:32:15.160060+0000","last_active":"2020-01-26T15:32:42.509755+0000","last_peered":"2020-01-26T15:32:42.509755+0000","last_clean":"2020-01-26T15:32:42.509755+0000","last_became_active":"2020-01-26T15:32:15.159093+0000","last_became_peered":"2020-01-26T15:32:15.159093+0000","last_unstale":"2020-01-26T15:32:42.509755+0000","last_undegraded":"2020-01-26T15:32:42.509755+0000","last_fullsized":"2020-01-26T15:32:42.509755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439116+0000","last_change":"2020-01-26T15:32:16.391402+0000","last_active":"2020-01-26T15:32:25.439116+0000","last_peered":"2020-01-26T15:32:25.439116+0000","last_clean":"2020-01-26T15:32:25.439116+0000","last_became_active":"2020-01-26T15:32:16.390999+0000","last_became_peered":"2020-01-26T15:32:16.390999+0000","last_unstale":"2020-01-26T15:32:25.439116+0000","last_undegraded":"2020-01-26T15:32:25.439116+0000","last_fullsized":"2020-01-26T15:32:25.439116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789827+0000","last_change":"2020-01-26T15:32:13.147209+0000","last_active":"2020-01-26T15:32:25.789827+0000","last_peered":"2020-01-26T15:32:25.789827+0000","last_clean":"2020-01-26T15:32:25.789827+0000","last_became_active":"2020-01-26T15:32:13.146844+0000","last_became_peered":"2020-01-26T15:32:13.146844+0000","last_unstale":"2020-01-26T15:32:25.789827+0000","last_undegraded":"2020-01-26T15:32:25.789827+0000","last_fullsized":"2020-01-26T15:32:25.789827+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"17'16","reported_seq":"29","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:52.525707+0000","last_change":"2020-01-26T15:32:15.160486+0000","last_active":"2020-01-26T15:32:52.525707+0000","last_peered":"2020-01-26T15:32:52.525707+0000","last_clean":"2020-01-26T15:32:52.525707+0000","last_became_active":"2020-01-26T15:32:15.160031+0000","last_became_peered":"2020-01-26T15:32:15.160031+0000","last_unstale":"2020-01-26T15:32:52.525707+0000","last_undegraded":"2020-01-26T15:32:52.525707+0000","last_fullsized":"2020-01-26T15:32:52.525707+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":656,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438898+0000","last_change":"2020-01-26T15:32:16.389450+0000","last_active":"2020-01-26T15:32:25.438898+0000","last_peered":"2020-01-26T15:32:25.438898+0000","last_clean":"2020-01-26T15:32:25.438898+0000","last_became_active":"2020-01-26T15:32:16.389078+0000","last_became_peered":"2020-01-26T15:32:16.389078+0000","last_unstale":"2020-01-26T15:32:25.438898+0000","last_undegraded":"2020-01-26T15:32:25.438898+0000","last_fullsized":"2020-01-26T15:32:25.438898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.440009+0000","last_change":"2020-01-26T15:32:13.141343+0000","last_active":"2020-01-26T15:32:25.440009+0000","last_peered":"2020-01-26T15:32:25.440009+0000","last_clean":"2020-01-26T15:32:25.440009+0000","last_became_active":"2020-01-26T15:32:13.140946+0000","last_became_peered":"2020-01-26T15:32:13.140946+0000","last_unstale":"2020-01-26T15:32:25.440009+0000","last_undegraded":"2020-01-26T15:32:25.440009+0000","last_fullsized":"2020-01-26T15:32:25.440009+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'14","reported_seq":"27","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789836+0000","last_change":"2020-01-26T15:32:15.158464+0000","last_active":"2020-01-26T15:32:25.789836+0000","last_peered":"2020-01-26T15:32:25.789836+0000","last_clean":"2020-01-26T15:32:25.789836+0000","last_became_active":"2020-01-26T15:32:15.158051+0000","last_became_peered":"2020-01-26T15:32:15.158051+0000","last_unstale":"2020-01-26T15:32:25.789836+0000","last_undegraded":"2020-01-26T15:32:25.789836+0000","last_fullsized":"2020-01-26T15:32:25.789836+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438767+0000","last_change":"2020-01-26T15:32:15.387895+0000","last_active":"2020-01-26T15:32:25.438767+0000","last_peered":"2020-01-26T15:32:25.438767+0000","last_clean":"2020-01-26T15:32:25.438767+0000","last_became_active":"2020-01-26T15:32:15.387508+0000","last_became_peered":"2020-01-26T15:32:15.387508+0000","last_unstale":"2020-01-26T15:32:25.438767+0000","last_undegraded":"2020-01-26T15:32:25.438767+0000","last_fullsized":"2020-01-26T15:32:25.438767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439067+0000","last_change":"2020-01-26T15:32:13.146813+0000","last_active":"2020-01-26T15:32:25.439067+0000","last_peered":"2020-01-26T15:32:25.439067+0000","last_clean":"2020-01-26T15:32:25.439067+0000","last_became_active":"2020-01-26T15:32:13.146287+0000","last_became_peered":"2020-01-26T15:32:13.146287+0000","last_unstale":"2020-01-26T15:32:25.439067+0000","last_undegraded":"2020-01-26T15:32:25.439067+0000","last_fullsized":"2020-01-26T15:32:25.439067+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'4","reported_seq":"17","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438392+0000","last_change":"2020-01-26T15:32:15.156510+0000","last_active":"2020-01-26T15:32:25.438392+0000","last_peered":"2020-01-26T15:32:25.438392+0000","last_clean":"2020-01-26T15:32:25.438392+0000","last_became_active":"2020-01-26T15:32:15.156120+0000","last_became_peered":"2020-01-26T15:32:15.156120+0000","last_unstale":"2020-01-26T15:32:25.438392+0000","last_undegraded":"2020-01-26T15:32:25.438392+0000","last_fullsized":"2020-01-26T15:32:25.438392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789734+0000","last_change":"2020-01-26T15:32:15.387494+0000","last_active":"2020-01-26T15:32:25.789734+0000","last_peered":"2020-01-26T15:32:25.789734+0000","last_clean":"2020-01-26T15:32:25.789734+0000","last_became_active":"2020-01-26T15:32:15.387118+0000","last_became_peered":"2020-01-26T15:32:15.387118+0000","last_unstale":"2020-01-26T15:32:25.789734+0000","last_undegraded":"2020-01-26T15:32:25.789734+0000","last_fullsized":"2020-01-26T15:32:25.789734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438841+0000","last_change":"2020-01-26T15:32:13.142443+0000","last_active":"2020-01-26T15:32:25.438841+0000","last_peered":"2020-01-26T15:32:25.438841+0000","last_clean":"2020-01-26T15:32:25.438841+0000","last_became_active":"2020-01-26T15:32:13.141994+0000","last_became_peered":"2020-01-26T15:32:13.141994+0000","last_unstale":"2020-01-26T15:32:25.438841+0000","last_undegraded":"2020-01-26T15:32:25.438841+0000","last_fullsized":"2020-01-26T15:32:25.438841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'21","reported_seq":"34","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:47.525922+0000","last_change":"2020-01-26T15:32:15.157741+0000","last_active":"2020-01-26T15:32:47.525922+0000","last_peered":"2020-01-26T15:32:47.525922+0000","last_clean":"2020-01-26T15:32:47.525922+0000","last_became_active":"2020-01-26T15:32:15.157363+0000","last_became_peered":"2020-01-26T15:32:15.157363+0000","last_unstale":"2020-01-26T15:32:47.525922+0000","last_undegraded":"2020-01-26T15:32:47.525922+0000","last_fullsized":"2020-01-26T15:32:47.525922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2240,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439526+0000","last_change":"2020-01-26T15:32:16.389403+0000","last_active":"2020-01-26T15:32:25.439526+0000","last_peered":"2020-01-26T15:32:25.439526+0000","last_clean":"2020-01-26T15:32:25.439526+0000","last_became_active":"2020-01-26T15:32:16.389018+0000","last_became_peered":"2020-01-26T15:32:16.389018+0000","last_unstale":"2020-01-26T15:32:25.439526+0000","last_undegraded":"2020-01-26T15:32:25.439526+0000","last_fullsized":"2020-01-26T15:32:25.439526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789818+0000","last_change":"2020-01-26T15:32:13.147557+0000","last_active":"2020-01-26T15:32:25.789818+0000","last_peered":"2020-01-26T15:32:25.789818+0000","last_clean":"2020-01-26T15:32:25.789818+0000","last_became_active":"2020-01-26T15:32:13.147173+0000","last_became_peered":"2020-01-26T15:32:13.147173+0000","last_unstale":"2020-01-26T15:32:25.789818+0000","last_undegraded":"2020-01-26T15:32:25.789818+0000","last_fullsized":"2020-01-26T15:32:25.789818+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'8","reported_seq":"21","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:47.523704+0000","last_change":"2020-01-26T15:32:15.158957+0000","last_active":"2020-01-26T15:32:47.523704+0000","last_peered":"2020-01-26T15:32:47.523704+0000","last_clean":"2020-01-26T15:32:47.523704+0000","last_became_active":"2020-01-26T15:32:15.158522+0000","last_became_peered":"2020-01-26T15:32:15.158522+0000","last_unstale":"2020-01-26T15:32:47.523704+0000","last_undegraded":"2020-01-26T15:32:47.523704+0000","last_fullsized":"2020-01-26T15:32:47.523704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439408+0000","last_change":"2020-01-26T15:32:15.388882+0000","last_active":"2020-01-26T15:32:25.439408+0000","last_peered":"2020-01-26T15:32:25.439408+0000","last_clean":"2020-01-26T15:32:25.439408+0000","last_became_active":"2020-01-26T15:32:15.388539+0000","last_became_peered":"2020-01-26T15:32:15.388539+0000","last_unstale":"2020-01-26T15:32:25.439408+0000","last_undegraded":"2020-01-26T15:32:25.439408+0000","last_fullsized":"2020-01-26T15:32:25.439408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.790090+0000","last_change":"2020-01-26T15:32:13.147923+0000","last_active":"2020-01-26T15:32:25.790090+0000","last_peered":"2020-01-26T15:32:25.790090+0000","last_clean":"2020-01-26T15:32:25.790090+0000","last_became_active":"2020-01-26T15:32:13.147051+0000","last_became_peered":"2020-01-26T15:32:13.147051+0000","last_unstale":"2020-01-26T15:32:25.790090+0000","last_undegraded":"2020-01-26T15:32:25.790090+0000","last_fullsized":"2020-01-26T15:32:25.790090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'8","reported_seq":"21","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.790013+0000","last_change":"2020-01-26T15:32:15.159142+0000","last_active":"2020-01-26T15:32:25.790013+0000","last_peered":"2020-01-26T15:32:25.790013+0000","last_clean":"2020-01-26T15:32:25.790013+0000","last_became_active":"2020-01-26T15:32:15.158804+0000","last_became_peered":"2020-01-26T15:32:15.158804+0000","last_unstale":"2020-01-26T15:32:25.790013+0000","last_undegraded":"2020-01-26T15:32:25.790013+0000","last_fullsized":"2020-01-26T15:32:25.790013+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438442+0000","last_change":"2020-01-26T15:32:15.388612+0000","last_active":"2020-01-26T15:32:25.438442+0000","last_peered":"2020-01-26T15:32:25.438442+0000","last_clean":"2020-01-26T15:32:25.438442+0000","last_became_active":"2020-01-26T15:32:15.388267+0000","last_became_peered":"2020-01-26T15:32:15.388267+0000","last_unstale":"2020-01-26T15:32:25.438442+0000","last_undegraded":"2020-01-26T15:32:25.438442+0000","last_fullsized":"2020-01-26T15:32:25.438442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439532+0000","last_change":"2020-01-26T15:32:13.142563+0000","last_active":"2020-01-26T15:32:25.439532+0000","last_peered":"2020-01-26T15:32:25.439532+0000","last_clean":"2020-01-26T15:32:25.439532+0000","last_became_active":"2020-01-26T15:32:13.142168+0000","last_became_peered":"2020-01-26T15:32:13.142168+0000","last_unstale":"2020-01-26T15:32:25.439532+0000","last_undegraded":"2020-01-26T15:32:25.439532+0000","last_fullsized":"2020-01-26T15:32:25.439532+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"18'17","reported_seq":"30","reported_epoch":"18","state":"active+clean","last_fresh":"2020-01-26T15:35:10.804798+0000","last_change":"2020-01-26T15:32:15.159708+0000","last_active":"2020-01-26T15:35:10.804798+0000","last_peered":"2020-01-26T15:35:10.804798+0000","last_clean":"2020-01-26T15:35:10.804798+0000","last_became_active":"2020-01-26T15:32:15.159343+0000","last_became_peered":"2020-01-26T15:32:15.159343+0000","last_unstale":"2020-01-26T15:35:10.804798+0000","last_undegraded":"2020-01-26T15:35:10.804798+0000","last_fullsized":"2020-01-26T15:35:10.804798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049360,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322480,"statfs":{"total":96636764160,"available":95562219520,"internally_reserved":0,"allocated":786432,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049248,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322592,"statfs":{"total":96636764160,"available":95562334208,"internally_reserved":0,"allocated":671744,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049344,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322496,"statfs":{"total":96636764160,"available":95562235904,"internally_reserved":0,"allocated":770048,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"statfs":{"total":96636764160,"available":95562350592,"internally_reserved":0,"allocated":655360,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}]}} 2020-01-26T15:35:14.232 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:35:14.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 Processor -- start 2020-01-26T15:35:14.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 -- start start 2020-01-26T15:35:14.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f093805edd0 0x7f093805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:14.343 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0938098000 con 0x7f09380a6870 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093805e050 con 0x7f0938149040 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f09380a6ca0 con 0x7f093805edd0 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093ca84700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f0938149040 0x7f093814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42426/0 (socket says 172.21.15.170:42426) 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093ca84700 1 -- 172.21.15.170:0/2003744187 learned_addr learned my addr 172.21.15.170:0/2003744187 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0936d9d700 -1 --2- 172.21.15.170:0/2003744187 >> v2:172.21.15.170:6790/0 conn(0x7f093805edd0 0x7f093805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0936d9d700 1 --2- 172.21.15.170:0/2003744187 >> v2:172.21.15.170:6790/0 conn(0x7f093805edd0 0x7f093805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745896189 0 0) 0x7f0938098000 con 0x7f09380a6870 2020-01-26T15:35:14.344 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0918003230 con 0x7f09380a6870 2020-01-26T15:35:14.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827290587 0 0) 0x7f093805e050 con 0x7f0938149040 2020-01-26T15:35:14.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0938098000 con 0x7f0938149040 2020-01-26T15:35:14.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2714105625 0 0) 0x7f0918003230 con 0x7f09380a6870 2020-01-26T15:35:14.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 >> v2:172.21.15.170:6790/0 conn(0x7f093805edd0 msgr2=0x7f093805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:14.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 --2- 172.21.15.170:0/2003744187 >> v2:172.21.15.170:6790/0 conn(0x7f093805edd0 0x7f093805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.345 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 >> v1:172.21.15.170:6791/0 conn(0x7f0938149040 legacy=0x7f093814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093814ecb0 con 0x7f09380a6870 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f09280016e0 con 0x7f09380a6870 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f0928001a50 con 0x7f09380a6870 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f0935d9b700 1 -- 172.21.15.170:0/2003744187 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f0928001ec0 con 0x7f09380a6870 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.336+0000 7f093759e700 1 -- 172.21.15.170:0/2003744187 >> v1:172.21.15.170:6790/0 conn(0x7f09380a6870 legacy=0x7f093807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 -- 172.21.15.170:0/2003744187 shutdown_connections 2020-01-26T15:35:14.346 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 --2- 172.21.15.170:0/2003744187 >> v2:172.21.15.170:6790/0 conn(0x7f093805edd0 0x7f093805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.347 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 -- 172.21.15.170:0/2003744187 >> 172.21.15.170:0/2003744187 conn(0x7f0938098e70 msgr2=0x7f09380a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.347 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 -- 172.21.15.170:0/2003744187 shutdown_connections 2020-01-26T15:35:14.347 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 -- 172.21.15.170:0/2003744187 wait complete. 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 Processor -- start 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.340+0000 7f093759e700 1 -- start start 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0938122a50 0x7f093813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093809fee0 con 0x7f09381224d0 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0938122e80 con 0x7f093809fab0 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0938121850 con 0x7f0938122a50 2020-01-26T15:35:14.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093659c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f093809fab0 0x7f09380a4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47304/0 (socket says 172.21.15.170:47304) 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093659c700 1 -- 172.21.15.170:0/1557618541 learned_addr learned my addr 172.21.15.170:0/1557618541 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093ca84700 -1 --2- 172.21.15.170:0/1557618541 >> v2:172.21.15.170:6791/0 conn(0x7f0938122a50 0x7f093813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093ca84700 1 --2- 172.21.15.170:0/1557618541 >> v2:172.21.15.170:6791/0 conn(0x7f0938122a50 0x7f093813b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891794398 0 0) 0x7f0938122e80 con 0x7f093809fab0 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0910003230 con 0x7f093809fab0 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341723169 0 0) 0x7f093809fee0 con 0x7f09381224d0 2020-01-26T15:35:14.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0938122e80 con 0x7f09381224d0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3939381662 0 0) 0x7f0910003230 con 0x7f093809fab0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f093809fee0 con 0x7f093809fab0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f0928001bf0 con 0x7f093809fab0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3623383028 0 0) 0x7f0938122e80 con 0x7f09381224d0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0910003230 con 0x7f09381224d0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f09300019f0 con 0x7f09381224d0 2020-01-26T15:35:14.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 708902176 0 0) 0x7f0910003230 con 0x7f09381224d0 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 >> v2:172.21.15.170:6791/0 conn(0x7f0938122a50 msgr2=0x7f093813b7a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 --2- 172.21.15.170:0/1557618541 >> v2:172.21.15.170:6791/0 conn(0x7f0938122a50 0x7f093813b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 >> v1:172.21.15.170:6790/0 conn(0x7f093809fab0 legacy=0x7f09380a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938121e50 con 0x7f09381224d0 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093809e200 con 0x7f09381224d0 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f093813bcf0 con 0x7f09381224d0 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f0930001bf0 con 0x7f09381224d0 2020-01-26T15:35:14.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f0930001fa0 con 0x7f09381224d0 2020-01-26T15:35:14.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f09300021a0 con 0x7f09381224d0 2020-01-26T15:35:14.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0938056600 con 0x7f09381224d0 2020-01-26T15:35:14.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.344+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f093004bad0 con 0x7f09381224d0 2020-01-26T15:35:14.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.356+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f0930031210 con 0x7f09381224d0 2020-01-26T15:35:14.469 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.468+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 --> v1:172.21.15.170:6800/17396 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f093809e470 con 0x7f091003e430 2020-01-26T15:35:14.474 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.472+0000 7f092f7fe700 1 -- 172.21.15.170:0/1557618541 <== mgr.64101 v1:172.21.15.170:6800/17396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63258 (unknown 2965378022 0 2077888211) 0x7f093809e470 con 0x7f091003e430 2020-01-26T15:35:14.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:14.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.472+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 >> v1:172.21.15.170:6800/17396 conn(0x7f091003e430 legacy=0x7f0910040940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.472+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 >> v1:172.21.15.170:6789/0 conn(0x7f09381224d0 legacy=0x7f09380a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.476+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 shutdown_connections 2020-01-26T15:35:14.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.476+0000 7f093759e700 1 --2- 172.21.15.170:0/1557618541 >> v2:172.21.15.170:6791/0 conn(0x7f0938122a50 0x7f093813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.476+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 >> 172.21.15.170:0/1557618541 conn(0x7f0938098e10 msgr2=0x7f093807f250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.476+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 shutdown_connections 2020-01-26T15:35:14.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.476+0000 7f093759e700 1 -- 172.21.15.170:0/1557618541 wait complete. 2020-01-26T15:35:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2020-01-26T15:35:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2020-01-26T15:35:12.746871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4197184,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290176,"statfs":{"total":386547056640,"available":382249140224,"internally_reserved":0,"allocated":2883584,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.991810"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789798+0000","last_change":"2020-01-26T15:32:15.388125+0000","last_active":"2020-01-26T15:32:25.789798+0000","last_peered":"2020-01-26T15:32:25.789798+0000","last_clean":"2020-01-26T15:32:25.789798+0000","last_became_active":"2020-01-26T15:32:15.387793+0000","last_became_peered":"2020-01-26T15:32:15.387793+0000","last_unstale":"2020-01-26T15:32:25.789798+0000","last_undegraded":"2020-01-26T15:32:25.789798+0000","last_fullsized":"2020-01-26T15:32:25.789798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438483+0000","last_change":"2020-01-26T15:32:13.141863+0000","last_active":"2020-01-26T15:32:25.438483+0000","last_peered":"2020-01-26T15:32:25.438483+0000","last_clean":"2020-01-26T15:32:25.438483+0000","last_became_active":"2020-01-26T15:32:13.141432+0000","last_became_peered":"2020-01-26T15:32:13.141432+0000","last_unstale":"2020-01-26T15:32:25.438483+0000","last_undegraded":"2020-01-26T15:32:25.438483+0000","last_fullsized":"2020-01-26T15:32:25.438483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'8","reported_seq":"21","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:42.509755+0000","last_change":"2020-01-26T15:32:15.160060+0000","last_active":"2020-01-26T15:32:42.509755+0000","last_peered":"2020-01-26T15:32:42.509755+0000","last_clean":"2020-01-26T15:32:42.509755+0000","last_became_active":"2020-01-26T15:32:15.159093+0000","last_became_peered":"2020-01-26T15:32:15.159093+0000","last_unstale":"2020-01-26T15:32:42.509755+0000","last_undegraded":"2020-01-26T15:32:42.509755+0000","last_fullsized":"2020-01-26T15:32:42.509755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439116+0000","last_change":"2020-01-26T15:32:16.391402+0000","last_active":"2020-01-26T15:32:25.439116+0000","last_peered":"2020-01-26T15:32:25.439116+0000","last_clean":"2020-01-26T15:32:25.439116+0000","last_became_active":"2020-01-26T15:32:16.390999+0000","last_became_peered":"2020-01-26T15:32:16.390999+0000","last_unstale":"2020-01-26T15:32:25.439116+0000","last_undegraded":"2020-01-26T15:32:25.439116+0000","last_fullsized":"2020-01-26T15:32:25.439116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789827+0000","last_change":"2020-01-26T15:32:13.147209+0000","last_active":"2020-01-26T15:32:25.789827+0000","last_peered":"2020-01-26T15:32:25.789827+0000","last_clean":"2020-01-26T15:32:25.789827+0000","last_became_active":"2020-01-26T15:32:13.146844+0000","last_became_peered":"2020-01-26T15:32:13.146844+0000","last_unstale":"2020-01-26T15:32:25.789827+0000","last_undegraded":"2020-01-26T15:32:25.789827+0000","last_fullsized":"2020-01-26T15:32:25.789827+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"17'16","reported_seq":"29","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:52.525707+0000","last_change":"2020-01-26T15:32:15.160486+0000","last_active":"2020-01-26T15:32:52.525707+0000","last_peered":"2020-01-26T15:32:52.525707+0000","last_clean":"2020-01-26T15:32:52.525707+0000","last_became_active":"2020-01-26T15:32:15.160031+0000","last_became_peered":"2020-01-26T15:32:15.160031+0000","last_unstale":"2020-01-26T15:32:52.525707+0000","last_undegraded":"2020-01-26T15:32:52.525707+0000","last_fullsized":"2020-01-26T15:32:52.525707+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":656,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438898+0000","last_change":"2020-01-26T15:32:16.389450+0000","last_active":"2020-01-26T15:32:25.438898+0000","last_peered":"2020-01-26T15:32:25.438898+0000","last_clean":"2020-01-26T15:32:25.438898+0000","last_became_active":"2020-01-26T15:32:16.389078+0000","last_became_peered":"2020-01-26T15:32:16.389078+0000","last_unstale":"2020-01-26T15:32:25.438898+0000","last_undegraded":"2020-01-26T15:32:25.438898+0000","last_fullsized":"2020-01-26T15:32:25.438898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.440009+0000","last_change":"2020-01-26T15:32:13.141343+0000","last_active":"2020-01-26T15:32:25.440009+0000","last_peered":"2020-01-26T15:32:25.440009+0000","last_clean":"2020-01-26T15:32:25.440009+0000","last_became_active":"2020-01-26T15:32:13.140946+0000","last_became_peered":"2020-01-26T15:32:13.140946+0000","last_unstale":"2020-01-26T15:32:25.440009+0000","last_undegraded":"2020-01-26T15:32:25.440009+0000","last_fullsized":"2020-01-26T15:32:25.440009+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'14","reported_seq":"27","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789836+0000","last_change":"2020-01-26T15:32:15.158464+0000","last_active":"2020-01-26T15:32:25.789836+0000","last_peered":"2020-01-26T15:32:25.789836+0000","last_clean":"2020-01-26T15:32:25.789836+0000","last_became_active":"2020-01-26T15:32:15.158051+0000","last_became_peered":"2020-01-26T15:32:15.158051+0000","last_unstale":"2020-01-26T15:32:25.789836+0000","last_undegraded":"2020-01-26T15:32:25.789836+0000","last_fullsized":"2020-01-26T15:32:25.789836+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438767+0000","last_change":"2020-01-26T15:32:15.387895+0000","last_active":"2020-01-26T15:32:25.438767+0000","last_peered":"2020-01-26T15:32:25.438767+0000","last_clean":"2020-01-26T15:32:25.438767+0000","last_became_active":"2020-01-26T15:32:15.387508+0000","last_became_peered":"2020-01-26T15:32:15.387508+0000","last_unstale":"2020-01-26T15:32:25.438767+0000","last_undegraded":"2020-01-26T15:32:25.438767+0000","last_fullsized":"2020-01-26T15:32:25.438767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439067+0000","last_change":"2020-01-26T15:32:13.146813+0000","last_active":"2020-01-26T15:32:25.439067+0000","last_peered":"2020-01-26T15:32:25.439067+0000","last_clean":"2020-01-26T15:32:25.439067+0000","last_became_active":"2020-01-26T15:32:13.146287+0000","last_became_peered":"2020-01-26T15:32:13.146287+0000","last_unstale":"2020-01-26T15:32:25.439067+0000","last_undegraded":"2020-01-26T15:32:25.439067+0000","last_fullsized":"2020-01-26T15:32:25.439067+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'4","reported_seq":"17","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438392+0000","last_change":"2020-01-26T15:32:15.156510+0000","last_active":"2020-01-26T15:32:25.438392+0000","last_peered":"2020-01-26T15:32:25.438392+0000","last_clean":"2020-01-26T15:32:25.438392+0000","last_became_active":"2020-01-26T15:32:15.156120+0000","last_became_peered":"2020-01-26T15:32:15.156120+0000","last_unstale":"2020-01-26T15:32:25.438392+0000","last_undegraded":"2020-01-26T15:32:25.438392+0000","last_fullsized":"2020-01-26T15:32:25.438392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789734+0000","last_change":"2020-01-26T15:32:15.387494+0000","last_active":"2020-01-26T15:32:25.789734+0000","last_peered":"2020-01-26T15:32:25.789734+0000","last_clean":"2020-01-26T15:32:25.789734+0000","last_became_active":"2020-01-26T15:32:15.387118+0000","last_became_peered":"2020-01-26T15:32:15.387118+0000","last_unstale":"2020-01-26T15:32:25.789734+0000","last_undegraded":"2020-01-26T15:32:25.789734+0000","last_fullsized":"2020-01-26T15:32:25.789734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438841+0000","last_change":"2020-01-26T15:32:13.142443+0000","last_active":"2020-01-26T15:32:25.438841+0000","last_peered":"2020-01-26T15:32:25.438841+0000","last_clean":"2020-01-26T15:32:25.438841+0000","last_became_active":"2020-01-26T15:32:13.141994+0000","last_became_peered":"2020-01-26T15:32:13.141994+0000","last_unstale":"2020-01-26T15:32:25.438841+0000","last_undegraded":"2020-01-26T15:32:25.438841+0000","last_fullsized":"2020-01-26T15:32:25.438841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'21","reported_seq":"34","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:47.525922+0000","last_change":"2020-01-26T15:32:15.157741+0000","last_active":"2020-01-26T15:32:47.525922+0000","last_peered":"2020-01-26T15:32:47.525922+0000","last_clean":"2020-01-26T15:32:47.525922+0000","last_became_active":"2020-01-26T15:32:15.157363+0000","last_became_peered":"2020-01-26T15:32:15.157363+0000","last_unstale":"2020-01-26T15:32:47.525922+0000","last_undegraded":"2020-01-26T15:32:47.525922+0000","last_fullsized":"2020-01-26T15:32:47.525922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2240,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439526+0000","last_change":"2020-01-26T15:32:16.389403+0000","last_active":"2020-01-26T15:32:25.439526+0000","last_peered":"2020-01-26T15:32:25.439526+0000","last_clean":"2020-01-26T15:32:25.439526+0000","last_became_active":"2020-01-26T15:32:16.389018+0000","last_became_peered":"2020-01-26T15:32:16.389018+0000","last_unstale":"2020-01-26T15:32:25.439526+0000","last_undegraded":"2020-01-26T15:32:25.439526+0000","last_fullsized":"2020-01-26T15:32:25.439526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.789818+0000","last_change":"2020-01-26T15:32:13.147557+0000","last_active":"2020-01-26T15:32:25.789818+0000","last_peered":"2020-01-26T15:32:25.789818+0000","last_clean":"2020-01-26T15:32:25.789818+0000","last_became_active":"2020-01-26T15:32:13.147173+0000","last_became_peered":"2020-01-26T15:32:13.147173+0000","last_unstale":"2020-01-26T15:32:25.789818+0000","last_undegraded":"2020-01-26T15:32:25.789818+0000","last_fullsized":"2020-01-26T15:32:25.789818+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'8","reported_seq":"21","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:47.523704+0000","last_change":"2020-01-26T15:32:15.158957+0000","last_active":"2020-01-26T15:32:47.523704+0000","last_peered":"2020-01-26T15:32:47.523704+0000","last_clean":"2020-01-26T15:32:47.523704+0000","last_became_active":"2020-01-26T15:32:15.158522+0000","last_became_peered":"2020-01-26T15:32:15.158522+0000","last_unstale":"2020-01-26T15:32:47.523704+0000","last_undegraded":"2020-01-26T15:32:47.523704+0000","last_fullsized":"2020-01-26T15:32:47.523704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439408+0000","last_change":"2020-01-26T15:32:15.388882+0000","last_active":"2020-01-26T15:32:25.439408+0000","last_peered":"2020-01-26T15:32:25.439408+0000","last_clean":"2020-01-26T15:32:25.439408+0000","last_became_active":"2020-01-26T15:32:15.388539+0000","last_became_peered":"2020-01-26T15:32:15.388539+0000","last_unstale":"2020-01-26T15:32:25.439408+0000","last_undegraded":"2020-01-26T15:32:25.439408+0000","last_fullsized":"2020-01-26T15:32:25.439408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.790090+0000","last_change":"2020-01-26T15:32:13.147923+0000","last_active":"2020-01-26T15:32:25.790090+0000","last_peered":"2020-01-26T15:32:25.790090+0000","last_clean":"2020-01-26T15:32:25.790090+0000","last_became_active":"2020-01-26T15:32:13.147051+0000","last_became_peered":"2020-01-26T15:32:13.147051+0000","last_unstale":"2020-01-26T15:32:25.790090+0000","last_undegraded":"2020-01-26T15:32:25.790090+0000","last_fullsized":"2020-01-26T15:32:25.790090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'8","reported_seq":"21","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.790013+0000","last_change":"2020-01-26T15:32:15.159142+0000","last_active":"2020-01-26T15:32:25.790013+0000","last_peered":"2020-01-26T15:32:25.790013+0000","last_clean":"2020-01-26T15:32:25.790013+0000","last_became_active":"2020-01-26T15:32:15.158804+0000","last_became_peered":"2020-01-26T15:32:15.158804+0000","last_unstale":"2020-01-26T15:32:25.790013+0000","last_undegraded":"2020-01-26T15:32:25.790013+0000","last_fullsized":"2020-01-26T15:32:25.790013+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.438442+0000","last_change":"2020-01-26T15:32:15.388612+0000","last_active":"2020-01-26T15:32:25.438442+0000","last_peered":"2020-01-26T15:32:25.438442+0000","last_clean":"2020-01-26T15:32:25.438442+0000","last_became_active":"2020-01-26T15:32:15.388267+0000","last_became_peered":"2020-01-26T15:32:15.388267+0000","last_unstale":"2020-01-26T15:32:25.438442+0000","last_undegraded":"2020-01-26T15:32:25.438442+0000","last_fullsized":"2020-01-26T15:32:25.438442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:32:25.439532+0000","last_change":"2020-01-26T15:32:13.142563+0000","last_active":"2020-01-26T15:32:25.439532+0000","last_peered":"2020-01-26T15:32:25.439532+0000","last_clean":"2020-01-26T15:32:25.439532+0000","last_became_active":"2020-01-26T15:32:13.142168+0000","last_became_peered":"2020-01-26T15:32:13.142168+0000","last_unstale":"2020-01-26T15:32:25.439532+0000","last_undegraded":"2020-01-26T15:32:25.439532+0000","last_fullsized":"2020-01-26T15:32:25.439532+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"18'17","reported_seq":"30","reported_epoch":"18","state":"active+clean","last_fresh":"2020-01-26T15:35:10.804798+0000","last_change":"2020-01-26T15:32:15.159708+0000","last_active":"2020-01-26T15:35:10.804798+0000","last_peered":"2020-01-26T15:35:10.804798+0000","last_clean":"2020-01-26T15:35:10.804798+0000","last_became_active":"2020-01-26T15:32:15.159343+0000","last_became_peered":"2020-01-26T15:32:15.159343+0000","last_unstale":"2020-01-26T15:35:10.804798+0000","last_undegraded":"2020-01-26T15:35:10.804798+0000","last_fullsized":"2020-01-26T15:35:10.804798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049360,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322480,"statfs":{"total":96636764160,"available":95562219520,"internally_reserved":0,"allocated":786432,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049248,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322592,"statfs":{"total":96636764160,"available":95562334208,"internally_reserved":0,"allocated":671744,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049344,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322496,"statfs":{"total":96636764160,"available":95562235904,"internally_reserved":0,"allocated":770048,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"statfs":{"total":96636764160,"available":95562350592,"internally_reserved":0,"allocated":655360,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}]}} 2020-01-26T15:35:14.497 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-26T15:35:14.498 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-26T15:35:14.498 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-26T15:35:14.498 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:14.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 Processor -- start 2020-01-26T15:35:14.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- start start 2020-01-26T15:35:14.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcad805e5f0 0x7fcad80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80a6dc0 con 0x7fcad805edd0 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad805ea20 con 0x7fcad8149040 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8098000 con 0x7fcad805e5f0 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad77fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcad805e5f0 0x7fcad80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad77fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcad805e5f0 0x7fcad80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad7fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fcad805edd0 0x7fcad807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50434/0 (socket says 172.21.15.170:50434) 2020-01-26T15:35:14.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad7fff700 1 -- 172.21.15.170:0/2938548298 learned_addr learned my addr 172.21.15.170:0/2938548298 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadde5b700 1 --1- 172.21.15.170:0/2938548298 >> v1:172.21.15.170:6790/0 conn(0x7fcad8149040 0x7fcad814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47314/0 (socket says 172.21.15.170:47314) 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137856239 0 0) 0x7fcad80a6dc0 con 0x7fcad805edd0 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac4003230 con 0x7fcad805edd0 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348765500 0 0) 0x7fcad805ea20 con 0x7fcad8149040 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad80a6dc0 con 0x7fcad8149040 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3607969249 0 0) 0x7fcac4003230 con 0x7fcad805edd0 2020-01-26T15:35:14.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 >> v2:172.21.15.170:6790/0 conn(0x7fcad805e5f0 msgr2=0x7fcad80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:14.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 --2- 172.21.15.170:0/2938548298 >> v2:172.21.15.170:6790/0 conn(0x7fcad805e5f0 0x7fcad80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 >> v1:172.21.15.170:6790/0 conn(0x7fcad8149040 legacy=0x7fcad814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad805e050 con 0x7fcad805edd0 2020-01-26T15:35:14.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fcac80016e0 con 0x7fcad805edd0 2020-01-26T15:35:14.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fcac8001980 con 0x7fcad805edd0 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcad6ffd700 1 -- 172.21.15.170:0/2938548298 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fcac80045b0 con 0x7fcad805edd0 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- 172.21.15.170:0/2938548298 >> v1:172.21.15.170:6789/0 conn(0x7fcad805edd0 legacy=0x7fcad807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- 172.21.15.170:0/2938548298 shutdown_connections 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 --2- 172.21.15.170:0/2938548298 >> v2:172.21.15.170:6790/0 conn(0x7fcad805e5f0 0x7fcad80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- 172.21.15.170:0/2938548298 >> 172.21.15.170:0/2938548298 conn(0x7fcad8098e70 msgr2=0x7fcad80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- 172.21.15.170:0/2938548298 shutdown_connections 2020-01-26T15:35:14.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- 172.21.15.170:0/2938548298 wait complete. 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 Processor -- start 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.604+0000 7fcadcbf9700 1 -- start start 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fcad80a3580 0x7fcad81335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcad8133b40 0x7fcad8133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80a1fc0 con 0x7fcad80a3070 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8120a30 con 0x7fcad8133b40 2020-01-26T15:35:14.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fcad809f630 con 0x7fcad80a3580 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad77fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fcad80a3580 0x7fcad81335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadde5b700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcad8133b40 0x7fcad8133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad77fe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fcad80a3580 0x7fcad81335f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadde5b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcad8133b40 0x7fcad8133f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad7fff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fcad80a3070 0x7fcad809ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47320/0 (socket says 172.21.15.170:47320) 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad7fff700 1 -- 172.21.15.170:0/3019944762 learned_addr learned my addr 172.21.15.170:0/3019944762 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844413618 0 0) 0x7fcad80a1fc0 con 0x7fcad80a3070 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc003230 con 0x7fcad80a3070 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2062000613 0 0) 0x7fcabc003230 con 0x7fcad80a3070 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcad80a1fc0 con 0x7fcad80a3070 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fcac8001a70 con 0x7fcad80a3070 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1729875077 0 0) 0x7fcad80a1fc0 con 0x7fcad80a3070 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 >> v2:172.21.15.170:6791/0 conn(0x7fcad80a3580 msgr2=0x7fcad81335f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:14.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 --2- 172.21.15.170:0/3019944762 >> v2:172.21.15.170:6791/0 conn(0x7fcad80a3580 0x7fcad81335f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 >> v2:172.21.15.170:6790/0 conn(0x7fcad8133b40 msgr2=0x7fcad8133f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 --2- 172.21.15.170:0/3019944762 >> v2:172.21.15.170:6790/0 conn(0x7fcad8133b40 0x7fcad8133f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad809e1c0 con 0x7fcad80a3070 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad813ad10 con 0x7fcad80a3070 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad813b1e0 con 0x7fcad80a3070 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fcac80048a0 con 0x7fcad80a3070 2020-01-26T15:35:14.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fcac8004c90 con 0x7fcad80a3070 2020-01-26T15:35:14.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fcac8004e90 con 0x7fcad80a3070 2020-01-26T15:35:14.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0003360 con 0x7fcad80a3070 2020-01-26T15:35:14.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.608+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7fcac804b950 con 0x7fcad80a3070 2020-01-26T15:35:14.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.616+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fcac8031090 con 0x7fcad80a3070 2020-01-26T15:35:14.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.776+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcab00037d0 con 0x7fcad80a3070 2020-01-26T15:35:14.782 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcad4ff9700 1 -- 172.21.15.170:0/3019944762 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (unknown 3730786198 0 3397129104) 0x7fcac804a780 con 0x7fcad80a3070 2020-01-26T15:35:14.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:14.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 >> v1:172.21.15.170:6800/17396 conn(0x7fcabc03e020 legacy=0x7fcabc040530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 >> v1:172.21.15.170:6790/0 conn(0x7fcad80a3070 legacy=0x7fcad809ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 shutdown_connections 2020-01-26T15:35:14.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 --2- 172.21.15.170:0/3019944762 >> v2:172.21.15.170:6790/0 conn(0x7fcad8133b40 0x7fcad8133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 --2- 172.21.15.170:0/3019944762 >> v2:172.21.15.170:6791/0 conn(0x7fcad80a3580 0x7fcad81335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.784 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 >> 172.21.15.170:0/3019944762 conn(0x7fcad8098e10 msgr2=0x7fcad80a4690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 shutdown_connections 2020-01-26T15:35:14.785 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.780+0000 7fcadcbf9700 1 -- 172.21.15.170:0/3019944762 wait complete. 2020-01-26T15:35:14.795 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-01-26T15:35:14.795 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-01-26T15:35:14.795 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:14.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70759e700 1 Processor -- start 2020-01-26T15:35:14.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70759e700 1 -- start start 2020-01-26T15:35:14.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70759e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70805ea20 con 0x7ff70805edd0 2020-01-26T15:35:14.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70759e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff708098000 con 0x7ff70805e5f0 2020-01-26T15:35:14.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70759e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70805e050 con 0x7ff7080a6870 2020-01-26T15:35:14.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70659c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff70805e5f0 0x7ff708149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47326/0 (socket says 172.21.15.170:47326) 2020-01-26T15:35:14.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70659c700 1 -- 172.21.15.170:0/3889090320 learned_addr learned my addr 172.21.15.170:0/3889090320 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff706d9d700 1 --1- 172.21.15.170:0/3889090320 >> v1:172.21.15.170:6789/0 conn(0x7ff70805edd0 0x7ff70807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50448/0 (socket says 172.21.15.170:50448) 2020-01-26T15:35:14.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010874643 0 0) 0x7ff70805ea20 con 0x7ff70805edd0 2020-01-26T15:35:14.904 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e8003230 con 0x7ff70805edd0 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900231056 0 0) 0x7ff70805e050 con 0x7ff7080a6870 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff70805ea20 con 0x7ff7080a6870 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622225407 0 0) 0x7ff708098000 con 0x7ff70805e5f0 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff70805e050 con 0x7ff70805e5f0 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1540290018 0 0) 0x7ff6e8003230 con 0x7ff70805edd0 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 >> v1:172.21.15.170:6791/0 conn(0x7ff7080a6870 legacy=0x7ff70814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 >> v1:172.21.15.170:6790/0 conn(0x7ff70805e5f0 legacy=0x7ff708149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080a6ca0 con 0x7ff70805edd0 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff6f00016e0 con 0x7ff70805edd0 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff6f0001a50 con 0x7ff70805edd0 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff705d9b700 1 -- 172.21.15.170:0/3889090320 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff6f00044f0 con 0x7ff70805edd0 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.896+0000 7ff70759e700 1 -- 172.21.15.170:0/3889090320 >> v1:172.21.15.170:6789/0 conn(0x7ff70805edd0 legacy=0x7ff70807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- 172.21.15.170:0/3889090320 shutdown_connections 2020-01-26T15:35:14.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- 172.21.15.170:0/3889090320 >> 172.21.15.170:0/3889090320 conn(0x7ff708098e70 msgr2=0x7ff7080a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:14.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- 172.21.15.170:0/3889090320 shutdown_connections 2020-01-26T15:35:14.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- 172.21.15.170:0/3889090320 wait complete. 2020-01-26T15:35:14.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 Processor -- start 2020-01-26T15:35:14.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- start start 2020-01-26T15:35:14.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff7080a15d0 0x7ff708120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:14.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70811f680 con 0x7ff708121a20 2020-01-26T15:35:14.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff708139b20 con 0x7ff708131340 2020-01-26T15:35:14.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70759e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff70811f080 con 0x7ff7080a15d0 2020-01-26T15:35:14.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff706d9d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff708121a20 0x7ff708130b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50454/0 (socket says 172.21.15.170:50454) 2020-01-26T15:35:14.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff706d9d700 1 -- 172.21.15.170:0/4235631367 learned_addr learned my addr 172.21.15.170:0/4235631367 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:14.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70659c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff708131340 0x7ff708120290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47334/0 (socket says 172.21.15.170:47334) 2020-01-26T15:35:14.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70cf7f700 -1 --2- 172.21.15.170:0/4235631367 >> v2:172.21.15.170:6790/0 conn(0x7ff7080a15d0 0x7ff708120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:14.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.900+0000 7ff70cf7f700 1 --2- 172.21.15.170:0/4235631367 >> v2:172.21.15.170:6790/0 conn(0x7ff7080a15d0 0x7ff708120a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:14.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311352638 0 0) 0x7ff70811f680 con 0x7ff708121a20 2020-01-26T15:35:14.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e0003230 con 0x7ff708121a20 2020-01-26T15:35:14.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943633796 0 0) 0x7ff708139b20 con 0x7ff708131340 2020-01-26T15:35:14.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff70811f680 con 0x7ff708131340 2020-01-26T15:35:14.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4228676268 0 0) 0x7ff6e0003230 con 0x7ff708121a20 2020-01-26T15:35:14.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff708139b20 con 0x7ff708121a20 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1379882967 0 0) 0x7ff70811f680 con 0x7ff708131340 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6e0003230 con 0x7ff708131340 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff6f00019b0 con 0x7ff708121a20 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff700001a00 con 0x7ff708131340 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2335565152 0 0) 0x7ff708139b20 con 0x7ff708121a20 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 >> v2:172.21.15.170:6790/0 conn(0x7ff7080a15d0 msgr2=0x7ff708120a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 --2- 172.21.15.170:0/4235631367 >> v2:172.21.15.170:6790/0 conn(0x7ff7080a15d0 0x7ff708120a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 >> v1:172.21.15.170:6790/0 conn(0x7ff708131340 legacy=0x7ff708120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:14.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708067b30 con 0x7ff708121a20 2020-01-26T15:35:14.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff708139d50 con 0x7ff708121a20 2020-01-26T15:35:14.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70813a2d0 con 0x7ff708121a20 2020-01-26T15:35:14.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff6f0001230 con 0x7ff708121a20 2020-01-26T15:35:14.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff6f0004bf0 con 0x7ff708121a20 2020-01-26T15:35:14.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7ff6f0010630 con 0x7ff708121a20 2020-01-26T15:35:14.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7ff6f004b840 con 0x7ff708121a20 2020-01-26T15:35:14.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.904+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e4003360 con 0x7ff708121a20 2020-01-26T15:35:14.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:14.912+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7ff6f00310a0 con 0x7ff708121a20 2020-01-26T15:35:15.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.028+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e40037e0 con 0x7ff708121a20 2020-01-26T15:35:15.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff6ff7fe700 1 -- 172.21.15.170:0/4235631367 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+8949 (unknown 3338201251 0 1949082715) 0x7ff6f0031c50 con 0x7ff708121a20 2020-01-26T15:35:15.035 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:15.035 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":18,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:10.598379+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":11354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":11354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":11354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":11354}]},"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":11357}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":11357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":11357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":11357}]},"public_addr":"172.21.15.170:6809/11357","cluster_addr":"172.21.15.170:6810/11357","heartbeat_back_addr":"172.21.15.170:6811/11357","heartbeat_front_addr":"172.21.15.170:6812/11357","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":11355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":11355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":11355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":11355}]},"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":11358}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":11358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":11358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":11358}]},"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:15.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 >> v1:172.21.15.170:6800/17396 conn(0x7ff6e003e3b0 legacy=0x7ff6e00408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 >> v1:172.21.15.170:6789/0 conn(0x7ff708121a20 legacy=0x7ff708130b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 shutdown_connections 2020-01-26T15:35:15.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 --2- 172.21.15.170:0/4235631367 >> v2:172.21.15.170:6790/0 conn(0x7ff7080a15d0 0x7ff708120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:15.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 >> 172.21.15.170:0/4235631367 conn(0x7ff708097e90 msgr2=0x7ff708124310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 shutdown_connections 2020-01-26T15:35:15.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.032+0000 7ff70759e700 1 -- 172.21.15.170:0/4235631367 wait complete. 2020-01-26T15:35:15.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26T15:32:11.534039+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'warn', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26T15:32:14.037219+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'warn', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26T15:32:14.435582+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'warn', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:35:15.055 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:35:15.173 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 Processor -- start 2020-01-26T15:35:15.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- start start 2020-01-26T15:35:15.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd968066310 con 0x7fd9680a78a0 2020-01-26T15:35:15.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd968025350 con 0x7fd96814a160 2020-01-26T15:35:15.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96814fdd0 con 0x7fd96807fd70 2020-01-26T15:35:15.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96759e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd9680a78a0 0x7fd968097880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50462/0 (socket says 172.21.15.170:50462) 2020-01-26T15:35:15.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96759e700 1 -- 172.21.15.170:0/2788723877 learned_addr learned my addr 172.21.15.170:0/2788723877 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852762507 0 0) 0x7fd968066310 con 0x7fd9680a78a0 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd954003230 con 0x7fd9680a78a0 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387160169 0 0) 0x7fd96814fdd0 con 0x7fd96807fd70 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd968066310 con 0x7fd96807fd70 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533263255 0 0) 0x7fd968025350 con 0x7fd96814a160 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd96814fdd0 con 0x7fd96814a160 2020-01-26T15:35:15.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1910300138 0 0) 0x7fd954003230 con 0x7fd9680a78a0 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 >> v1:172.21.15.170:6791/0 conn(0x7fd96807fd70 legacy=0x7fd9680a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 >> v1:172.21.15.170:6790/0 conn(0x7fd96814a160 legacy=0x7fd96814c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968151010 con 0x7fd9680a78a0 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fd960001a60 con 0x7fd9680a78a0 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fd960001dd0 con 0x7fd9680a78a0 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96659c700 1 -- 172.21.15.170:0/2788723877 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fd960004930 con 0x7fd9680a78a0 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- 172.21.15.170:0/2788723877 >> v1:172.21.15.170:6789/0 conn(0x7fd9680a78a0 legacy=0x7fd968097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- 172.21.15.170:0/2788723877 shutdown_connections 2020-01-26T15:35:15.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- 172.21.15.170:0/2788723877 >> 172.21.15.170:0/2788723877 conn(0x7fd968099260 msgr2=0x7fd96805f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- 172.21.15.170:0/2788723877 shutdown_connections 2020-01-26T15:35:15.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.168+0000 7fd96c96a700 1 -- 172.21.15.170:0/2788723877 wait complete. 2020-01-26T15:35:15.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 Processor -- start 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 -- start start 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fd96807ba60 0x7fd96815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96809d650 con 0x7fd9680636b0 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd968144ae0 con 0x7fd96809d220 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd9681452a0 con 0x7fd96807ba60 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96759e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fd96809d220 0x7fd968062eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42470/0 (socket says 172.21.15.170:42470) 2020-01-26T15:35:15.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96759e700 1 -- 172.21.15.170:0/80560685 learned_addr learned my addr 172.21.15.170:0/80560685 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96d16b700 -1 --2- 172.21.15.170:0/80560685 >> v2:172.21.15.170:6791/0 conn(0x7fd96807ba60 0x7fd96815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96d16b700 1 --2- 172.21.15.170:0/80560685 >> v2:172.21.15.170:6791/0 conn(0x7fd96807ba60 0x7fd96815b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814087417 0 0) 0x7fd96809d650 con 0x7fd9680636b0 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c003230 con 0x7fd9680636b0 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158782813 0 0) 0x7fd968144ae0 con 0x7fd96809d220 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd96809d650 con 0x7fd96809d220 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 703970415 0 0) 0x7fd94c003230 con 0x7fd9680636b0 2020-01-26T15:35:15.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd968144ae0 con 0x7fd9680636b0 2020-01-26T15:35:15.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fd950001860 con 0x7fd9680636b0 2020-01-26T15:35:15.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4294225380 0 0) 0x7fd96809d650 con 0x7fd96809d220 2020-01-26T15:35:15.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd94c003230 con 0x7fd96809d220 2020-01-26T15:35:15.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fd960001f70 con 0x7fd96809d220 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1924720145 0 0) 0x7fd968144ae0 con 0x7fd9680636b0 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 >> v2:172.21.15.170:6791/0 conn(0x7fd96807ba60 msgr2=0x7fd96815b8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 --2- 172.21.15.170:0/80560685 >> v2:172.21.15.170:6791/0 conn(0x7fd96807ba60 0x7fd96815b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 >> v1:172.21.15.170:6791/0 conn(0x7fd96809d220 legacy=0x7fd968062eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96809c280 con 0x7fd9680636b0 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96807be90 con 0x7fd9680636b0 2020-01-26T15:35:15.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9680603c0 con 0x7fd9680636b0 2020-01-26T15:35:15.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fd950001db0 con 0x7fd9680636b0 2020-01-26T15:35:15.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.172+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fd9500021e0 con 0x7fd9680636b0 2020-01-26T15:35:15.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.176+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96809d880 con 0x7fd9680636b0 2020-01-26T15:35:15.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.176+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fd950002460 con 0x7fd9680636b0 2020-01-26T15:35:15.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.176+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7fd950049070 con 0x7fd9680636b0 2020-01-26T15:35:15.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.180+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fd95002e790 con 0x7fd9680636b0 2020-01-26T15:35:15.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd968056600 con 0x7fd9680636b0 2020-01-26T15:35:15.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd95ffff700 1 -- 172.21.15.170:0/80560685 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (unknown 1614612280 0 265718887) 0x7fd950047ee0 con 0x7fd9680636b0 2020-01-26T15:35:15.304 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:35:15.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 >> v1:172.21.15.170:6800/17396 conn(0x7fd94c042800 legacy=0x7fd94c044d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 >> v1:172.21.15.170:6789/0 conn(0x7fd9680636b0 legacy=0x7fd96807b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 shutdown_connections 2020-01-26T15:35:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd96c96a700 1 --2- 172.21.15.170:0/80560685 >> v2:172.21.15.170:6791/0 conn(0x7fd96807ba60 0x7fd96815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.300+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 >> 172.21.15.170:0/80560685 conn(0x7fd96809e450 msgr2=0x7fd968097860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.304+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 shutdown_connections 2020-01-26T15:35:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.304+0000 7fd96c96a700 1 -- 172.21.15.170:0/80560685 wait complete. 2020-01-26T15:35:15.317 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:35:15.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73398e9700 1 Processor -- start 2020-01-26T15:35:15.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73398e9700 1 -- start start 2020-01-26T15:35:15.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73398e9700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334066310 con 0x7f73340a78a0 2020-01-26T15:35:15.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73398e9700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334025350 con 0x7f733414a160 2020-01-26T15:35:15.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73398e9700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733414fdd0 con 0x7f733407fd70 2020-01-26T15:35:15.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f733ab4b700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f733414a160 0x7f733414c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47356/0 (socket says 172.21.15.170:47356) 2020-01-26T15:35:15.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73388e7700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f733407fd70 0x7f73340a6750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42480/0 (socket says 172.21.15.170:42480) 2020-01-26T15:35:15.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73390e8700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f73340a78a0 0x7f7334097880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50476/0 (socket says 172.21.15.170:50476) 2020-01-26T15:35:15.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f733ab4b700 1 -- 172.21.15.170:0/3096412749 learned_addr learned my addr 172.21.15.170:0/3096412749 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429921984 0 0) 0x7f733414fdd0 con 0x7f733407fd70 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7320003230 con 0x7f733407fd70 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709708761 0 0) 0x7f7334066310 con 0x7f73340a78a0 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733414fdd0 con 0x7f73340a78a0 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784310726 0 0) 0x7f7334025350 con 0x7f733414a160 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7334066310 con 0x7f733414a160 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3346132759 0 0) 0x7f7320003230 con 0x7f733407fd70 2020-01-26T15:35:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 >> v1:172.21.15.170:6790/0 conn(0x7f733414a160 legacy=0x7f733414c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 >> v1:172.21.15.170:6789/0 conn(0x7f73340a78a0 legacy=0x7f7334097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334151010 con 0x7f733407fd70 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f73240016e0 con 0x7f733407fd70 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7324001980 con 0x7f733407fd70 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f732bfff700 1 -- 172.21.15.170:0/3096412749 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f73240044f0 con 0x7f733407fd70 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.432+0000 7f73398e9700 1 -- 172.21.15.170:0/3096412749 >> v1:172.21.15.170:6791/0 conn(0x7f733407fd70 legacy=0x7f73340a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- 172.21.15.170:0/3096412749 shutdown_connections 2020-01-26T15:35:15.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- 172.21.15.170:0/3096412749 >> 172.21.15.170:0/3096412749 conn(0x7f7334099260 msgr2=0x7f733405f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- 172.21.15.170:0/3096412749 shutdown_connections 2020-01-26T15:35:15.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- 172.21.15.170:0/3096412749 wait complete. 2020-01-26T15:35:15.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 Processor -- start 2020-01-26T15:35:15.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- start start 2020-01-26T15:35:15.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f73340647f0 0x7f733409f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:15.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334065b40 con 0x7f733412c880 2020-01-26T15:35:15.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334065d70 con 0x7f733409fe30 2020-01-26T15:35:15.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73398e9700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7334063d10 con 0x7f73340647f0 2020-01-26T15:35:15.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73390e8700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f73340647f0 0x7f733409f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:15.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73390e8700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f73340647f0 0x7f733409f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:15.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73388e7700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f733409fe30 0x7f733412c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42486/0 (socket says 172.21.15.170:42486) 2020-01-26T15:35:15.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.436+0000 7f73388e7700 1 -- 172.21.15.170:0/3843329333 learned_addr learned my addr 172.21.15.170:0/3843329333 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637471553 0 0) 0x7f7334065b40 con 0x7f733412c880 2020-01-26T15:35:15.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7314003230 con 0x7f733412c880 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173672586 0 0) 0x7f7334065d70 con 0x7f733409fe30 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7334065b40 con 0x7f733409fe30 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3949137458 0 0) 0x7f7314003230 con 0x7f733412c880 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7334065d70 con 0x7f733412c880 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f732c001a10 con 0x7f733412c880 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1453119563 0 0) 0x7f7334065b40 con 0x7f733409fe30 2020-01-26T15:35:15.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7314003230 con 0x7f733409fe30 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7324001af0 con 0x7f733409fe30 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1028581390 0 0) 0x7f7334065d70 con 0x7f733412c880 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 >> v2:172.21.15.170:6791/0 conn(0x7f73340647f0 msgr2=0x7f733409f8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 --2- 172.21.15.170:0/3843329333 >> v2:172.21.15.170:6791/0 conn(0x7f73340647f0 0x7f733409f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 >> v1:172.21.15.170:6791/0 conn(0x7f733409fe30 legacy=0x7f733412c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334065fa0 con 0x7f733412c880 2020-01-26T15:35:15.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7334137610 con 0x7f733412c880 2020-01-26T15:35:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334137ae0 con 0x7f733412c880 2020-01-26T15:35:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f732c001f80 con 0x7f733412c880 2020-01-26T15:35:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f732c004a30 con 0x7f733412c880 2020-01-26T15:35:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c003360 con 0x7f733412c880 2020-01-26T15:35:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.440+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f732c004cb0 con 0x7f733412c880 2020-01-26T15:35:15.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.444+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f732c04b970 con 0x7f733412c880 2020-01-26T15:35:15.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.444+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f732c0056f0 con 0x7f733412c880 2020-01-26T15:35:15.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.564+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f730c002220 con 0x7f733412c880 2020-01-26T15:35:15.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.564+0000 7f7329ffb700 1 -- 172.21.15.170:0/3843329333 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+10 (unknown 3401600817 0 265718887) 0x7f732c031050 con 0x7f733412c880 2020-01-26T15:35:15.569 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:35:15.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 >> v1:172.21.15.170:6800/17396 conn(0x7f731403e450 legacy=0x7f7314040960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 >> v1:172.21.15.170:6790/0 conn(0x7f733412c880 legacy=0x7f7334065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 shutdown_connections 2020-01-26T15:35:15.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 --2- 172.21.15.170:0/3843329333 >> v2:172.21.15.170:6791/0 conn(0x7f73340647f0 0x7f733409f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:15.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 >> 172.21.15.170:0/3843329333 conn(0x7f73340a7330 msgr2=0x7f7334150000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 shutdown_connections 2020-01-26T15:35:15.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.568+0000 7f73398e9700 1 -- 172.21.15.170:0/3843329333 wait complete. 2020-01-26T15:35:15.581 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:35:15.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 Processor -- start 2020-01-26T15:35:15.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 -- start start 2020-01-26T15:35:15.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff3e407fd70 0x7ff3e40a6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:15.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e4066310 con 0x7ff3e40a6ca0 2020-01-26T15:35:15.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e4025350 con 0x7ff3e40a78a0 2020-01-26T15:35:15.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e40a7cd0 con 0x7ff3e407fd70 2020-01-26T15:35:15.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e359e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff3e40a78a0 0x7ff3e4097880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42492/0 (socket says 172.21.15.170:42492) 2020-01-26T15:35:15.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e359e700 1 -- 172.21.15.170:0/1449199591 learned_addr learned my addr 172.21.15.170:0/1449199591 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e2d9d700 -1 --2- 172.21.15.170:0/1449199591 >> v2:172.21.15.170:6790/0 conn(0x7ff3e407fd70 0x7ff3e40a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:15.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e2d9d700 1 --2- 172.21.15.170:0/1449199591 >> v2:172.21.15.170:6790/0 conn(0x7ff3e407fd70 0x7ff3e40a6750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:15.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496122411 0 0) 0x7ff3e4025350 con 0x7ff3e40a78a0 2020-01-26T15:35:15.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c4003230 con 0x7ff3e40a78a0 2020-01-26T15:35:15.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804430340 0 0) 0x7ff3e4066310 con 0x7ff3e40a6ca0 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e4025350 con 0x7ff3e40a6ca0 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2434200535 0 0) 0x7ff3c4003230 con 0x7ff3e40a78a0 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 >> v2:172.21.15.170:6790/0 conn(0x7ff3e407fd70 msgr2=0x7ff3e40a6750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 --2- 172.21.15.170:0/1449199591 >> v2:172.21.15.170:6790/0 conn(0x7ff3e407fd70 0x7ff3e40a6750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 >> v1:172.21.15.170:6790/0 conn(0x7ff3e40a6ca0 legacy=0x7ff3e414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e414e990 con 0x7ff3e40a78a0 2020-01-26T15:35:15.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff3dc001a60 con 0x7ff3e40a78a0 2020-01-26T15:35:15.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff3dc001dd0 con 0x7ff3e40a78a0 2020-01-26T15:35:15.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e259c700 1 -- 172.21.15.170:0/1449199591 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff3dc004930 con 0x7ff3e40a78a0 2020-01-26T15:35:15.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.696+0000 7ff3e8967700 1 -- 172.21.15.170:0/1449199591 >> v1:172.21.15.170:6791/0 conn(0x7ff3e40a78a0 legacy=0x7ff3e4097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- 172.21.15.170:0/1449199591 shutdown_connections 2020-01-26T15:35:15.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 --2- 172.21.15.170:0/1449199591 >> v2:172.21.15.170:6790/0 conn(0x7ff3e407fd70 0x7ff3e40a6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:15.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- 172.21.15.170:0/1449199591 >> 172.21.15.170:0/1449199591 conn(0x7ff3e4099260 msgr2=0x7ff3e405f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- 172.21.15.170:0/1449199591 shutdown_connections 2020-01-26T15:35:15.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- 172.21.15.170:0/1449199591 wait complete. 2020-01-26T15:35:15.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 Processor -- start 2020-01-26T15:35:15.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- start start 2020-01-26T15:35:15.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e4060d90 con 0x7ff3e4061650 2020-01-26T15:35:15.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e4061a80 con 0x7ff3e4061140 2020-01-26T15:35:15.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e8967700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e4120890 con 0x7ff3e40605a0 2020-01-26T15:35:15.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e359e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff3e4061140 0x7ff3e4062540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47372/0 (socket says 172.21.15.170:47372) 2020-01-26T15:35:15.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3e359e700 1 -- 172.21.15.170:0/2419913551 learned_addr learned my addr 172.21.15.170:0/2419913551 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895124504 0 0) 0x7ff3e4061a80 con 0x7ff3e4061140 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3bc003230 con 0x7ff3e4061140 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285753662 0 0) 0x7ff3e4060d90 con 0x7ff3e4061650 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e4061a80 con 0x7ff3e4061650 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823014185 0 0) 0x7ff3e4120890 con 0x7ff3e40605a0 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.700+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e4060d90 con 0x7ff3e40605a0 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1664204403 0 0) 0x7ff3e4061a80 con 0x7ff3e4061650 2020-01-26T15:35:15.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff3e4120890 con 0x7ff3e4061650 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff3cc001670 con 0x7ff3e4061650 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 163433629 0 0) 0x7ff3e4060d90 con 0x7ff3e40605a0 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff3e4061a80 con 0x7ff3e40605a0 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1722784816 0 0) 0x7ff3bc003230 con 0x7ff3e4061140 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff3e4060d90 con 0x7ff3e4061140 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff3d4001760 con 0x7ff3e40605a0 2020-01-26T15:35:15.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff3dc0017a0 con 0x7ff3e4061140 2020-01-26T15:35:15.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 560433493 0 0) 0x7ff3e4120890 con 0x7ff3e4061650 2020-01-26T15:35:15.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 >> v1:172.21.15.170:6791/0 conn(0x7ff3e40605a0 legacy=0x7ff3e407f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 >> v1:172.21.15.170:6790/0 conn(0x7ff3e4061140 legacy=0x7ff3e4062540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e4096680 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e40609d0 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e4099b90 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff3cc001940 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7ff3cc001cf0 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7ff3cc001ef0 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7ff3cc04b8a0 con 0x7ff3e4061650 2020-01-26T15:35:15.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.704+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c0003360 con 0x7ff3e4061650 2020-01-26T15:35:15.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.712+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7ff3cc030f80 con 0x7ff3e4061650 2020-01-26T15:35:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.828+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3c00037f0 con 0x7ff3e4061650 2020-01-26T15:35:15.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3dbfff700 1 -- 172.21.15.170:0/2419913551 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+10 (unknown 975828523 0 265718887) 0x7ff3cc04a6d0 con 0x7ff3e4061650 2020-01-26T15:35:15.834 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 8 2020-01-26T15:35:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 >> v1:172.21.15.170:6800/17396 conn(0x7ff3bc040a10 legacy=0x7ff3bc042f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 >> v1:172.21.15.170:6789/0 conn(0x7ff3e4061650 legacy=0x7ff3e407ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 shutdown_connections 2020-01-26T15:35:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 >> 172.21.15.170:0/2419913551 conn(0x7ff3e4097da0 msgr2=0x7ff3e41238e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 shutdown_connections 2020-01-26T15:35:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.832+0000 7ff3e8967700 1 -- 172.21.15.170:0/2419913551 wait complete. 2020-01-26T15:35:15.854 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:35:15.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.956+0000 7f07db59e700 1 Processor -- start 2020-01-26T15:35:15.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.956+0000 7f07db59e700 1 -- start start 2020-01-26T15:35:15.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:15.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc0a6dc0 con 0x7f07dc05edd0 2020-01-26T15:35:15.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc05ea20 con 0x7f07dc149040 2020-01-26T15:35:15.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc098000 con 0x7f07dc05e5f0 2020-01-26T15:35:15.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07d3fff700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:15.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07dad9d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f07dc05edd0 0x7f07dc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50504/0 (socket says 172.21.15.170:50504) 2020-01-26T15:35:15.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07dad9d700 1 -- 172.21.15.170:0/1944452454 learned_addr learned my addr 172.21.15.170:0/1944452454 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07e0c81700 1 --1- 172.21.15.170:0/1944452454 >> v1:172.21.15.170:6791/0 conn(0x7f07dc149040 0x7f07dc14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42510/0 (socket says 172.21.15.170:42510) 2020-01-26T15:35:15.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07d3fff700 1 --2- 172.21.15.170:0/1944452454 >> v2:172.21.15.170:6791/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:15.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590328892 0 0) 0x7f07dc05ea20 con 0x7f07dc149040 2020-01-26T15:35:15.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c8003230 con 0x7f07dc149040 2020-01-26T15:35:15.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262348542 0 0) 0x7f07dc0a6dc0 con 0x7f07dc05edd0 2020-01-26T15:35:15.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc05ea20 con 0x7f07dc05edd0 2020-01-26T15:35:15.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3497711136 0 0) 0x7f07c8003230 con 0x7f07dc149040 2020-01-26T15:35:15.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 >> v2:172.21.15.170:6791/0 conn(0x7f07dc05e5f0 msgr2=0x7f07dc0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:15.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 --2- 172.21.15.170:0/1944452454 >> v2:172.21.15.170:6791/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:15.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 >> v1:172.21.15.170:6789/0 conn(0x7f07dc05edd0 legacy=0x7f07dc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc05e050 con 0x7f07dc149040 2020-01-26T15:35:15.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f07d4001a60 con 0x7f07dc149040 2020-01-26T15:35:15.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f07d4001dd0 con 0x7f07dc149040 2020-01-26T15:35:15.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07da59c700 1 -- 172.21.15.170:0/1944452454 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f07d4004870 con 0x7f07dc149040 2020-01-26T15:35:15.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- 172.21.15.170:0/1944452454 >> v1:172.21.15.170:6791/0 conn(0x7f07dc149040 legacy=0x7f07dc14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- 172.21.15.170:0/1944452454 shutdown_connections 2020-01-26T15:35:15.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 --2- 172.21.15.170:0/1944452454 >> v2:172.21.15.170:6791/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:15.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- 172.21.15.170:0/1944452454 >> 172.21.15.170:0/1944452454 conn(0x7f07dc098e70 msgr2=0x7f07dc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:15.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- 172.21.15.170:0/1944452454 shutdown_connections 2020-01-26T15:35:15.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.960+0000 7f07db59e700 1 -- 172.21.15.170:0/1944452454 wait complete. 2020-01-26T15:35:15.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07db59e700 1 Processor -- start 2020-01-26T15:35:15.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07db59e700 1 -- start start 2020-01-26T15:35:15.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07db59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc0a0880 0x7f07dc07ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:15.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07db59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc09ff00 con 0x7f07dc0a0210 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07db59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc07d790 con 0x7f07dc07d360 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07db59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc121af0 con 0x7f07dc0a0880 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07dad9d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f07dc0a0210 0x7f07dc0a0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50510/0 (socket says 172.21.15.170:50510) 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07dad9d700 1 -- 172.21.15.170:0/900050170 learned_addr learned my addr 172.21.15.170:0/900050170 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d3fff700 -1 --2- 172.21.15.170:0/900050170 >> v2:172.21.15.170:6790/0 conn(0x7f07dc0a0880 0x7f07dc07ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d3fff700 1 --2- 172.21.15.170:0/900050170 >> v2:172.21.15.170:6790/0 conn(0x7f07dc0a0880 0x7f07dc07ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:15.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119803910 0 0) 0x7f07dc09ff00 con 0x7f07dc0a0210 2020-01-26T15:35:15.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c0003230 con 0x7f07dc0a0210 2020-01-26T15:35:15.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370150440 0 0) 0x7f07dc07d790 con 0x7f07dc07d360 2020-01-26T15:35:15.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc09ff00 con 0x7f07dc07d360 2020-01-26T15:35:15.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 394492905 0 0) 0x7f07c0003230 con 0x7f07dc0a0210 2020-01-26T15:35:15.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07dc07d790 con 0x7f07dc0a0210 2020-01-26T15:35:15.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f07cc001820 con 0x7f07dc0a0210 2020-01-26T15:35:15.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3983831014 0 0) 0x7f07dc09ff00 con 0x7f07dc07d360 2020-01-26T15:35:15.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07c0003230 con 0x7f07dc07d360 2020-01-26T15:35:15.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.964+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f07d40017a0 con 0x7f07dc07d360 2020-01-26T15:35:15.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 694033217 0 0) 0x7f07dc07d790 con 0x7f07dc0a0210 2020-01-26T15:35:15.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 >> v2:172.21.15.170:6790/0 conn(0x7f07dc0a0880 msgr2=0x7f07dc07ce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 --2- 172.21.15.170:0/900050170 >> v2:172.21.15.170:6790/0 conn(0x7f07dc0a0880 0x7f07dc07ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 >> v1:172.21.15.170:6790/0 conn(0x7f07dc07d360 legacy=0x7f07dc1375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0a0cb0 con 0x7f07dc0a0210 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc121650 con 0x7f07dc0a0210 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc138dc0 con 0x7f07dc0a0210 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f07cc0045f0 con 0x7f07dc0a0210 2020-01-26T15:35:15.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f07cc0049a0 con 0x7f07dc0a0210 2020-01-26T15:35:15.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f07cc004c20 con 0x7f07dc0a0210 2020-01-26T15:35:15.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc056600 con 0x7f07dc0a0210 2020-01-26T15:35:15.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.968+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f07cc04b870 con 0x7f07dc0a0210 2020-01-26T15:35:15.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:15.972+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f07dc0a0cb0 con 0x7f07dc0a0210 2020-01-26T15:35:16.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07dc05cc60 con 0x7f07dc0a0210 2020-01-26T15:35:16.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07d37fe700 1 -- 172.21.15.170:0/900050170 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1708 (unknown 312852535 0 2744335463) 0x7f07cc030fb0 con 0x7f07dc0a0210 2020-01-26T15:35:16.126 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:16.126 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26T15:32:15.376136+0000","modified":"2020-01-26T15:32:58.344929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4225},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4225":{"gid":4225,"name":"c","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.170:6817/12433226","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6817","nonce":12433226}]},"export_targets":[],"features":4611087854031667195,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:35:16.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 >> v1:172.21.15.170:6800/17396 conn(0x7f07c0040630 legacy=0x7f07c0042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 >> v1:172.21.15.170:6789/0 conn(0x7f07dc0a0210 legacy=0x7f07dc0a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 shutdown_connections 2020-01-26T15:35:16.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 --2- 172.21.15.170:0/900050170 >> v2:172.21.15.170:6790/0 conn(0x7f07dc0a0880 0x7f07dc07ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:16.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 >> 172.21.15.170:0/900050170 conn(0x7f07dc05e5f0 msgr2=0x7f07dc07e120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:16.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 shutdown_connections 2020-01-26T15:35:16.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.124+0000 7f07db59e700 1 -- 172.21.15.170:0/900050170 wait complete. 2020-01-26T15:35:16.129 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 13 2020-01-26T15:35:16.240 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4225}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 12, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4225': {u'export_targets': [], u'name': u'c', u'incarnation': 6, u'state_seq': 2, u'state': u'up:active', u'gid': 4225, u'features': 4611087854031667195, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 12433226, u'type': u'v1', u'addr': u'172.21.15.170:6817'}]}, u'addr': u'172.21.15.170:6817/12433226'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26T15:32:15.376136+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26T15:32:58.344929+0000', u'session_timeout': 60, u'stopped': [1], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:35:16.240 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:35:16.241 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:35:16.363 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:35:16.363 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:35:16.364 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2020-01-26T15:35:16.364 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4225, 2020-01-26T15:35:16.364 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2020-01-26T15:35:16.364 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2020-01-26T15:35:16.364 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 177.961946, 2020-01-26T15:35:16.364 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 12, 2020-01-26T15:35:16.365 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 18, 2020-01-26T15:35:16.365 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 17, 2020-01-26T15:35:16.365 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 178.861792 2020-01-26T15:35:16.365 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:35:16.372 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", "whoami": 0, "id": 4225, "want_state": "up:active", "state": "up:active", "rank_uptime": 177.961946, "mdsmap_epoch": 12, "osdmap_epoch": 18, "osdmap_epoch_barrier": 17, "uptime": 178.861792 } 2020-01-26T15:35:16.373 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-01-26T15:35:16.390 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-01-26T15:35:16.391 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:16.458 INFO:tasks.ceph.osd.1:Stopped 2020-01-26T15:35:16.459 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2020-01-26T15:35:16.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 Processor -- start 2020-01-26T15:35:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- start start 2020-01-26T15:35:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7b2c05edd0 0x7f7b2c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c098000 con 0x7f7b2c0a6870 2020-01-26T15:35:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c05e050 con 0x7f7b2c149040 2020-01-26T15:35:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c0a6ca0 con 0x7f7b2c05edd0 2020-01-26T15:35:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b3124d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7b2c05edd0 0x7f7b2c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b3124d700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7b2c05edd0 0x7f7b2c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b30a4c700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7b2c0a6870 0x7f7b2c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50534/0 (socket says 172.21.15.170:50534) 2020-01-26T15:35:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b30a4c700 1 -- 172.21.15.170:0/473207326 learned_addr learned my addr 172.21.15.170:0/473207326 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b32cb0700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f7b2c149040 0x7f7b2c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42538/0 (socket says 172.21.15.170:42538) 2020-01-26T15:35:16.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265477789 0 0) 0x7f7b2c098000 con 0x7f7b2c0a6870 2020-01-26T15:35:16.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b14003230 con 0x7f7b2c0a6870 2020-01-26T15:35:16.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658339079 0 0) 0x7f7b2c05e050 con 0x7f7b2c149040 2020-01-26T15:35:16.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b2c098000 con 0x7f7b2c149040 2020-01-26T15:35:16.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1297988199 0 0) 0x7f7b14003230 con 0x7f7b2c0a6870 2020-01-26T15:35:16.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c05edd0 msgr2=0x7f7b2c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:16.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 --2- 172.21.15.170:0/473207326 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c05edd0 0x7f7b2c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:16.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 >> v1:172.21.15.170:6791/0 conn(0x7f7b2c149040 legacy=0x7f7b2c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c14ecb0 con 0x7f7b2c0a6870 2020-01-26T15:35:16.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7b200016e0 con 0x7f7b2c0a6870 2020-01-26T15:35:16.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7b20001a50 con 0x7f7b2c0a6870 2020-01-26T15:35:16.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b2bfff700 1 -- 172.21.15.170:0/473207326 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7b200045b0 con 0x7f7b2c0a6870 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- 172.21.15.170:0/473207326 >> v1:172.21.15.170:6789/0 conn(0x7f7b2c0a6870 legacy=0x7f7b2c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- 172.21.15.170:0/473207326 shutdown_connections 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 --2- 172.21.15.170:0/473207326 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c05edd0 0x7f7b2c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- 172.21.15.170:0/473207326 >> 172.21.15.170:0/473207326 conn(0x7f7b2c098e70 msgr2=0x7f7b2c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- 172.21.15.170:0/473207326 shutdown_connections 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.572+0000 7f7b31a4e700 1 -- 172.21.15.170:0/473207326 wait complete. 2020-01-26T15:35:16.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 Processor -- start 2020-01-26T15:35:16.584 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 -- start start 2020-01-26T15:35:16.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7b2c07cf70 0x7f7b2c07d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:16.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c09a460 con 0x7f7b2c0a4690 2020-01-26T15:35:16.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c13a4f0 con 0x7f7b2c09df30 2020-01-26T15:35:16.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c120940 con 0x7f7b2c07cf70 2020-01-26T15:35:16.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b3124d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7b2c0a4690 0x7f7b2c120030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50540/0 (socket says 172.21.15.170:50540) 2020-01-26T15:35:16.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b3124d700 1 -- 172.21.15.170:0/1569134704 learned_addr learned my addr 172.21.15.170:0/1569134704 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:16.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b32cb0700 -1 --2- 172.21.15.170:0/1569134704 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c07cf70 0x7f7b2c07d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:16.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b32cb0700 1 --2- 172.21.15.170:0/1569134704 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c07cf70 0x7f7b2c07d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:16.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028682931 0 0) 0x7f7b2c13a4f0 con 0x7f7b2c09df30 2020-01-26T15:35:16.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b0c003230 con 0x7f7b2c09df30 2020-01-26T15:35:16.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428310493 0 0) 0x7f7b2c09a460 con 0x7f7b2c0a4690 2020-01-26T15:35:16.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b2c13a4f0 con 0x7f7b2c0a4690 2020-01-26T15:35:16.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1627473003 0 0) 0x7f7b0c003230 con 0x7f7b2c09df30 2020-01-26T15:35:16.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7b2c09a460 con 0x7f7b2c09df30 2020-01-26T15:35:16.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7b20001420 con 0x7f7b2c09df30 2020-01-26T15:35:16.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2562094638 0 0) 0x7f7b2c13a4f0 con 0x7f7b2c0a4690 2020-01-26T15:35:16.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7b0c003230 con 0x7f7b2c0a4690 2020-01-26T15:35:16.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7b24002a90 con 0x7f7b2c0a4690 2020-01-26T15:35:16.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 450899425 0 0) 0x7f7b2c09a460 con 0x7f7b2c09df30 2020-01-26T15:35:16.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c07cf70 msgr2=0x7f7b2c07d3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:16.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 --2- 172.21.15.170:0/1569134704 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c07cf70 0x7f7b2c07d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:16.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 >> v1:172.21.15.170:6789/0 conn(0x7f7b2c0a4690 legacy=0x7f7b2c120030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c13b730 con 0x7f7b2c09df30 2020-01-26T15:35:16.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c1394e0 con 0x7f7b2c09df30 2020-01-26T15:35:16.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c1399e0 con 0x7f7b2c09df30 2020-01-26T15:35:16.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7b20001210 con 0x7f7b2c09df30 2020-01-26T15:35:16.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.576+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f7b20004b30 con 0x7f7b2c09df30 2020-01-26T15:35:16.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.580+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f7b20010570 con 0x7f7b2c09df30 2020-01-26T15:35:16.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.580+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b04003360 con 0x7f7b2c09df30 2020-01-26T15:35:16.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.580+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3607459627 0 0) 0x7f7b2004b8f0 con 0x7f7b2c09df30 2020-01-26T15:35:16.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.584+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f7b20030dd0 con 0x7f7b2c09df30 2020-01-26T15:35:16.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.716+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f7b040037d0 con 0x7f7b2c09df30 2020-01-26T15:35:16.719 INFO:tasks.ceph.mon.a.smithi170.stderr:2020-01-26T15:35:16.716+0000 7fe488f5f700 -1 mon.a@0(leader).osd e18 definitely_dead 0 2020-01-26T15:35:16.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.796+0000 7f7b29ffb700 1 -- 172.21.15.170:0/1569134704 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v19) v1 ==== 89+0+0 (unknown 3370709173 0 0) 0x7f7b20031030 con 0x7f7b2c09df30 2020-01-26T15:35:16.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 >> v1:172.21.15.170:6800/17396 conn(0x7f7b0c03e370 legacy=0x7f7b0c040880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 >> v1:172.21.15.170:6790/0 conn(0x7f7b2c09df30 legacy=0x7f7b2c099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:16.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 shutdown_connections 2020-01-26T15:35:16.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 --2- 172.21.15.170:0/1569134704 >> v2:172.21.15.170:6791/0 conn(0x7f7b2c07cf70 0x7f7b2c07d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:16.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 >> 172.21.15.170:0/1569134704 conn(0x7f7b2c098e10 msgr2=0x7f7b2c07f270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:16.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 shutdown_connections 2020-01-26T15:35:16.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.800+0000 7f7b31a4e700 1 -- 172.21.15.170:0/1569134704 wait complete. 2020-01-26T15:35:16.804 INFO:teuthology.orchestra.run.smithi170.stderr:marked down osd.1. 2020-01-26T15:35:16.814 INFO:tasks.ceph.osd.1:Restarting daemon 2020-01-26T15:35:16.815 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-01-26T15:35:16.817 INFO:tasks.ceph.osd.1:Started 2020-01-26T15:35:16.817 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-01-26T15:35:16.817 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:16.879 INFO:tasks.ceph.osd.0:Stopped 2020-01-26T15:35:16.880 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2020-01-26T15:35:16.888 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:16.884+0000 7fc625b5a700 -1 --2- 172.21.15.170:0/3611604114 >> v2:172.21.15.170:6790/0 conn(0x561f9722bb00 0x561f97e9c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:16.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.988+0000 7efc7981e700 1 Processor -- start 2020-01-26T15:35:16.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.988+0000 7efc7981e700 1 -- start start 2020-01-26T15:35:16.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7efc7405edd0 0x7efc7405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:16.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc74098000 con 0x7efc740a6870 2020-01-26T15:35:16.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7405e050 con 0x7efc74149040 2020-01-26T15:35:16.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7efc740a6ca0 con 0x7efc7405edd0 2020-01-26T15:35:16.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7aa80700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7efc74149040 0x7efc7414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42588/0 (socket says 172.21.15.170:42588) 2020-01-26T15:35:16.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7aa80700 1 -- 172.21.15.170:0/693619642 learned_addr learned my addr 172.21.15.170:0/693619642 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:16.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7901d700 -1 --2- 172.21.15.170:0/693619642 >> v2:172.21.15.170:6791/0 conn(0x7efc7405edd0 0x7efc7405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:16.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7901d700 1 --2- 172.21.15.170:0/693619642 >> v2:172.21.15.170:6791/0 conn(0x7efc7405edd0 0x7efc7405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:16.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360425954 0 0) 0x7efc7405e050 con 0x7efc74149040 2020-01-26T15:35:16.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc60003230 con 0x7efc74149040 2020-01-26T15:35:16.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304773793 0 0) 0x7efc74098000 con 0x7efc740a6870 2020-01-26T15:35:16.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc7405e050 con 0x7efc740a6870 2020-01-26T15:35:16.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2704366394 0 0) 0x7efc7405e050 con 0x7efc740a6870 2020-01-26T15:35:16.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 >> v2:172.21.15.170:6791/0 conn(0x7efc7405edd0 msgr2=0x7efc7405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:17.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 --2- 172.21.15.170:0/693619642 >> v2:172.21.15.170:6791/0 conn(0x7efc7405edd0 0x7efc7405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:17.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 >> v1:172.21.15.170:6791/0 conn(0x7efc74149040 legacy=0x7efc7414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:17.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7414ecb0 con 0x7efc740a6870 2020-01-26T15:35:17.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efc640016c0 con 0x7efc740a6870 2020-01-26T15:35:17.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 <== mon.0 v1:172.21.15.170:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7efc64001a30 con 0x7efc740a6870 2020-01-26T15:35:17.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc6bfff700 1 -- 172.21.15.170:0/693619642 <== mon.0 v1:172.21.15.170:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efc64001ec0 con 0x7efc740a6870 2020-01-26T15:35:17.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- 172.21.15.170:0/693619642 >> v1:172.21.15.170:6789/0 conn(0x7efc740a6870 legacy=0x7efc7407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:17.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- 172.21.15.170:0/693619642 shutdown_connections 2020-01-26T15:35:17.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 --2- 172.21.15.170:0/693619642 >> v2:172.21.15.170:6791/0 conn(0x7efc7405edd0 0x7efc7405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:17.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- 172.21.15.170:0/693619642 >> 172.21.15.170:0/693619642 conn(0x7efc74098e70 msgr2=0x7efc740a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:17.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- 172.21.15.170:0/693619642 shutdown_connections 2020-01-26T15:35:17.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- 172.21.15.170:0/693619642 wait complete. 2020-01-26T15:35:17.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 Processor -- start 2020-01-26T15:35:17.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.992+0000 7efc7981e700 1 -- start start 2020-01-26T15:35:17.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7efc74130550 0x7efc740a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:17.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7409fc80 con 0x7efc74138240 2020-01-26T15:35:17.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740a1000 con 0x7efc7409f850 2020-01-26T15:35:17.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7efc7405bee0 con 0x7efc74130550 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7901d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7efc7409f850 0x7efc7412fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47464/0 (socket says 172.21.15.170:47464) 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7901d700 1 -- 172.21.15.170:0/636056721 learned_addr learned my addr 172.21.15.170:0/636056721 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7aa80700 1 --1- 172.21.15.170:0/636056721 >> v1:172.21.15.170:6789/0 conn(0x7efc74138240 0x7efc7413a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50592/0 (socket says 172.21.15.170:50592) 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7881c700 -1 --2- 172.21.15.170:0/636056721 >> v2:172.21.15.170:6790/0 conn(0x7efc74130550 0x7efc740a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7881c700 1 --2- 172.21.15.170:0/636056721 >> v2:172.21.15.170:6790/0 conn(0x7efc74130550 0x7efc740a0ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542632759 0 0) 0x7efc740a1000 con 0x7efc7409f850 2020-01-26T15:35:17.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc54003230 con 0x7efc7409f850 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786479444 0 0) 0x7efc7409fc80 con 0x7efc74138240 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc740a1000 con 0x7efc74138240 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1438664482 0 0) 0x7efc740a1000 con 0x7efc74138240 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efc7409fc80 con 0x7efc74138240 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efc6c001c60 con 0x7efc74138240 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3845856521 0 0) 0x7efc54003230 con 0x7efc7409f850 2020-01-26T15:35:17.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efc740a1000 con 0x7efc7409f850 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efc700026d0 con 0x7efc7409f850 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 636083200 0 0) 0x7efc7409fc80 con 0x7efc74138240 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 >> v2:172.21.15.170:6790/0 conn(0x7efc74130550 msgr2=0x7efc740a0ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 --2- 172.21.15.170:0/636056721 >> v2:172.21.15.170:6790/0 conn(0x7efc74130550 0x7efc740a0ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 >> v1:172.21.15.170:6790/0 conn(0x7efc7409f850 legacy=0x7efc7412fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7411fbf0 con 0x7efc74138240 2020-01-26T15:35:17.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc74120b20 con 0x7efc74138240 2020-01-26T15:35:17.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7efc6c0048f0 con 0x7efc74138240 2020-01-26T15:35:17.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efc74120720 con 0x7efc74138240 2020-01-26T15:35:17.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7efc6c004ca0 con 0x7efc74138240 2020-01-26T15:35:17.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7efc6c004ea0 con 0x7efc74138240 2020-01-26T15:35:17.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 2854+0+0 (unknown 1089245841 0 0) 0x7efc6c04bad0 con 0x7efc74138240 2020-01-26T15:35:17.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:16.996+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc74056600 con 0x7efc74138240 2020-01-26T15:35:17.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.000+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7efc6c031210 con 0x7efc74138240 2020-01-26T15:35:17.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.136+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7efc740a7630 con 0x7efc74138240 2020-01-26T15:35:17.138 INFO:tasks.ceph.mon.a.smithi170.stderr:2020-01-26T15:35:17.136+0000 7fe488f5f700 -1 mon.a@0(leader).osd e19 definitely_dead 0 2020-01-26T15:35:17.424 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.420+0000 7fc62ae88d80 -1 Falling back to public interface 2020-01-26T15:35:17.735 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.732+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:17.736 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.732+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:17.738 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.738 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.738 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.738 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.739 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.740 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.740 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.740 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:17.736+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:17.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.800+0000 7efc69ffb700 1 -- 172.21.15.170:0/636056721 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v20) v1 ==== 89+0+0 (unknown 2417466687 0 0) 0x7efc6c04a900 con 0x7efc74138240 2020-01-26T15:35:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 >> v1:172.21.15.170:6800/17396 conn(0x7efc5403e3c0 legacy=0x7efc540408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 >> v1:172.21.15.170:6789/0 conn(0x7efc74138240 legacy=0x7efc7413a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 shutdown_connections 2020-01-26T15:35:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 --2- 172.21.15.170:0/636056721 >> v2:172.21.15.170:6790/0 conn(0x7efc74130550 0x7efc740a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 >> 172.21.15.170:0/636056721 conn(0x7efc74099010 msgr2=0x7efc740a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 shutdown_connections 2020-01-26T15:35:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:17.804+0000 7efc7981e700 1 -- 172.21.15.170:0/636056721 wait complete. 2020-01-26T15:35:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:marked down osd.0. 2020-01-26T15:35:17.819 INFO:tasks.ceph.osd.0:Restarting daemon 2020-01-26T15:35:17.819 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-01-26T15:35:17.863 INFO:tasks.ceph.osd.0:Started 2020-01-26T15:35:17.863 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-01-26T15:35:17.863 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:17.932 INFO:tasks.ceph.osd.3:Stopped 2020-01-26T15:35:17.932 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2020-01-26T15:35:18.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.028+0000 7f381ca45700 1 Processor -- start 2020-01-26T15:35:18.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.028+0000 7f381ca45700 1 -- start start 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f381805edd0 0x7f381805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3818149040 0x7f381814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3818098000 con 0x7f38180a6870 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f381805e050 con 0x7f3818149040 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f38180a6ca0 con 0x7f381805edd0 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381d246700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3818149040 0x7f381814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:18.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381d246700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3818149040 0x7f381814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381759e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f381805edd0 0x7f381805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381759e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f381805edd0 0x7f381805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f380ed9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f38180a6870 0x7f381807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42634/0 (socket says 172.21.15.170:42634) 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f380ed9d700 1 -- 172.21.15.170:0/4222862249 learned_addr learned my addr 172.21.15.170:0/4222862249 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874384554 0 0) 0x7f3818098000 con 0x7f38180a6870 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3804003230 con 0x7f38180a6870 2020-01-26T15:35:18.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 132850969 0 0) 0x7f3804003230 con 0x7f38180a6870 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 >> v2:172.21.15.170:6791/0 conn(0x7f381805edd0 msgr2=0x7f381805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 --2- 172.21.15.170:0/4222862249 >> v2:172.21.15.170:6791/0 conn(0x7f381805edd0 0x7f381805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 >> v2:172.21.15.170:6790/0 conn(0x7f3818149040 msgr2=0x7f381814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 --2- 172.21.15.170:0/4222862249 >> v2:172.21.15.170:6790/0 conn(0x7f3818149040 0x7f381814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381814c9e0 con 0x7f38180a6870 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f38000016e0 con 0x7f38180a6870 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3800001b10 con 0x7f38180a6870 2020-01-26T15:35:18.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f3816d9d700 1 -- 172.21.15.170:0/4222862249 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3800004730 con 0x7f38180a6870 2020-01-26T15:35:18.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 -- 172.21.15.170:0/4222862249 >> v1:172.21.15.170:6791/0 conn(0x7f38180a6870 legacy=0x7f381807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:18.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.032+0000 7f381ca45700 1 -- 172.21.15.170:0/4222862249 shutdown_connections 2020-01-26T15:35:18.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 --2- 172.21.15.170:0/4222862249 >> v2:172.21.15.170:6790/0 conn(0x7f3818149040 0x7f381814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:18.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 --2- 172.21.15.170:0/4222862249 >> v2:172.21.15.170:6791/0 conn(0x7f381805edd0 0x7f381805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:18.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- 172.21.15.170:0/4222862249 >> 172.21.15.170:0/4222862249 conn(0x7f3818098e70 msgr2=0x7f38180a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:18.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- 172.21.15.170:0/4222862249 shutdown_connections 2020-01-26T15:35:18.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- 172.21.15.170:0/4222862249 wait complete. 2020-01-26T15:35:18.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 Processor -- start 2020-01-26T15:35:18.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- start start 2020-01-26T15:35:18.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f38180a30d0 0x7f38181399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:18.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180a3500 con 0x7f38180a1fc0 2020-01-26T15:35:18.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3818122780 con 0x7f381811ea20 2020-01-26T15:35:18.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381ca45700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f381811ef60 con 0x7f38180a30d0 2020-01-26T15:35:18.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f380ed9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f381811ea20 0x7f38181361a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42638/0 (socket says 172.21.15.170:42638) 2020-01-26T15:35:18.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381759e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f38180a1fc0 0x7f381812dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50638/0 (socket says 172.21.15.170:50638) 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f380ed9d700 1 -- 172.21.15.170:0/3618154356 learned_addr learned my addr 172.21.15.170:0/3618154356 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381d246700 -1 --2- 172.21.15.170:0/3618154356 >> v2:172.21.15.170:6790/0 conn(0x7f38180a30d0 0x7f38181399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.036+0000 7f381d246700 1 --2- 172.21.15.170:0/3618154356 >> v2:172.21.15.170:6790/0 conn(0x7f38180a30d0 0x7f38181399c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529647491 0 0) 0x7f3818122780 con 0x7f381811ea20 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37fc003230 con 0x7f381811ea20 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411983415 0 0) 0x7f38180a3500 con 0x7f38180a1fc0 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3818122780 con 0x7f38180a1fc0 2020-01-26T15:35:18.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 682637811 0 0) 0x7f37fc003230 con 0x7f381811ea20 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f38180a3500 con 0x7f381811ea20 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2340176221 0 0) 0x7f3818122780 con 0x7f38180a1fc0 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37fc003230 con 0x7f38180a1fc0 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3800001420 con 0x7f381811ea20 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3808001670 con 0x7f38180a1fc0 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2275263585 0 0) 0x7f38180a3500 con 0x7f381811ea20 2020-01-26T15:35:18.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 >> v2:172.21.15.170:6790/0 conn(0x7f38180a30d0 msgr2=0x7f38181399c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 --2- 172.21.15.170:0/3618154356 >> v2:172.21.15.170:6790/0 conn(0x7f38180a30d0 0x7f38181399c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 >> v1:172.21.15.170:6789/0 conn(0x7f38180a1fc0 legacy=0x7f381812dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381805c0f0 con 0x7f381811ea20 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180a1410 con 0x7f381811ea20 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180a2c30 con 0x7f381811ea20 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3800004980 con 0x7f381811ea20 2020-01-26T15:35:18.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3800004cf0 con 0x7f381811ea20 2020-01-26T15:35:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f38000107b0 con 0x7f381811ea20 2020-01-26T15:35:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3818056600 con 0x7f381811ea20 2020-01-26T15:35:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.040+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(20..20 src has 1..20) v4 ==== 2854+0+0 (unknown 2839916964 0 0) 0x7f380004b960 con 0x7f381811ea20 2020-01-26T15:35:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.044+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f3800030e40 con 0x7f381811ea20 2020-01-26T15:35:18.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.172+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f381812e690 con 0x7f381811ea20 2020-01-26T15:35:18.176 INFO:tasks.ceph.mon.a.smithi170.stderr:2020-01-26T15:35:18.172+0000 7fe488f5f700 -1 mon.a@0(leader).osd e20 definitely_dead 0 2020-01-26T15:35:18.479 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.476+0000 7f7f887d6d80 -1 Falling back to public interface 2020-01-26T15:35:18.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.800+0000 7f3814d99700 1 -- 172.21.15.170:0/3618154356 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v21) v1 ==== 89+0+0 (unknown 1633624331 0 0) 0x7f38000310a0 con 0x7f381811ea20 2020-01-26T15:35:18.806 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:18.806 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:18.809 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.809 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.809 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.810 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.811 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.811 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:18.804+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 >> v1:172.21.15.170:6800/17396 conn(0x7f37fc03e400 legacy=0x7f37fc040910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:18.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 >> v1:172.21.15.170:6791/0 conn(0x7f381811ea20 legacy=0x7f38181361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:18.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 shutdown_connections 2020-01-26T15:35:18.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 --2- 172.21.15.170:0/3618154356 >> v2:172.21.15.170:6790/0 conn(0x7f38180a30d0 0x7f38181399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:18.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 >> 172.21.15.170:0/3618154356 conn(0x7f38180a5520 msgr2=0x7f381807f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:18.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 shutdown_connections 2020-01-26T15:35:18.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:18.808+0000 7f381ca45700 1 -- 172.21.15.170:0/3618154356 wait complete. 2020-01-26T15:35:18.813 INFO:teuthology.orchestra.run.smithi170.stderr:marked down osd.3. 2020-01-26T15:35:18.824 INFO:tasks.ceph.osd.3:Restarting daemon 2020-01-26T15:35:18.825 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-01-26T15:35:18.827 INFO:tasks.ceph.osd.3:Started 2020-01-26T15:35:18.828 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-01-26T15:35:18.828 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:18.891 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:18.888+0000 7fca6bf05700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x555922cf1b00 0x555923962000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:18.891 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:18.888+0000 7fca6c706700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x555922cf2400 0x555923962580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:18.901 INFO:tasks.ceph.osd.2:Stopped 2020-01-26T15:35:18.901 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2020-01-26T15:35:18.903 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.900+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:18.903 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.900+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:18.907 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.907 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.907 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.908 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.908 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.908 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.912 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.912 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.912 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.913 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.913 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.913 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.913 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.913 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.904+0000 7fc61a0e0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:18.914 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.908+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck error: legacy statfs record found, removing 2020-01-26T15:35:18.914 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.908+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:35:18.914 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:18.908+0000 7fc62ae88d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:35:19.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 Processor -- start 2020-01-26T15:35:19.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- start start 2020-01-26T15:35:19.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fea5c05e5f0 0x7fea5c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:19.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0a6dc0 con 0x7fea5c149040 2020-01-26T15:35:19.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c05ea20 con 0x7fea5c05edd0 2020-01-26T15:35:19.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c098000 con 0x7fea5c05e5f0 2020-01-26T15:35:19.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea61361700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fea5c05e5f0 0x7fea5c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:19.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea61361700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fea5c05e5f0 0x7fea5c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea61b62700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fea5c05edd0 0x7fea5c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42668/0 (socket says 172.21.15.170:42668) 2020-01-26T15:35:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea61b62700 1 -- 172.21.15.170:0/1817085286 learned_addr learned my addr 172.21.15.170:0/1817085286 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea635c5700 1 --1- 172.21.15.170:0/1817085286 >> v1:172.21.15.170:6789/0 conn(0x7fea5c149040 0x7fea5c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50670/0 (socket says 172.21.15.170:50670) 2020-01-26T15:35:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403420815 0 0) 0x7fea5c05ea20 con 0x7fea5c05edd0 2020-01-26T15:35:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea48003230 con 0x7fea5c05edd0 2020-01-26T15:35:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399733991 0 0) 0x7fea5c0a6dc0 con 0x7fea5c149040 2020-01-26T15:35:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea5c05ea20 con 0x7fea5c149040 2020-01-26T15:35:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4000434794 0 0) 0x7fea48003230 con 0x7fea5c05edd0 2020-01-26T15:35:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 >> v2:172.21.15.170:6791/0 conn(0x7fea5c05e5f0 msgr2=0x7fea5c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 --2- 172.21.15.170:0/1817085286 >> v2:172.21.15.170:6791/0 conn(0x7fea5c05e5f0 0x7fea5c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 >> v1:172.21.15.170:6789/0 conn(0x7fea5c149040 legacy=0x7fea5c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c05e050 con 0x7fea5c05edd0 2020-01-26T15:35:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fea44001a60 con 0x7fea5c05edd0 2020-01-26T15:35:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fea44001dd0 con 0x7fea5c05edd0 2020-01-26T15:35:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea60b60700 1 -- 172.21.15.170:0/1817085286 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fea44004930 con 0x7fea5c05edd0 2020-01-26T15:35:19.033 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- 172.21.15.170:0/1817085286 >> v1:172.21.15.170:6791/0 conn(0x7fea5c05edd0 legacy=0x7fea5c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- 172.21.15.170:0/1817085286 shutdown_connections 2020-01-26T15:35:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 --2- 172.21.15.170:0/1817085286 >> v2:172.21.15.170:6791/0 conn(0x7fea5c05e5f0 0x7fea5c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- 172.21.15.170:0/1817085286 >> 172.21.15.170:0/1817085286 conn(0x7fea5c098e70 msgr2=0x7fea5c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- 172.21.15.170:0/1817085286 shutdown_connections 2020-01-26T15:35:19.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.004+0000 7fea62363700 1 -- 172.21.15.170:0/1817085286 wait complete. 2020-01-26T15:35:19.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 Processor -- start 2020-01-26T15:35:19.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 -- start start 2020-01-26T15:35:19.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fea5c09db50 0x7fea5c060fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:19.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fea5c07b800 0x7fea5c137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:19.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c09cf90 con 0x7fea5c061500 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c09cb20 con 0x7fea5c07b800 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c07f700 con 0x7fea5c09db50 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea61b62700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fea5c09db50 0x7fea5c060fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea635c5700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fea5c07b800 0x7fea5c137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea61b62700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fea5c09db50 0x7fea5c060fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea635c5700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fea5c07b800 0x7fea5c137a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea61361700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fea5c061500 0x7fea5c07b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42676/0 (socket says 172.21.15.170:42676) 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea61361700 1 -- 172.21.15.170:0/1395444038 learned_addr learned my addr 172.21.15.170:0/1395444038 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568890026 0 0) 0x7fea5c09cf90 con 0x7fea5c061500 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea40003230 con 0x7fea5c061500 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2751159687 0 0) 0x7fea40003230 con 0x7fea5c061500 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea5c09cf90 con 0x7fea5c061500 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fea4c002750 con 0x7fea5c061500 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 518432443 0 0) 0x7fea5c09cf90 con 0x7fea5c061500 2020-01-26T15:35:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 >> v2:172.21.15.170:6791/0 conn(0x7fea5c09db50 msgr2=0x7fea5c060fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 --2- 172.21.15.170:0/1395444038 >> v2:172.21.15.170:6791/0 conn(0x7fea5c09db50 0x7fea5c060fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 >> v2:172.21.15.170:6790/0 conn(0x7fea5c07b800 msgr2=0x7fea5c137a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 --2- 172.21.15.170:0/1395444038 >> v2:172.21.15.170:6790/0 conn(0x7fea5c07b800 0x7fea5c137a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c09d590 con 0x7fea5c061500 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c09e770 con 0x7fea5c061500 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c0a2dd0 con 0x7fea5c061500 2020-01-26T15:35:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fea4c000f50 con 0x7fea5c061500 2020-01-26T15:35:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.008+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fea4c0012f0 con 0x7fea5c061500 2020-01-26T15:35:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.012+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fea4c001570 con 0x7fea5c061500 2020-01-26T15:35:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.012+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea34003360 con 0x7fea5c061500 2020-01-26T15:35:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.012+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(21..21 src has 1..21) v4 ==== 2854+0+0 (unknown 1051481118 0 0) 0x7fea4c04baa0 con 0x7fea5c061500 2020-01-26T15:35:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.016+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fea5c0a2dd0 con 0x7fea5c061500 2020-01-26T15:35:19.148 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.144+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7fea340037d0 con 0x7fea5c061500 2020-01-26T15:35:19.149 INFO:tasks.ceph.mon.a.smithi170.stderr:2020-01-26T15:35:19.148+0000 7fe488f5f700 -1 mon.a@0(leader).osd e21 definitely_dead 0 2020-01-26T15:35:19.546 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.544+0000 7fca71233d80 -1 Falling back to public interface 2020-01-26T15:35:19.744 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:19.740+0000 7fc62ae88d80 -1 osd.1 18 log_to_monitors {default=true} 2020-01-26T15:35:19.750 INFO:tasks.ceph.osd.1.smithi170.stderr:2020-01-26T15:35:19.748+0000 7fc625359700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:19.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.816+0000 7fea5a7fc700 1 -- 172.21.15.170:0/1395444038 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v22) v1 ==== 89+0+0 (unknown 897894868 0 0) 0x7fea4c0311e0 con 0x7fea5c061500 2020-01-26T15:35:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 >> v1:172.21.15.170:6800/17396 conn(0x7fea400401f0 legacy=0x7fea40042700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 >> v1:172.21.15.170:6791/0 conn(0x7fea5c061500 legacy=0x7fea5c07b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 shutdown_connections 2020-01-26T15:35:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 --2- 172.21.15.170:0/1395444038 >> v2:172.21.15.170:6790/0 conn(0x7fea5c07b800 0x7fea5c137a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 --2- 172.21.15.170:0/1395444038 >> v2:172.21.15.170:6791/0 conn(0x7fea5c09db50 0x7fea5c060fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 >> 172.21.15.170:0/1395444038 conn(0x7fea5c099040 msgr2=0x7fea5c0a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 shutdown_connections 2020-01-26T15:35:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.824+0000 7fea62363700 1 -- 172.21.15.170:0/1395444038 wait complete. 2020-01-26T15:35:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:marked down osd.2. 2020-01-26T15:35:19.836 INFO:tasks.ceph.osd.2:Restarting daemon 2020-01-26T15:35:19.836 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-01-26T15:35:19.868 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.864+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:19.869 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.864+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:19.872 INFO:tasks.ceph.osd.2:Started 2020-01-26T15:35:19.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:35:19.873 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:19.873 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.873 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.873 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.874 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.875 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.876 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.876 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.876 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.876 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:19.868+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:19.927 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:19.924+0000 7f3851fbf700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x55ed259d3f80 0x55ed26648000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:19.928 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:19.924+0000 7f3852fc1700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55ed259d4400 0x55ed26648580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d73af700 1 Processor -- start 2020-01-26T15:35:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d73af700 1 -- start start 2020-01-26T15:35:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d73af700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f78d005e5f0 0x7f78d00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d73af700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00a6dc0 con 0x7f78d005edd0 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d73af700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d005ea20 con 0x7f78d0149040 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d73af700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f78d0098000 con 0x7f78d005e5f0 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d8611700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f78d0149040 0x7f78d014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47574/0 (socket says 172.21.15.170:47574) 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d63ad700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f78d005e5f0 0x7f78d00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d8611700 1 -- 172.21.15.170:0/467846697 learned_addr learned my addr 172.21.15.170:0/467846697 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d6bae700 1 --1- 172.21.15.170:0/467846697 >> v1:172.21.15.170:6789/0 conn(0x7f78d005edd0 0x7f78d007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50694/0 (socket says 172.21.15.170:50694) 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.980+0000 7f78d63ad700 1 --2- 172.21.15.170:0/467846697 >> v2:172.21.15.170:6791/0 conn(0x7f78d005e5f0 0x7f78d00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155261504 0 0) 0x7f78d005ea20 con 0x7f78d0149040 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc003230 con 0x7f78d0149040 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814835844 0 0) 0x7f78d00a6dc0 con 0x7f78d005edd0 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d005ea20 con 0x7f78d005edd0 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1543016213 0 0) 0x7f78bc003230 con 0x7f78d0149040 2020-01-26T15:35:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 >> v2:172.21.15.170:6791/0 conn(0x7f78d005e5f0 msgr2=0x7f78d00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 --2- 172.21.15.170:0/467846697 >> v2:172.21.15.170:6791/0 conn(0x7f78d005e5f0 0x7f78d00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 >> v1:172.21.15.170:6789/0 conn(0x7f78d005edd0 legacy=0x7f78d007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d005e050 con 0x7f78d0149040 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f78c8001a60 con 0x7f78d0149040 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f78c8001dd0 con 0x7f78d0149040 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d5bac700 1 -- 172.21.15.170:0/467846697 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f78c8004930 con 0x7f78d0149040 2020-01-26T15:35:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 -- 172.21.15.170:0/467846697 >> v1:172.21.15.170:6790/0 conn(0x7f78d0149040 legacy=0x7f78d014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 -- 172.21.15.170:0/467846697 shutdown_connections 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 --2- 172.21.15.170:0/467846697 >> v2:172.21.15.170:6791/0 conn(0x7f78d005e5f0 0x7f78d00a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 -- 172.21.15.170:0/467846697 >> 172.21.15.170:0/467846697 conn(0x7f78d0098e70 msgr2=0x7f78d00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 -- 172.21.15.170:0/467846697 shutdown_connections 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 -- 172.21.15.170:0/467846697 wait complete. 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 Processor -- start 2020-01-26T15:35:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.984+0000 7f78d73af700 1 -- start start 2020-01-26T15:35:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f78d007d290 0x7f78d01399f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00a4f50 con 0x7f78d011f060 2020-01-26T15:35:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d0099a00 con 0x7f78d0099d40 2020-01-26T15:35:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00a11a0 con 0x7f78d007d290 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d8611700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f78d007d290 0x7f78d01399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d8611700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f78d007d290 0x7f78d01399f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d63ad700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f78d0099d40 0x7f78d007ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47576/0 (socket says 172.21.15.170:47576) 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d63ad700 1 -- 172.21.15.170:0/3631255599 learned_addr learned my addr 172.21.15.170:0/3631255599 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457920426 0 0) 0x7f78d00a4f50 con 0x7f78d011f060 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b8003230 con 0x7f78d011f060 2020-01-26T15:35:19.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432266752 0 0) 0x7f78d0099a00 con 0x7f78d0099d40 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d00a4f50 con 0x7f78d0099d40 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 133318456 0 0) 0x7f78b8003230 con 0x7f78d011f060 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78d0099a00 con 0x7f78d011f060 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f78cc001790 con 0x7f78d011f060 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3623533626 0 0) 0x7f78d00a4f50 con 0x7f78d0099d40 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78b8003230 con 0x7f78d0099d40 2020-01-26T15:35:19.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f78c0002710 con 0x7f78d0099d40 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2406488873 0 0) 0x7f78d0099a00 con 0x7f78d011f060 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 >> v2:172.21.15.170:6791/0 conn(0x7f78d007d290 msgr2=0x7f78d01399f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 --2- 172.21.15.170:0/3631255599 >> v2:172.21.15.170:6791/0 conn(0x7f78d007d290 0x7f78d01399f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 >> v1:172.21.15.170:6790/0 conn(0x7f78d0099d40 legacy=0x7f78d007ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d009b320 con 0x7f78d011f060 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d0123180 con 0x7f78d011f060 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d007d6c0 con 0x7f78d011f060 2020-01-26T15:35:19.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f78cc0044f0 con 0x7f78d011f060 2020-01-26T15:35:20.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f78cc004920 con 0x7f78d011f060 2020-01-26T15:35:20.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f78cc004ba0 con 0x7f78d011f060 2020-01-26T15:35:20.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac003360 con 0x7f78d011f060 2020-01-26T15:35:20.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.988+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(22..22 src has 1..22) v4 ==== 2854+0+0 (unknown 2205813793 0 0) 0x7f78cc04b660 con 0x7f78d011f060 2020-01-26T15:35:20.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:19.996+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f78cc030e00 con 0x7f78d011f060 2020-01-26T15:35:20.038 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.036+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:20.038 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.036+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:20.040 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.036+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.041 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.041 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.042 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.042 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.042 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.043 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.043 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.044 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.044 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.044 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.044 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f77a2e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.045 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck error: legacy statfs record found, removing 2020-01-26T15:35:20.045 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:35:20.045 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.040+0000 7f7f887d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:35:20.117 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.112+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78ac0021f0 con 0x7f78d011f060 2020-01-26T15:35:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78c77fe700 1 -- 172.21.15.170:0/3631255599 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+8963 (unknown 861009196 0 3661116749) 0x7f78cc04a4f0 con 0x7f78d011f060 2020-01-26T15:35:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 >> v1:172.21.15.170:6800/17396 conn(0x7f78b803e520 legacy=0x7f78b8040a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 >> v1:172.21.15.170:6789/0 conn(0x7f78d011f060 legacy=0x7f78d009ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 shutdown_connections 2020-01-26T15:35:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 --2- 172.21.15.170:0/3631255599 >> v2:172.21.15.170:6791/0 conn(0x7f78d007d290 0x7f78d01399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 >> 172.21.15.170:0/3631255599 conn(0x7f78d0099040 msgr2=0x7f78d00a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 shutdown_connections 2020-01-26T15:35:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:20.116+0000 7f78d73af700 1 -- 172.21.15.170:0/3631255599 wait complete. 2020-01-26T15:35:20.123 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:20.124 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":22,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:19.809376+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":11354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":11354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":11354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":11354}]},"public_addr":"172.21.15.170:6801/11354","cluster_addr":"172.21.15.170:6802/11354","heartbeat_back_addr":"172.21.15.170:6803/11354","heartbeat_front_addr":"172.21.15.170:6804/11354","state":["exists"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":13,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":18293}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":18293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":18293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":18293}]},"public_addr":"172.21.15.170:6801/18293","cluster_addr":"172.21.15.170:6802/18293","heartbeat_back_addr":"172.21.15.170:6804/18293","heartbeat_front_addr":"172.21.15.170:6803/18293","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":11355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":11355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":11355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":11355}]},"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":11358}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":11358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":11358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":11358}]},"public_addr":"172.21.15.170:6813/11358","cluster_addr":"172.21.15.170:6814/11358","heartbeat_back_addr":"172.21.15.170:6815/11358","heartbeat_front_addr":"172.21.15.170:6816/11358","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:35:19.809376+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:20.583 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.580+0000 7f3857aeed80 -1 Falling back to public interface 2020-01-26T15:35:20.866 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.864+0000 7f7f887d6d80 -1 osd.0 18 log_to_monitors {default=true} 2020-01-26T15:35:20.868 INFO:tasks.ceph.osd.0.smithi170.stderr:2020-01-26T15:35:20.864+0000 7f7f83ca9700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:20.927 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:20.927 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:20.929 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.929 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.929 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.930 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.930 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.930 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:20.930 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:20.924+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.210 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.208+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:21.210 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.208+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:21.212 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.208+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.213 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.213 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.214 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.214 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.214 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.215 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.215 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.216 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.216 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.216 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.216 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.217 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.217 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.212+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.217 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.218 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.218 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.218 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.219 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.219 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.219 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca6048b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:21.226 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck error: legacy statfs record found, removing 2020-01-26T15:35:21.226 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:35:21.226 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:21.216+0000 7fca71233d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:35:22.066 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:22.064+0000 7fca71233d80 -1 osd.3 20 log_to_monitors {default=true} 2020-01-26T15:35:22.068 INFO:tasks.ceph.osd.3.smithi170.stderr:2020-01-26T15:35:22.064+0000 7fca6bf05700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:22.140 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.136+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:35:22.141 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.136+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:35:22.142 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.142 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.143 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.143 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.143 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.144 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.144 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3846d46700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:35:22.145 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck error: legacy statfs record found, removing 2020-01-26T15:35:22.146 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:35:22.146 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.140+0000 7f3857aeed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:35:22.963 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.960+0000 7f3857aeed80 -1 osd.2 21 log_to_monitors {default=true} 2020-01-26T15:35:22.966 INFO:tasks.ceph.osd.2.smithi170.stderr:2020-01-26T15:35:22.964+0000 7f3851fbf700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:23.132 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe63083c700 1 Processor -- start 2020-01-26T15:35:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe63083c700 1 -- start start 2020-01-26T15:35:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe63083c700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c05ea20 con 0x7fe62c05e5f0 2020-01-26T15:35:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe63083c700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c098000 con 0x7fe62c0a6870 2020-01-26T15:35:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe63083c700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c05e050 con 0x7fe62c05edd0 2020-01-26T15:35:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe631a9e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe62c0a6870 0x7fe62c14c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47640/0 (socket says 172.21.15.170:47640) 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe631a9e700 1 -- 172.21.15.170:0/2274466540 learned_addr learned my addr 172.21.15.170:0/2274466540 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62b7fe700 1 --1- 172.21.15.170:0/2274466540 >> v1:172.21.15.170:6789/0 conn(0x7fe62c05e5f0 0x7fe62c149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50762/0 (socket says 172.21.15.170:50762) 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62bfff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fe62c05edd0 0x7fe62c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42762/0 (socket says 172.21.15.170:42762) 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847609101 0 0) 0x7fe62c098000 con 0x7fe62c0a6870 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe614003230 con 0x7fe62c0a6870 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928382934 0 0) 0x7fe62c05ea20 con 0x7fe62c05e5f0 2020-01-26T15:35:23.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c098000 con 0x7fe62c05e5f0 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640810048 0 0) 0x7fe62c05e050 con 0x7fe62c05edd0 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c05ea20 con 0x7fe62c05edd0 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3483991834 0 0) 0x7fe614003230 con 0x7fe62c0a6870 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 >> v1:172.21.15.170:6791/0 conn(0x7fe62c05edd0 legacy=0x7fe62c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 >> v1:172.21.15.170:6789/0 conn(0x7fe62c05e5f0 legacy=0x7fe62c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c0a6ca0 con 0x7fe62c0a6870 2020-01-26T15:35:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fe6240016e0 con 0x7fe62c0a6870 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fe624001a50 con 0x7fe62c0a6870 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe62affd700 1 -- 172.21.15.170:0/2274466540 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fe6240045b0 con 0x7fe62c0a6870 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.236+0000 7fe63083c700 1 -- 172.21.15.170:0/2274466540 >> v1:172.21.15.170:6790/0 conn(0x7fe62c0a6870 legacy=0x7fe62c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- 172.21.15.170:0/2274466540 shutdown_connections 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- 172.21.15.170:0/2274466540 >> 172.21.15.170:0/2274466540 conn(0x7fe62c098e70 msgr2=0x7fe62c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- 172.21.15.170:0/2274466540 shutdown_connections 2020-01-26T15:35:23.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- 172.21.15.170:0/2274466540 wait complete. 2020-01-26T15:35:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 Processor -- start 2020-01-26T15:35:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- start start 2020-01-26T15:35:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe62c0a1610 0x7fe62c121ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe62c120140 0x7fe62c137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c0a3750 con 0x7fe62c11f680 2020-01-26T15:35:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe62c120790 con 0x7fe62c0a1610 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe63083c700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe62c120a30 con 0x7fe62c120140 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe62b7fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe62c0a1610 0x7fe62c121ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe631a9e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe62c120140 0x7fe62c137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe62bfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe62c11f680 0x7fe62c07e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50766/0 (socket says 172.21.15.170:50766) 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe62bfff700 1 -- 172.21.15.170:0/2673381990 learned_addr learned my addr 172.21.15.170:0/2673381990 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe62b7fe700 1 --2- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6790/0 conn(0x7fe62c0a1610 0x7fe62c121ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.240+0000 7fe631a9e700 1 --2- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6791/0 conn(0x7fe62c120140 0x7fe62c137a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:23.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573413694 0 0) 0x7fe62c0a3750 con 0x7fe62c11f680 2020-01-26T15:35:23.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe60c003230 con 0x7fe62c11f680 2020-01-26T15:35:23.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 502147430 0 0) 0x7fe60c003230 con 0x7fe62c11f680 2020-01-26T15:35:23.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe62c0a3750 con 0x7fe62c11f680 2020-01-26T15:35:23.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fe61c001bb0 con 0x7fe62c11f680 2020-01-26T15:35:23.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1482631100 0 0) 0x7fe62c0a3750 con 0x7fe62c11f680 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6791/0 conn(0x7fe62c120140 msgr2=0x7fe62c137a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 --2- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6791/0 conn(0x7fe62c120140 0x7fe62c137a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6790/0 conn(0x7fe62c0a1610 msgr2=0x7fe62c121ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 --2- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6790/0 conn(0x7fe62c0a1610 0x7fe62c121ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c099a00 con 0x7fe62c11f680 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c07e8e0 con 0x7fe62c11f680 2020-01-26T15:35:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c138200 con 0x7fe62c11f680 2020-01-26T15:35:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fe61c004970 con 0x7fe62c11f680 2020-01-26T15:35:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fe61c004ce0 con 0x7fe62c11f680 2020-01-26T15:35:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c056600 con 0x7fe62c11f680 2020-01-26T15:35:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fe61c0107a0 con 0x7fe62c11f680 2020-01-26T15:35:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.244+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(25..25 src has 1..25) v4 ==== 2854+0+0 (unknown 3257784576 0 0) 0x7fe61c04bb50 con 0x7fe62c11f680 2020-01-26T15:35:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.252+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fe61c031290 con 0x7fe62c11f680 2020-01-26T15:35:23.371 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.368+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe62c120570 con 0x7fe62c11f680 2020-01-26T15:35:23.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.368+0000 7fe628ff9700 1 -- 172.21.15.170:0/2673381990 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8977 (unknown 780366164 0 1099583518) 0x7fe61c04a9e0 con 0x7fe62c11f680 2020-01-26T15:35:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:23.373 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:22.838860+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":24,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":18374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":18374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":18374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":18374}]},"public_addr":"172.21.15.170:6809/18374","cluster_addr":"172.21.15.170:6810/18374","heartbeat_back_addr":"172.21.15.170:6812/18374","heartbeat_front_addr":"172.21.15.170:6811/18374","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":24,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":18293}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":18293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":18293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":18293}]},"public_addr":"172.21.15.170:6801/18293","cluster_addr":"172.21.15.170:6802/18293","heartbeat_back_addr":"172.21.15.170:6804/18293","heartbeat_front_addr":"172.21.15.170:6803/18293","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":11355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":11355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":11355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":11355}]},"public_addr":"172.21.15.170:6805/11355","cluster_addr":"172.21.15.170:6806/11355","heartbeat_back_addr":"172.21.15.170:6807/11355","heartbeat_front_addr":"172.21.15.170:6808/11355","state":["exists"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":18499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":18499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":18499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":18499}]},"public_addr":"172.21.15.170:6805/18499","cluster_addr":"172.21.15.170:6806/18499","heartbeat_back_addr":"172.21.15.170:6808/18499","heartbeat_front_addr":"172.21.15.170:6807/18499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:35:19.809376+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:23.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 >> v1:172.21.15.170:6800/17396 conn(0x7fe60c03e120 legacy=0x7fe60c040630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:23.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 >> v1:172.21.15.170:6789/0 conn(0x7fe62c11f680 legacy=0x7fe62c07e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:23.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 shutdown_connections 2020-01-26T15:35:23.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 --2- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6791/0 conn(0x7fe62c120140 0x7fe62c137a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:23.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 --2- 172.21.15.170:0/2673381990 >> v2:172.21.15.170:6790/0 conn(0x7fe62c0a1610 0x7fe62c121ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:23.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 >> 172.21.15.170:0/2673381990 conn(0x7fe62c0979d0 msgr2=0x7fe62c0a2780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:23.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 shutdown_connections 2020-01-26T15:35:23.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:23.372+0000 7fe63083c700 1 -- 172.21.15.170:0/2673381990 wait complete. 2020-01-26T15:35:26.388 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:26.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.504+0000 7f53d5461700 1 Processor -- start 2020-01-26T15:35:26.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.504+0000 7f53d5461700 1 -- start start 2020-01-26T15:35:26.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.504+0000 7f53d5461700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f53d00a6870 0x7f53d014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:26.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.504+0000 7f53d5461700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d005ea20 con 0x7f53d005e5f0 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.504+0000 7f53d5461700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d0098000 con 0x7f53d005edd0 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.504+0000 7f53d5461700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f53d005e050 con 0x7f53d00a6870 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d66c3700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f53d00a6870 0x7f53d014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d66c3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f53d00a6870 0x7f53d014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cffff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f53d005e5f0 0x7f53d0149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50808/0 (socket says 172.21.15.170:50808) 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cffff700 1 -- 172.21.15.170:0/853638346 learned_addr learned my addr 172.21.15.170:0/853638346 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743612216 0 0) 0x7f53d0098000 con 0x7f53d005edd0 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c0003230 con 0x7f53d005edd0 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876187089 0 0) 0x7f53d005ea20 con 0x7f53d005e5f0 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d0098000 con 0x7f53d005e5f0 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3666039784 0 0) 0x7f53c0003230 con 0x7f53d005edd0 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 >> v2:172.21.15.170:6790/0 conn(0x7f53d00a6870 msgr2=0x7f53d014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 --2- 172.21.15.170:0/853638346 >> v2:172.21.15.170:6790/0 conn(0x7f53d00a6870 0x7f53d014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 >> v1:172.21.15.170:6789/0 conn(0x7f53d005e5f0 legacy=0x7f53d0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:26.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00a6ca0 con 0x7f53d005edd0 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f53c40016e0 con 0x7f53d005edd0 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f53c4001980 con 0x7f53d005edd0 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53cf7fe700 1 -- 172.21.15.170:0/853638346 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f53c4001ec0 con 0x7f53d005edd0 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 -- 172.21.15.170:0/853638346 >> v1:172.21.15.170:6790/0 conn(0x7f53d005edd0 legacy=0x7f53d007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 -- 172.21.15.170:0/853638346 shutdown_connections 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 --2- 172.21.15.170:0/853638346 >> v2:172.21.15.170:6790/0 conn(0x7f53d00a6870 0x7f53d014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:26.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 -- 172.21.15.170:0/853638346 >> 172.21.15.170:0/853638346 conn(0x7f53d0098e70 msgr2=0x7f53d00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:26.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 -- 172.21.15.170:0/853638346 shutdown_connections 2020-01-26T15:35:26.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 -- 172.21.15.170:0/853638346 wait complete. 2020-01-26T15:35:26.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 Processor -- start 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.508+0000 7f53d5461700 1 -- start start 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d5461700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f53d00247b0 0x7f53d0024be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d5461700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d0121da0 con 0x7f53d0025130 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d5461700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00a14a0 con 0x7f53d0121820 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d5461700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00a37b0 con 0x7f53d00247b0 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d66c3700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f53d0025130 0x7f53d013b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47690/0 (socket says 172.21.15.170:47690) 2020-01-26T15:35:26.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d66c3700 1 -- 172.21.15.170:0/1957027700 learned_addr learned my addr 172.21.15.170:0/1957027700 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cffff700 -1 --2- 172.21.15.170:0/1957027700 >> v2:172.21.15.170:6791/0 conn(0x7f53d00247b0 0x7f53d0024be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cffff700 1 --2- 172.21.15.170:0/1957027700 >> v2:172.21.15.170:6791/0 conn(0x7f53d00247b0 0x7f53d0024be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257159962 0 0) 0x7f53d00a14a0 con 0x7f53d0121820 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b0003230 con 0x7f53d0121820 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374576803 0 0) 0x7f53d0121da0 con 0x7f53d0025130 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d00a14a0 con 0x7f53d0025130 2020-01-26T15:35:26.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3692121628 0 0) 0x7f53b0003230 con 0x7f53d0121820 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f53d0121da0 con 0x7f53d0121820 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f53c4001af0 con 0x7f53d0121820 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3136834482 0 0) 0x7f53d0121da0 con 0x7f53d0121820 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 >> v2:172.21.15.170:6791/0 conn(0x7f53d00247b0 msgr2=0x7f53d0024be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 --2- 172.21.15.170:0/1957027700 >> v2:172.21.15.170:6791/0 conn(0x7f53d00247b0 0x7f53d0024be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 >> v1:172.21.15.170:6790/0 conn(0x7f53d0025130 legacy=0x7f53d013b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0025560 con 0x7f53d0121820 2020-01-26T15:35:26.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d011fd70 con 0x7f53d0121820 2020-01-26T15:35:26.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d009e2f0 con 0x7f53d0121820 2020-01-26T15:35:26.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f53c4001ea0 con 0x7f53d0121820 2020-01-26T15:35:26.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f53c40025c0 con 0x7f53d0121820 2020-01-26T15:35:26.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f53c400e000 con 0x7f53d0121820 2020-01-26T15:35:26.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.512+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(27..27 src has 1..27) v4 ==== 2854+0+0 (unknown 3893519493 0 0) 0x7f53c4049150 con 0x7f53d0121820 2020-01-26T15:35:26.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.516+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a8003360 con 0x7f53d0121820 2020-01-26T15:35:26.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.520+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f53d009e2f0 con 0x7f53d0121820 2020-01-26T15:35:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53a80037e0 con 0x7f53d0121820 2020-01-26T15:35:26.643 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53cd7fa700 1 -- 172.21.15.170:0/1957027700 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+8984 (unknown 3600925931 0 1851054844) 0x7f53c402e780 con 0x7f53d0121820 2020-01-26T15:35:26.644 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:26.644 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":27,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:24.844226+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":18374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":18374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":18374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":18374}]},"public_addr":"172.21.15.170:6809/18374","cluster_addr":"172.21.15.170:6810/18374","heartbeat_back_addr":"172.21.15.170:6812/18374","heartbeat_front_addr":"172.21.15.170:6811/18374","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":18293}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":18293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":18293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":18293}]},"public_addr":"172.21.15.170:6801/18293","cluster_addr":"172.21.15.170:6802/18293","heartbeat_back_addr":"172.21.15.170:6804/18293","heartbeat_front_addr":"172.21.15.170:6803/18293","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":26,"up_thru":26,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":18671}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":18671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":18671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":18671}]},"public_addr":"172.21.15.170:6813/18671","cluster_addr":"172.21.15.170:6814/18671","heartbeat_back_addr":"172.21.15.170:6816/18671","heartbeat_front_addr":"172.21.15.170:6815/18671","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":18499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":18499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":18499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":18499}]},"public_addr":"172.21.15.170:6805/18499","cluster_addr":"172.21.15.170:6806/18499","heartbeat_back_addr":"172.21.15.170:6808/18499","heartbeat_front_addr":"172.21.15.170:6807/18499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:35:19.809376+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:26.645 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 >> v1:172.21.15.170:6800/17396 conn(0x7f53b003e0f0 legacy=0x7f53b0040600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:26.645 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 >> v1:172.21.15.170:6791/0 conn(0x7f53d0121820 legacy=0x7f53d011f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:26.645 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 shutdown_connections 2020-01-26T15:35:26.645 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 --2- 172.21.15.170:0/1957027700 >> v2:172.21.15.170:6791/0 conn(0x7f53d00247b0 0x7f53d0024be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:26.645 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 >> 172.21.15.170:0/1957027700 conn(0x7f53d00a1fc0 msgr2=0x7f53d00a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:26.646 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.640+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 shutdown_connections 2020-01-26T15:35:26.646 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:26.644+0000 7f53d5461700 1 -- 172.21.15.170:0/1957027700 wait complete. 2020-01-26T15:35:26.657 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:35:26.657 INFO:teuthology.run_tasks:Running task ceph.stop... 2020-01-26T15:35:26.672 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2020-01-26T15:35:26.673 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-01-26T15:35:26.673 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:35:26.689 INFO:tasks.ceph.mds.c:Stopped 2020-01-26T15:35:26.690 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2020-01-26T15:35:31.103 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2020-01-26T15:35:31.103 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-01-26T15:35:31.147 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2020-01-26T15:35:31.148 INFO:tasks.ceph.mds.a:Restarting daemon 2020-01-26T15:35:31.148 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-01-26T15:35:31.151 INFO:tasks.ceph.mds.a:Started 2020-01-26T15:35:31.151 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2020-01-26T15:35:31.151 INFO:tasks.ceph.mds.c:Restarting daemon 2020-01-26T15:35:31.151 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-01-26T15:35:31.154 INFO:tasks.ceph.mds.c:Started 2020-01-26T15:35:31.154 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2020-01-26T15:35:31.154 INFO:tasks.ceph.mds.b:Restarting daemon 2020-01-26T15:35:31.154 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-01-26T15:35:31.156 INFO:tasks.ceph.mds.b:Started 2020-01-26T15:35:31.156 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:35:31.157 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:31.217 INFO:tasks.ceph.mds.a.smithi170.stderr:2020-01-26T15:35:31.216+0000 7f82e954d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x55c16c591200 0x55c16d1fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:31.218 INFO:tasks.ceph.mds.a.smithi170.stderr:2020-01-26T15:35:31.216+0000 7f82e9d4e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55c16c590d80 0x55c16d1fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.219 INFO:tasks.ceph.mds.a.smithi170.stdout:starting mds.a at 2020-01-26T15:35:31.223 INFO:tasks.ceph.mds.b.smithi170.stderr:2020-01-26T15:35:31.220+0000 7f93bea06700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55bbdb581680 0x55bbdc1f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.224 INFO:tasks.ceph.mds.a.smithi170.stderr:2020-01-26T15:35:31.220+0000 7f82ea54f700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:31.228 INFO:tasks.ceph.mds.c.smithi170.stderr:2020-01-26T15:35:31.224+0000 7f7d24051700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x5558b8fb1680 0x5558b9c34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.229 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2020-01-26T15:35:31.229 INFO:tasks.ceph.mds.c.smithi170.stderr:2020-01-26T15:35:31.228+0000 7f7d2304f700 -1 --2- 172.21.15.170:0/2286806513 >> v2:172.21.15.170:6791/0 conn(0x5558b8fb1200 0x5558b9c34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:31.231 INFO:tasks.ceph.mds.b.smithi170.stderr:2020-01-26T15:35:31.228+0000 7f93bda04700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:31.232 INFO:tasks.ceph.mds.c.smithi170.stdout:starting mds.c at 2020-01-26T15:35:31.233 INFO:tasks.ceph.mds.c.smithi170.stderr:2020-01-26T15:35:31.232+0000 7f7d23850700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:31.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 Processor -- start 2020-01-26T15:35:31.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 -- start start 2020-01-26T15:35:31.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fdd1405edd0 0x7fdd1405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:31.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd14098000 con 0x7fdd140a6870 2020-01-26T15:35:31.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1405e050 con 0x7fdd14149040 2020-01-26T15:35:31.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdd140a6ca0 con 0x7fdd1405edd0 2020-01-26T15:35:31.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd1a00f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fdd14149040 0x7fdd1414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47736/0 (socket says 172.21.15.170:47736) 2020-01-26T15:35:31.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd1a00f700 1 -- 172.21.15.170:0/2298574387 learned_addr learned my addr 172.21.15.170:0/2298574387 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd13fff700 -1 --2- 172.21.15.170:0/2298574387 >> v2:172.21.15.170:6790/0 conn(0x7fdd1405edd0 0x7fdd1405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd13fff700 1 --2- 172.21.15.170:0/2298574387 >> v2:172.21.15.170:6790/0 conn(0x7fdd1405edd0 0x7fdd1405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508760319 0 0) 0x7fdd1405e050 con 0x7fdd14149040 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcfc003230 con 0x7fdd14149040 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063091050 0 0) 0x7fdd14098000 con 0x7fdd140a6870 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd1405e050 con 0x7fdd140a6870 2020-01-26T15:35:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 591609174 0 0) 0x7fdcfc003230 con 0x7fdd14149040 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 >> v2:172.21.15.170:6790/0 conn(0x7fdd1405edd0 msgr2=0x7fdd1405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 --2- 172.21.15.170:0/2298574387 >> v2:172.21.15.170:6790/0 conn(0x7fdd1405edd0 0x7fdd1405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 >> v1:172.21.15.170:6789/0 conn(0x7fdd140a6870 legacy=0x7fdd1407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1414ecb0 con 0x7fdd14149040 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdd0c001a60 con 0x7fdd14149040 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdd0c001dd0 con 0x7fdd14149040 2020-01-26T15:35:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd12ffd700 1 -- 172.21.15.170:0/2298574387 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdd0c004930 con 0x7fdd14149040 2020-01-26T15:35:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.264+0000 7fdd18dad700 1 -- 172.21.15.170:0/2298574387 >> v1:172.21.15.170:6790/0 conn(0x7fdd14149040 legacy=0x7fdd1414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- 172.21.15.170:0/2298574387 shutdown_connections 2020-01-26T15:35:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 --2- 172.21.15.170:0/2298574387 >> v2:172.21.15.170:6790/0 conn(0x7fdd1405edd0 0x7fdd1405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- 172.21.15.170:0/2298574387 >> 172.21.15.170:0/2298574387 conn(0x7fdd14098e70 msgr2=0x7fdd140a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- 172.21.15.170:0/2298574387 shutdown_connections 2020-01-26T15:35:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- 172.21.15.170:0/2298574387 wait complete. 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 Processor -- start 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- start start 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fdd1409aa00 0x7fdd14024fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdd1411e260 0x7fdd1411e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1409af40 con 0x7fdd1409a5a0 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1411f1e0 con 0x7fdd1409aa00 2020-01-26T15:35:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd18dad700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1411f6c0 con 0x7fdd1411e260 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd1a00f700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdd1411e260 0x7fdd1411e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd1a00f700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdd1411e260 0x7fdd1411e690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd13fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fdd1409a5a0 0x7fdd1409ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50864/0 (socket says 172.21.15.170:50864) 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd13fff700 1 -- 172.21.15.170:0/1762413980 learned_addr learned my addr 172.21.15.170:0/1762413980 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd137fe700 -1 --2- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6790/0 conn(0x7fdd1409aa00 0x7fdd14024fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd137fe700 1 --2- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6790/0 conn(0x7fdd1409aa00 0x7fdd14024fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893992021 0 0) 0x7fdd1409af40 con 0x7fdd1409a5a0 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf4003230 con 0x7fdd1409a5a0 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2236927078 0 0) 0x7fdcf4003230 con 0x7fdd1409a5a0 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdd1409af40 con 0x7fdd1409a5a0 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdd04002750 con 0x7fdd1409a5a0 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2368970456 0 0) 0x7fdd1409af40 con 0x7fdd1409a5a0 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6791/0 conn(0x7fdd1411e260 msgr2=0x7fdd1411e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 --2- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6791/0 conn(0x7fdd1411e260 0x7fdd1411e690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.268+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6790/0 conn(0x7fdd1409aa00 msgr2=0x7fdd14024fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd10ff9700 1 --2- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6790/0 conn(0x7fdd1409aa00 0x7fdd14024fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1411ebe0 con 0x7fdd1409a5a0 2020-01-26T15:35:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd14138530 con 0x7fdd1409a5a0 2020-01-26T15:35:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd14138a30 con 0x7fdd1409a5a0 2020-01-26T15:35:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdd04000e90 con 0x7fdd1409a5a0 2020-01-26T15:35:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7fdd04001280 con 0x7fdd1409a5a0 2020-01-26T15:35:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fdd04001500 con 0x7fdd1409a5a0 2020-01-26T15:35:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcec003360 con 0x7fdd1409a5a0 2020-01-26T15:35:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.272+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 8 ==== osd_map(28..28 src has 1..28) v4 ==== 2897+0+0 (unknown 2549143237 0 0) 0x7fdd0404b980 con 0x7fdd1409a5a0 2020-01-26T15:35:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.280+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fdd04031120 con 0x7fdd1409a5a0 2020-01-26T15:35:31.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 --> v1:172.21.15.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcec0021f0 con 0x7fdd1409a5a0 2020-01-26T15:35:31.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd10ff9700 1 -- 172.21.15.170:0/1762413980 <== mon.0 v1:172.21.15.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+9051 (unknown 634195324 0 2754743336) 0x7fdd0404a7e0 con 0x7fdd1409a5a0 2020-01-26T15:35:31.403 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:31.403 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":28,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:31.240390+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":18374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":18374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":18374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":18374}]},"public_addr":"172.21.15.170:6809/18374","cluster_addr":"172.21.15.170:6810/18374","heartbeat_back_addr":"172.21.15.170:6812/18374","heartbeat_front_addr":"172.21.15.170:6811/18374","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":18293}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":18293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":18293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":18293}]},"public_addr":"172.21.15.170:6801/18293","cluster_addr":"172.21.15.170:6802/18293","heartbeat_back_addr":"172.21.15.170:6804/18293","heartbeat_front_addr":"172.21.15.170:6803/18293","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":26,"up_thru":26,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":18671}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":18671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":18671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":18671}]},"public_addr":"172.21.15.170:6813/18671","cluster_addr":"172.21.15.170:6814/18671","heartbeat_back_addr":"172.21.15.170:6816/18671","heartbeat_front_addr":"172.21.15.170:6815/18671","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":18499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":18499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":18499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":18499}]},"public_addr":"172.21.15.170:6805/18499","cluster_addr":"172.21.15.170:6806/18499","heartbeat_back_addr":"172.21.15.170:6808/18499","heartbeat_front_addr":"172.21.15.170:6807/18499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:35:19.809376+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.170:6817/12433226":"2020-01-27T15:35:31.240361+0000","v1:172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:31.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 >> v1:172.21.15.170:6800/17396 conn(0x7fdcf403e0e0 legacy=0x7fdcf40405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 >> v1:172.21.15.170:6789/0 conn(0x7fdd1409a5a0 legacy=0x7fdd1409ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 shutdown_connections 2020-01-26T15:35:31.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 --2- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6791/0 conn(0x7fdd1411e260 0x7fdd1411e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 --2- 172.21.15.170:0/1762413980 >> v2:172.21.15.170:6790/0 conn(0x7fdd1409aa00 0x7fdd14024fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 >> 172.21.15.170:0/1762413980 conn(0x7fdd14098f40 msgr2=0x7fdd140a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:31.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 shutdown_connections 2020-01-26T15:35:31.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.400+0000 7fdd18dad700 1 -- 172.21.15.170:0/1762413980 wait complete. 2020-01-26T15:35:31.416 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:35:31.416 INFO:teuthology.run_tasks:Running task exec... 2020-01-26T15:35:31.431 INFO:teuthology.task.exec:Executing custom commands... 2020-01-26T15:35:31.431 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2020-01-26T15:35:31.431 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mon enable-msgr2' 2020-01-26T15:35:31.475 INFO:tasks.ceph.mds.a.smithi170.stderr:2020-01-26T15:35:31.472+0000 7f82e0d3c700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:35:31.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.540+0000 7f3b620f3700 1 Processor -- start 2020-01-26T15:35:31.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.540+0000 7f3b620f3700 1 -- start start 2020-01-26T15:35:31.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f3b5c097720 0x7f3b5c060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:31.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3b5c05f5a0 0x7f3b5c0a7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:31.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c0a77b0 con 0x7f3b5c065e30 2020-01-26T15:35:31.549 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c065bd0 con 0x7f3b5c05f5a0 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c1442e0 con 0x7f3b5c097720 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b610f1700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f3b5c097720 0x7f3b5c060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b63355700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3b5c05f5a0 0x7f3b5c0a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b618f2700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f3b5c065e30 0x7f3b5c144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47756/0 (socket says 172.21.15.170:47756) 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b618f2700 1 -- 172.21.15.170:0/1242421178 learned_addr learned my addr 172.21.15.170:0/1242421178 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b610f1700 1 --2- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6791/0 conn(0x7f3b5c097720 0x7f3b5c060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b63355700 1 --2- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c05f5a0 0x7f3b5c0a7260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172650084 0 0) 0x7f3b5c0a77b0 con 0x7f3b5c065e30 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b48003230 con 0x7f3b5c065e30 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2722482467 0 0) 0x7f3b48003230 con 0x7f3b5c065e30 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6791/0 conn(0x7f3b5c097720 msgr2=0x7f3b5c060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 --2- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6791/0 conn(0x7f3b5c097720 0x7f3b5c060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c05f5a0 msgr2=0x7f3b5c0a7260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:31.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 --2- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c05f5a0 0x7f3b5c0a7260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c145160 con 0x7f3b5c065e30 2020-01-26T15:35:31.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3b58001a60 con 0x7f3b5c065e30 2020-01-26T15:35:31.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3b58001d00 con 0x7f3b5c065e30 2020-01-26T15:35:31.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b608f0700 1 -- 172.21.15.170:0/1242421178 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3b58004930 con 0x7f3b5c065e30 2020-01-26T15:35:31.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- 172.21.15.170:0/1242421178 >> v1:172.21.15.170:6790/0 conn(0x7f3b5c065e30 legacy=0x7f3b5c144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- 172.21.15.170:0/1242421178 shutdown_connections 2020-01-26T15:35:31.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 --2- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c05f5a0 0x7f3b5c0a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 --2- 172.21.15.170:0/1242421178 >> v2:172.21.15.170:6791/0 conn(0x7f3b5c097720 0x7f3b5c060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- 172.21.15.170:0/1242421178 >> 172.21.15.170:0/1242421178 conn(0x7f3b5c060030 msgr2=0x7f3b5c05e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:31.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- 172.21.15.170:0/1242421178 shutdown_connections 2020-01-26T15:35:31.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.544+0000 7f3b620f3700 1 -- 172.21.15.170:0/1242421178 wait complete. 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 Processor -- start 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 -- start start 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3b5c1325d0 0x7f3b5c134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c062580 con 0x7f3b5c07a110 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c064730 con 0x7f3b5c062150 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c07f5d0 con 0x7f3b5c1325d0 2020-01-26T15:35:31.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b63355700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3b5c1325d0 0x7f3b5c134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b618f2700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f3b5c062150 0x7f3b5c0639d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42888/0 (socket says 172.21.15.170:42888) 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b618f2700 1 -- 172.21.15.170:0/1988888157 learned_addr learned my addr 172.21.15.170:0/1988888157 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b63355700 1 --2- 172.21.15.170:0/1988888157 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c1325d0 0x7f3b5c134a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835802848 0 0) 0x7f3b5c062580 con 0x7f3b5c07a110 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b44003230 con 0x7f3b5c07a110 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994337849 0 0) 0x7f3b5c064730 con 0x7f3b5c062150 2020-01-26T15:35:31.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b5c062580 con 0x7f3b5c062150 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2409702239 0 0) 0x7f3b44003230 con 0x7f3b5c07a110 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b5c064730 con 0x7f3b5c07a110 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3b4c002670 con 0x7f3b5c07a110 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4140057589 0 0) 0x7f3b5c062580 con 0x7f3b5c062150 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b44003230 con 0x7f3b5c062150 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3b58001bb0 con 0x7f3b5c062150 2020-01-26T15:35:31.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3692075206 0 0) 0x7f3b5c064730 con 0x7f3b5c07a110 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c1325d0 msgr2=0x7f3b5c134a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 --2- 172.21.15.170:0/1988888157 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c1325d0 0x7f3b5c134a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 >> v1:172.21.15.170:6791/0 conn(0x7f3b5c062150 legacy=0x7f3b5c0639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0257c0 con 0x7f3b5c07a110 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c0a6040 con 0x7f3b5c07a110 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c064d00 con 0x7f3b5c07a110 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3b4c000e90 con 0x7f3b5c07a110 2020-01-26T15:35:31.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.548+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 2741850770 0 0) 0x7f3b4c001280 con 0x7f3b5c07a110 2020-01-26T15:35:31.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.552+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f3b4c001480 con 0x7f3b5c07a110 2020-01-26T15:35:31.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.552+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b38003360 con 0x7f3b5c07a110 2020-01-26T15:35:31.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.552+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(28..28 src has 1..28) v4 ==== 2897+0+0 (unknown 2549143237 0 0) 0x7f3b4c04b670 con 0x7f3b5c07a110 2020-01-26T15:35:31.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.556+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f3b4c030de0 con 0x7f3b5c07a110 2020-01-26T15:35:31.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.712+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "mon enable-msgr2"} v 0) v1 -- 0x7f3b380037d0 con 0x7f3b5c07a110 2020-01-26T15:35:31.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.712+0000 7f3b527fc700 1 -- 172.21.15.170:0/1988888157 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "mon enable-msgr2"}]=0 v2) v1 ==== 64+0+0 (unknown 626962205 0 0) 0x7f3b4c04a4d0 con 0x7f3b5c07a110 2020-01-26T15:35:31.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.716+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 >> v1:172.21.15.170:6800/17396 conn(0x7f3b4403e5d0 legacy=0x7f3b44040ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.716+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 >> v1:172.21.15.170:6790/0 conn(0x7f3b5c07a110 legacy=0x7f3b5c07a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.716+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 shutdown_connections 2020-01-26T15:35:31.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.716+0000 7f3b620f3700 1 --2- 172.21.15.170:0/1988888157 >> v2:172.21.15.170:6790/0 conn(0x7f3b5c1325d0 0x7f3b5c134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.716+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 >> 172.21.15.170:0/1988888157 conn(0x7f3b5c05f580 msgr2=0x7f3b5c07fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:31.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.720+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 shutdown_connections 2020-01-26T15:35:31.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.720+0000 7f3b620f3700 1 -- 172.21.15.170:0/1988888157 wait complete. 2020-01-26T15:35:31.735 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2020-01-26T15:35:31.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 Processor -- start 2020-01-26T15:35:31.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 -- start start 2020-01-26T15:35:31.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe688065e30 0x7fe688060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:31.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe688097720 0x7fe688144960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:31.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880a7a60 con 0x7fe68805f5a0 2020-01-26T15:35:31.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe688065bd0 con 0x7fe688065e30 2020-01-26T15:35:31.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe687fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe6881442e0 con 0x7fe688097720 2020-01-26T15:35:31.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe686ffd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe688097720 0x7fe688144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:31.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe6877fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe688065e30 0x7fe688060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe6877fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe688065e30 0x7fe688060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe686ffd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe688097720 0x7fe688144960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe68d732700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe68805f5a0 0x7fe6880a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50926/0 (socket says 172.21.15.170:50926) 2020-01-26T15:35:31.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe68d732700 1 -- 172.21.15.170:0/193305146 learned_addr learned my addr 172.21.15.170:0/193305146 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103804147 0 0) 0x7fe6880a7a60 con 0x7fe68805f5a0 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.868+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe674003230 con 0x7fe68805f5a0 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3759057609 0 0) 0x7fe674003230 con 0x7fe68805f5a0 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 >> v2:172.21.15.170:6791/0 conn(0x7fe688097720 msgr2=0x7fe688144960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 --2- 172.21.15.170:0/193305146 >> v2:172.21.15.170:6791/0 conn(0x7fe688097720 0x7fe688144960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 >> v2:172.21.15.170:6790/0 conn(0x7fe688065e30 msgr2=0x7fe688060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 --2- 172.21.15.170:0/193305146 >> v2:172.21.15.170:6790/0 conn(0x7fe688065e30 0x7fe688060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:31.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688144eb0 con 0x7fe68805f5a0 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe678001710 con 0x7fe68805f5a0 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 >> v1:172.21.15.170:6789/0 conn(0x7fe68805f5a0 legacy=0x7fe6880a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe674003230 con 0x7fe67400a330 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe6880a7a60 con 0x7fe674003890 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe688065bd0 con 0x7fe6740077d0 2020-01-26T15:35:31.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:31.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300257053 0 0) 0x7fe6880a7a60 con 0x7fe674003890 2020-01-26T15:35:31.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe67400f740 con 0x7fe674003890 2020-01-26T15:35:31.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654070086 0 0) 0x7fe674003230 con 0x7fe67400a330 2020-01-26T15:35:31.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6880a7a60 con 0x7fe67400a330 2020-01-26T15:35:31.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 -- 172.21.15.170:0/193305146 >> v1:172.21.15.170:6791/0 conn(0x7fe674003890 legacy=0x7fe674003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 -- 172.21.15.170:0/193305146 >> v1:172.21.15.170:6790/0 conn(0x7fe67400a330 legacy=0x7fe67400c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe68d732700 1 -- 172.21.15.170:0/193305146 reap_dead start 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 -- 172.21.15.170:0/193305146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67400f390 con 0x7fe6740077d0 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6800032b0 tx=0x7fe6800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6800032b0 tx=0x7fe6800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fe6800032b0 tx=0x7fe6800101e0).ready entity=mon.0 client_cookie=995897b3a93f5edf server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6800032b0 tx=0x7fe6800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe680010ab0 con 0x7fe6740077d0 2020-01-26T15:35:31.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6800032b0 tx=0x7fe6800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe686ffd700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6800032b0 tx=0x7fe6800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe680010d50 con 0x7fe6740077d0 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe6867fc700 1 -- 172.21.15.170:0/193305146 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe6800110c0 con 0x7fe6740077d0 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 -- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 msgr2=0x7fe674009cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fe6800032b0 tx=0x7fe6800101e0).stop 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 -- 172.21.15.170:0/193305146 shutdown_connections 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 --2- 172.21.15.170:0/193305146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6740077d0 0x7fe674009cb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 -- 172.21.15.170:0/193305146 >> 172.21.15.170:0/193305146 conn(0x7fe688060030 msgr2=0x7fe68805e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 -- 172.21.15.170:0/193305146 shutdown_connections 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 -- 172.21.15.170:0/193305146 wait complete. 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 Processor -- start 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.872+0000 7fe687fff700 1 -- start start 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe688136f50 0x7fe688137380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe688124470 0x7fe6881248a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:31.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68807dbb0 con 0x7fe688079630 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880a5190 con 0x7fe688124470 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe688077450 con 0x7fe688136f50 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe688079630 0x7fe688079bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50934/0 (socket says 172.21.15.170:50934) 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 -- 172.21.15.170:0/2941371031 learned_addr learned my addr 172.21.15.170:0/2941371031 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe68d732700 -1 --2- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6790/0 conn(0x7fe688124470 0x7fe6881248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe68d732700 1 --2- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6790/0 conn(0x7fe688124470 0x7fe6881248a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.891 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe686ffd700 -1 --2- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6791/0 conn(0x7fe688136f50 0x7fe688137380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe686ffd700 1 --2- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6791/0 conn(0x7fe688136f50 0x7fe688137380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913813058 0 0) 0x7fe68807dbb0 con 0x7fe688079630 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c003230 con 0x7fe688079630 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4273862955 0 0) 0x7fe66c003230 con 0x7fe688079630 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe68807dbb0 con 0x7fe688079630 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe6700016f0 con 0x7fe688079630 2020-01-26T15:35:31.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6791/0 conn(0x7fe688136f50 msgr2=0x7fe688137380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:31.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 --2- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6791/0 conn(0x7fe688136f50 0x7fe688137380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6790/0 conn(0x7fe688124470 msgr2=0x7fe6881248a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:31.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 --2- 172.21.15.170:0/2941371031 >> v2:172.21.15.170:6790/0 conn(0x7fe688124470 0x7fe6881248a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:31.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 >> v1:172.21.15.170:6789/0 conn(0x7fe688079630 legacy=0x7fe688079bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe66c003230 con 0x7fe66c00a7f0 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe66c005380 con 0x7fe66c0045a0 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880a5190 con 0x7fe66c003a20 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426601681 0 0) 0x7fe66c005380 con 0x7fe66c0045a0 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c00e440 con 0x7fe66c0045a0 2020-01-26T15:35:31.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820789409 0 0) 0x7fe66c003230 con 0x7fe66c00a7f0 2020-01-26T15:35:31.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c005380 con 0x7fe66c00a7f0 2020-01-26T15:35:31.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 -- 172.21.15.170:0/2941371031 >> v1:172.21.15.170:6791/0 conn(0x7fe66c0045a0 legacy=0x7fe66c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 -- 172.21.15.170:0/2941371031 >> v1:172.21.15.170:6790/0 conn(0x7fe66c00a7f0 legacy=0x7fe66c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:31.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe68d732700 1 -- 172.21.15.170:0/2941371031 reap_dead start 2020-01-26T15:35:31.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 -- 172.21.15.170:0/2941371031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688124df0 con 0x7fe66c003a20 2020-01-26T15:35:31.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6881250c0 con 0x7fe66c003a20 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe688079630 con 0x7fe66c003a20 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe67000e310 con 0x7fe66c003a20 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe67000e510 con 0x7fe66c003a20 2020-01-26T15:35:31.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe670005760 con 0x7fe66c003a20 2020-01-26T15:35:31.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.876+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.880+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe660003360 con 0x7fe66c003a20 2020-01-26T15:35:31.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.880+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe6700059b0 con 0x7fe66c003a20 2020-01-26T15:35:31.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.880+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.880+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2897+0+0 (secure 0 0 0) 0x7fe67004dea0 con 0x7fe66c003a20 2020-01-26T15:35:31.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.884+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:31.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:31.884+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe670034050 con 0x7fe66c003a20 2020-01-26T15:35:32.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.044+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe6600037a0 con 0x7fe66c003a20 2020-01-26T15:35:32.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.044+0000 7fe6877fe700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.049 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.044+0000 7fe67ffff700 1 -- 172.21.15.170:0/2941371031 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fe6700342b0 con 0x7fe66c003a20 2020-01-26T15:35:32.049 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:35:32.049 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2020-01-26T15:35:32.049 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 3 2020-01-26T15:35:32.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.049 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 2 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 4 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 3 2020-01-26T15:35:32.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.051 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2020-01-26T15:35:32.051 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 12 2020-01-26T15:35:32.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.051 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:35:32.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 >> v1:172.21.15.170:6800/17396 conn(0x7fe66c040b90 legacy=0x7fe66c0430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 msgr2=0x7fe66c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fe67000c8b0 tx=0x7fe670011630).stop 2020-01-26T15:35:32.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 shutdown_connections 2020-01-26T15:35:32.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 --2- 172.21.15.170:0/2941371031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe66c003a20 0x7fe66c003e50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:32.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 >> 172.21.15.170:0/2941371031 conn(0x7fe688065120 msgr2=0x7fe68807a530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:32.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 shutdown_connections 2020-01-26T15:35:32.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.048+0000 7fe687fff700 1 -- 172.21.15.170:0/2941371031 wait complete. 2020-01-26T15:35:32.062 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2020-01-26T15:35:32.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.164+0000 7fe3b70c1700 1 Processor -- start 2020-01-26T15:35:32.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.164+0000 7fe3b70c1700 1 -- start start 2020-01-26T15:35:32.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b70c1700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe3b0097720 0x7fe3b0060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:32.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b70c1700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b00a7a60 con 0x7fe3b0065e30 2020-01-26T15:35:32.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b70c1700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b014d6f0 con 0x7fe3b005f5a0 2020-01-26T15:35:32.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b70c1700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b0065bd0 con 0x7fe3b0097720 2020-01-26T15:35:32.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b68c0700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe3b0065e30 0x7fe3b0144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50948/0 (socket says 172.21.15.170:50948) 2020-01-26T15:35:32.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b68c0700 1 -- 172.21.15.170:0/130478574 learned_addr learned my addr 172.21.15.170:0/130478574 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:32.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 -1 --2- 172.21.15.170:0/130478574 >> v2:172.21.15.170:6791/0 conn(0x7fe3b0097720 0x7fe3b0060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:32.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> v2:172.21.15.170:6791/0 conn(0x7fe3b0097720 0x7fe3b0060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:32.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638953199 0 0) 0x7fe3b014d6f0 con 0x7fe3b005f5a0 2020-01-26T15:35:32.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe39c003230 con 0x7fe3b005f5a0 2020-01-26T15:35:32.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497692432 0 0) 0x7fe3b00a7a60 con 0x7fe3b0065e30 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b014d6f0 con 0x7fe3b0065e30 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4143075674 0 0) 0x7fe3b014d6f0 con 0x7fe3b0065e30 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 >> v2:172.21.15.170:6791/0 conn(0x7fe3b0097720 msgr2=0x7fe3b0060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 --2- 172.21.15.170:0/130478574 >> v2:172.21.15.170:6791/0 conn(0x7fe3b0097720 0x7fe3b0060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 >> v1:172.21.15.170:6791/0 conn(0x7fe3b005f5a0 legacy=0x7fe3b00a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0145160 con 0x7fe3b0065e30 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe3ac0016f0 con 0x7fe3b0065e30 2020-01-26T15:35:32.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 >> v1:172.21.15.170:6789/0 conn(0x7fe3b0065e30 legacy=0x7fe3b0144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe3b014d6f0 con 0x7fe39c004b20 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe3b00a7a60 con 0x7fe39c00a7f0 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0065bd0 con 0x7fe39c004f90 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990401707 0 0) 0x7fe3b014d6f0 con 0x7fe39c004b20 2020-01-26T15:35:32.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe39c00e440 con 0x7fe39c004b20 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147407186 0 0) 0x7fe3b00a7a60 con 0x7fe39c00a7f0 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b014d6f0 con 0x7fe39c00a7f0 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 -- 172.21.15.170:0/130478574 >> v1:172.21.15.170:6791/0 conn(0x7fe39c00a7f0 legacy=0x7fe39c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 -- 172.21.15.170:0/130478574 >> v1:172.21.15.170:6790/0 conn(0x7fe39c004b20 legacy=0x7fe39c003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 -- 172.21.15.170:0/130478574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c010680 con 0x7fe39c004f90 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).ready entity=mon.0 client_cookie=9b8761ac3c1fec71 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:32.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe3a404cc70 con 0x7fe39c004f90 2020-01-26T15:35:32.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b60bf700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe3a4049790 con 0x7fe39c004f90 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.168+0000 7fe3b58be700 1 -- 172.21.15.170:0/130478574 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe3a4049b30 con 0x7fe39c004f90 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 -- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 msgr2=0x7fe39c003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 --2- 172.21.15.170:0/130478574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe39c004f90 0x7fe39c003d40 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a4053e70).stop 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b8323700 1 -- 172.21.15.170:0/130478574 reap_dead start 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 -- 172.21.15.170:0/130478574 shutdown_connections 2020-01-26T15:35:32.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 -- 172.21.15.170:0/130478574 >> 172.21.15.170:0/130478574 conn(0x7fe3b0060030 msgr2=0x7fe3b005e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:32.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 -- 172.21.15.170:0/130478574 shutdown_connections 2020-01-26T15:35:32.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 -- 172.21.15.170:0/130478574 wait complete. 2020-01-26T15:35:32.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 Processor -- start 2020-01-26T15:35:32.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.172+0000 7fe3b70c1700 1 -- start start 2020-01-26T15:35:32.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b70c1700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe3b007c680 0x7fe3b014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:32.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b70c1700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b0061c30 con 0x7fe3b007d510 2020-01-26T15:35:32.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b70c1700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b007cab0 con 0x7fe3b007da90 2020-01-26T15:35:32.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b70c1700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b007a7f0 con 0x7fe3b007c680 2020-01-26T15:35:32.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b60bf700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fe3b007da90 0x7fe3b014c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42962/0 (socket says 172.21.15.170:42962) 2020-01-26T15:35:32.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b60bf700 1 -- 172.21.15.170:0/2413662750 learned_addr learned my addr 172.21.15.170:0/2413662750 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:32.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b8323700 -1 --2- 172.21.15.170:0/2413662750 >> v2:172.21.15.170:6790/0 conn(0x7fe3b007c680 0x7fe3b014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:32.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b8323700 1 --2- 172.21.15.170:0/2413662750 >> v2:172.21.15.170:6790/0 conn(0x7fe3b007c680 0x7fe3b014cc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:32.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078702492 0 0) 0x7fe3b007cab0 con 0x7fe3b007da90 2020-01-26T15:35:32.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe398003230 con 0x7fe3b007da90 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85583784 0 0) 0x7fe3b0061c30 con 0x7fe3b007d510 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b007cab0 con 0x7fe3b007d510 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1011955262 0 0) 0x7fe3b007cab0 con 0x7fe3b007d510 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3b0061c30 con 0x7fe3b007d510 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe3ac0016d0 con 0x7fe3b007d510 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 >> v2:172.21.15.170:6790/0 conn(0x7fe3b007c680 msgr2=0x7fe3b014cc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:32.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 --2- 172.21.15.170:0/2413662750 >> v2:172.21.15.170:6790/0 conn(0x7fe3b007c680 0x7fe3b014cc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:32.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 >> v1:172.21.15.170:6791/0 conn(0x7fe3b007da90 legacy=0x7fe3b014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 >> v1:172.21.15.170:6789/0 conn(0x7fe3b007d510 legacy=0x7fe3b0061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:32.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe398003230 con 0x7fe39800a7f0 2020-01-26T15:35:32.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe3b007cab0 con 0x7fe398004060 2020-01-26T15:35:32.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b007a7f0 con 0x7fe398003c30 2020-01-26T15:35:32.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:32.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100227653 0 0) 0x7fe3b007cab0 con 0x7fe398004060 2020-01-26T15:35:32.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe398010650 con 0x7fe398004060 2020-01-26T15:35:32.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 -- 172.21.15.170:0/2413662750 >> v1:172.21.15.170:6791/0 conn(0x7fe398004060 legacy=0x7fe398004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 -- 172.21.15.170:0/2413662750 >> v1:172.21.15.170:6790/0 conn(0x7fe39800a7f0 legacy=0x7fe39800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 -- 172.21.15.170:0/2413662750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b014d1d0 con 0x7fe398003c30 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b0068690 con 0x7fe398003c30 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b007dc30 con 0x7fe398003c30 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:32.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe3ac008160 con 0x7fe398003c30 2020-01-26T15:35:32.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe3ac008360 con 0x7fe398003c30 2020-01-26T15:35:32.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe3ac006a70 con 0x7fe398003c30 2020-01-26T15:35:32.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.176+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.180+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c003360 con 0x7fe398003c30 2020-01-26T15:35:32.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.180+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe3ac00ecf0 con 0x7fe398003c30 2020-01-26T15:35:32.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.180+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.180+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2897+0+0 (secure 0 0 0) 0x7fe3ac04db40 con 0x7fe398003c30 2020-01-26T15:35:32.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.184+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.184+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe3b0145160 con 0x7fe398003c30 2020-01-26T15:35:32.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe38c0021f0 con 0x7fe398003c30 2020-01-26T15:35:32.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b68c0700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3a37fe700 1 -- 172.21.15.170:0/2413662750 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v29) v1 ==== 81+0+17107 (secure 0 0 0) 0x7fe3ac033d10 con 0x7fe398003c30 2020-01-26T15:35:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:32.307 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "epoch": 29, 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "fsid": "8497d181-a5c1-4388-9117-8dc8db8c2871", 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "created": "2020-01-26T15:32:02.055148+0000", 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "modified": "2020-01-26T15:35:31.837979+0000", 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "last_up_change": "0.000000", 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "last_in_change": "0.000000", 2020-01-26T15:35:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs", 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flags_num": 1605632, 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flags_set": [ 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "purged_snapdirs", 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_deletes", 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "sortbitwise" 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2020-01-26T15:35:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_version": 4, 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "full_ratio": 0.94999998807907104, 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "nearfull_ratio": 0.85000002384185791, 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_snapshot": "", 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_max": 3, 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "max_osd": 4, 2020-01-26T15:35:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "require_min_compat_client": "mimic", 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "min_compat_client": "jewel", 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "require_osd_release": "mimic", 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "pools": [ 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "pool": 1, 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_name": "rbd", 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "create_time": "2020-01-26T15:32:11.534039+0000", 2020-01-26T15:35:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2020-01-26T15:35:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "flags_names": "hashpspool", 2020-01-26T15:35:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "type": 1, 2020-01-26T15:35:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 2, 2020-01-26T15:35:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "min_size": 1, 2020-01-26T15:35:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_rule": 0, 2020-01-26T15:35:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "object_hash": 2, 2020-01-26T15:35:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscale_mode": "warn", 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num": 8, 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_placement_num": 8, 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_placement_num_target": 8, 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num_target": 8, 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num_pending": 8, 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "last_pg_merge_meta": { 2020-01-26T15:35:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "source_pgid": "0.0", 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "ready_epoch": 0, 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "last_epoch_started": 0, 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "last_epoch_clean": 0, 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "source_version": "0'0", 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "target_version": "0'0" 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "last_change": "11", 2020-01-26T15:35:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend": "0", 2020-01-26T15:35:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend_prenautilus": "0", 2020-01-26T15:35:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend_preluminous": "0", 2020-01-26T15:35:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "auid": 0, 2020-01-26T15:35:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_mode": "selfmanaged", 2020-01-26T15:35:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_seq": 0, 2020-01-26T15:35:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_epoch": 0, 2020-01-26T15:35:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_snaps": [], 2020-01-26T15:35:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "removed_snaps": "[]", 2020-01-26T15:35:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "quota_max_bytes": 0, 2020-01-26T15:35:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "quota_max_objects": 0, 2020-01-26T15:35:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "tiers": [], 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "tier_of": -1, 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "read_tier": -1, 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "write_tier": -1, 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_mode": "none", 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "target_max_bytes": 0, 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "target_max_objects": 0, 2020-01-26T15:35:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_full_ratio_micro": 800000, 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_min_flush_age": 0, 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_min_evict_age": 0, 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "erasure_code_profile": "", 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_params": { 2020-01-26T15:35:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "none" 2020-01-26T15:35:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_period": 0, 2020-01-26T15:35:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_count": 0, 2020-01-26T15:35:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "use_gmt_hitset": true, 2020-01-26T15:35:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "min_read_recency_for_promote": 0, 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "min_write_recency_for_promote": 0, 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_grade_decay_rate": 0, 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_search_last_n": 0, 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "grade_table": [], 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "stripe_width": 0, 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "expected_num_objects": 0, 2020-01-26T15:35:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "fast_read": false, 2020-01-26T15:35:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "options": {}, 2020-01-26T15:35:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "application_metadata": { 2020-01-26T15:35:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd": {} 2020-01-26T15:35:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "pool": 2, 2020-01-26T15:35:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_name": "cephfs_metadata", 2020-01-26T15:35:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "create_time": "2020-01-26T15:32:14.037219+0000", 2020-01-26T15:35:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2020-01-26T15:35:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "flags_names": "hashpspool", 2020-01-26T15:35:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "type": 1, 2020-01-26T15:35:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 2, 2020-01-26T15:35:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "min_size": 1, 2020-01-26T15:35:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_rule": 0, 2020-01-26T15:35:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "object_hash": 2, 2020-01-26T15:35:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscale_mode": "warn", 2020-01-26T15:35:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num": 8, 2020-01-26T15:35:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_placement_num": 8, 2020-01-26T15:35:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_placement_num_target": 8, 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num_target": 8, 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num_pending": 8, 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "last_pg_merge_meta": { 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "source_pgid": "0.0", 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "ready_epoch": 0, 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "last_epoch_started": 0, 2020-01-26T15:35:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "last_epoch_clean": 0, 2020-01-26T15:35:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "source_version": "0'0", 2020-01-26T15:35:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "target_version": "0'0" 2020-01-26T15:35:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "last_change": "14", 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend": "0", 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend_prenautilus": "0", 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend_preluminous": "0", 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "auid": 0, 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_mode": "selfmanaged", 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_seq": 0, 2020-01-26T15:35:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_epoch": 0, 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_snaps": [], 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "removed_snaps": "[]", 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "quota_max_bytes": 0, 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "quota_max_objects": 0, 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "tiers": [], 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "tier_of": -1, 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "read_tier": -1, 2020-01-26T15:35:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "write_tier": -1, 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_mode": "none", 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "target_max_bytes": 0, 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "target_max_objects": 0, 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_full_ratio_micro": 800000, 2020-01-26T15:35:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_min_flush_age": 0, 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_min_evict_age": 0, 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "erasure_code_profile": "", 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_params": { 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "none" 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_period": 0, 2020-01-26T15:35:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_count": 0, 2020-01-26T15:35:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "use_gmt_hitset": true, 2020-01-26T15:35:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "min_read_recency_for_promote": 0, 2020-01-26T15:35:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "min_write_recency_for_promote": 0, 2020-01-26T15:35:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_grade_decay_rate": 0, 2020-01-26T15:35:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_search_last_n": 0, 2020-01-26T15:35:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "grade_table": [], 2020-01-26T15:35:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "stripe_width": 0, 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "expected_num_objects": 0, 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "fast_read": false, 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "options": {}, 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "application_metadata": { 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "cephfs": { 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": "cephfs" 2020-01-26T15:35:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "pool": 3, 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_name": "cephfs_data", 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "create_time": "2020-01-26T15:32:14.435582+0000", 2020-01-26T15:35:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2020-01-26T15:35:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flags_names": "hashpspool", 2020-01-26T15:35:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "type": 1, 2020-01-26T15:35:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 2, 2020-01-26T15:35:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "min_size": 1, 2020-01-26T15:35:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_rule": 0, 2020-01-26T15:35:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "object_hash": 2, 2020-01-26T15:35:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscale_mode": "warn", 2020-01-26T15:35:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num": 8, 2020-01-26T15:35:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_placement_num": 8, 2020-01-26T15:35:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_placement_num_target": 8, 2020-01-26T15:35:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num_target": 8, 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num_pending": 8, 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "last_pg_merge_meta": { 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "source_pgid": "0.0", 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "ready_epoch": 0, 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "last_epoch_started": 0, 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "last_epoch_clean": 0, 2020-01-26T15:35:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "source_version": "0'0", 2020-01-26T15:35:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "target_version": "0'0" 2020-01-26T15:35:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "last_change": "14", 2020-01-26T15:35:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend": "0", 2020-01-26T15:35:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend_prenautilus": "0", 2020-01-26T15:35:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "last_force_op_resend_preluminous": "0", 2020-01-26T15:35:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "auid": 0, 2020-01-26T15:35:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_mode": "selfmanaged", 2020-01-26T15:35:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_seq": 0, 2020-01-26T15:35:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "snap_epoch": 0, 2020-01-26T15:35:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_snaps": [], 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "removed_snaps": "[]", 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "quota_max_bytes": 0, 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "quota_max_objects": 0, 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "tiers": [], 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "tier_of": -1, 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "read_tier": -1, 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "write_tier": -1, 2020-01-26T15:35:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_mode": "none", 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "target_max_bytes": 0, 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "target_max_objects": 0, 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_target_full_ratio_micro": 800000, 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_min_flush_age": 0, 2020-01-26T15:35:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "cache_min_evict_age": 0, 2020-01-26T15:35:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "erasure_code_profile": "", 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_params": { 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "none" 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_period": 0, 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_count": 0, 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "use_gmt_hitset": true, 2020-01-26T15:35:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "min_read_recency_for_promote": 0, 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "min_write_recency_for_promote": 0, 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_grade_decay_rate": 0, 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "hit_set_search_last_n": 0, 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "grade_table": [], 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "stripe_width": 0, 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "expected_num_objects": 0, 2020-01-26T15:35:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "fast_read": false, 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "options": {}, 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "application_metadata": { 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "cephfs": { 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "data": "cephfs" 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2020-01-26T15:35:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "osds": [ 2020-01-26T15:35:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 0, 2020-01-26T15:35:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "uuid": "6fdaa328-9697-4ff6-9ca7-e68075640913", 2020-01-26T15:35:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "up": 1, 2020-01-26T15:35:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "in": 1, 2020-01-26T15:35:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "weight": 1, 2020-01-26T15:35:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "primary_affinity": 1, 2020-01-26T15:35:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_begin": 9, 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_end": 18, 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "up_from": 24, 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "up_thru": 26, 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "down_at": 20, 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "lost_at": 0, 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addrs": { 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6809", 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18374 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addrs": { 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6810", 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18374 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addrs": { 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6812", 2020-01-26T15:35:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18374 2020-01-26T15:35:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addrs": { 2020-01-26T15:35:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6811", 2020-01-26T15:35:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18374 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addr": "172.21.15.170:6809/18374", 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addr": "172.21.15.170:6810/18374", 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addr": "172.21.15.170:6812/18374", 2020-01-26T15:35:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addr": "172.21.15.170:6811/18374", 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "state": [ 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "exists", 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "up" 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 1, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "uuid": "32b5087d-d77d-4c3d-8736-f4f41237b81e", 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "up": 1, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "in": 1, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "weight": 1, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "primary_affinity": 1, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_begin": 9, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_end": 18, 2020-01-26T15:35:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "up_from": 22, 2020-01-26T15:35:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "up_thru": 26, 2020-01-26T15:35:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "down_at": 19, 2020-01-26T15:35:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "lost_at": 0, 2020-01-26T15:35:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addrs": { 2020-01-26T15:35:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6801", 2020-01-26T15:35:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18293 2020-01-26T15:35:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addrs": { 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6802", 2020-01-26T15:35:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18293 2020-01-26T15:35:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addrs": { 2020-01-26T15:35:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6804", 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18293 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addrs": { 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6803", 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18293 2020-01-26T15:35:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addr": "172.21.15.170:6801/18293", 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addr": "172.21.15.170:6802/18293", 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addr": "172.21.15.170:6804/18293", 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addr": "172.21.15.170:6803/18293", 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "state": [ 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "exists", 2020-01-26T15:35:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "up" 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 2, 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "uuid": "f8248e42-e78d-4926-9c81-1a1c4199b946", 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "up": 1, 2020-01-26T15:35:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "in": 1, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "weight": 1, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "primary_affinity": 1, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_begin": 9, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_end": 21, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "up_from": 26, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "up_thru": 26, 2020-01-26T15:35:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "down_at": 22, 2020-01-26T15:35:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "lost_at": 0, 2020-01-26T15:35:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addrs": { 2020-01-26T15:35:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6813", 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18671 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addrs": { 2020-01-26T15:35:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6814", 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18671 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addrs": { 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6816", 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18671 2020-01-26T15:35:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addrs": { 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6815", 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18671 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addr": "172.21.15.170:6813/18671", 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addr": "172.21.15.170:6814/18671", 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addr": "172.21.15.170:6816/18671", 2020-01-26T15:35:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addr": "172.21.15.170:6815/18671", 2020-01-26T15:35:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "state": [ 2020-01-26T15:35:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "exists", 2020-01-26T15:35:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "up" 2020-01-26T15:35:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 3, 2020-01-26T15:35:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "uuid": "6e582686-4f2c-467b-8c9a-c79a94d3887f", 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "up": 1, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "in": 1, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "weight": 1, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "primary_affinity": 1, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_begin": 9, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "last_clean_end": 20, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "up_from": 25, 2020-01-26T15:35:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "up_thru": 26, 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "down_at": 21, 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "lost_at": 0, 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addrs": { 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6805", 2020-01-26T15:35:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18499 2020-01-26T15:35:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addrs": { 2020-01-26T15:35:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6806", 2020-01-26T15:35:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18499 2020-01-26T15:35:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addrs": { 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6808", 2020-01-26T15:35:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18499 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addrs": { 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2020-01-26T15:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6807", 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 18499 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: "public_addr": "172.21.15.170:6805/18499", 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_addr": "172.21.15.170:6806/18499", 2020-01-26T15:35:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_back_addr": "172.21.15.170:6808/18499", 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: "heartbeat_front_addr": "172.21.15.170:6807/18499", 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: "state": [ 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: "exists", 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: "up" 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2020-01-26T15:35:32.383 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_xinfo": [ 2020-01-26T15:35:32.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.384 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 0, 2020-01-26T15:35:32.384 INFO:teuthology.orchestra.run.smithi170.stdout: "down_stamp": "0.000000", 2020-01-26T15:35:32.384 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_probability": 0, 2020-01-26T15:35:32.384 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_interval": 0, 2020-01-26T15:35:32.385 INFO:teuthology.orchestra.run.smithi170.stdout: "features": 4540138292836696063, 2020-01-26T15:35:32.385 INFO:teuthology.orchestra.run.smithi170.stdout: "old_weight": 0, 2020-01-26T15:35:32.385 INFO:teuthology.orchestra.run.smithi170.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:35:32.385 INFO:teuthology.orchestra.run.smithi170.stdout: "dead_epoch": 0 2020-01-26T15:35:32.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 1, 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: "down_stamp": "0.000000", 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_probability": 0, 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_interval": 0, 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: "features": 4540138292836696063, 2020-01-26T15:35:32.386 INFO:teuthology.orchestra.run.smithi170.stdout: "old_weight": 0, 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: "dead_epoch": 0 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 2, 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: "down_stamp": "2020-01-26T15:35:19.809376+0000", 2020-01-26T15:35:32.387 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_probability": 0, 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_interval": 0, 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: "features": 4540138292836696063, 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: "old_weight": 0, 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: "dead_epoch": 0 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2020-01-26T15:35:32.388 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": 3, 2020-01-26T15:35:32.389 INFO:teuthology.orchestra.run.smithi170.stdout: "down_stamp": "0.000000", 2020-01-26T15:35:32.389 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_probability": 0, 2020-01-26T15:35:32.389 INFO:teuthology.orchestra.run.smithi170.stdout: "laggy_interval": 0, 2020-01-26T15:35:32.389 INFO:teuthology.orchestra.run.smithi170.stdout: "features": 4540138292836696063, 2020-01-26T15:35:32.389 INFO:teuthology.orchestra.run.smithi170.stdout: "old_weight": 0, 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: "dead_epoch": 0 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_upmap": [], 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_upmap_items": [], 2020-01-26T15:35:32.390 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_temp": [], 2020-01-26T15:35:32.391 INFO:teuthology.orchestra.run.smithi170.stdout: "primary_temp": [], 2020-01-26T15:35:32.391 INFO:teuthology.orchestra.run.smithi170.stdout: "blacklist": { 2020-01-26T15:35:32.391 INFO:teuthology.orchestra.run.smithi170.stdout: "v1:172.21.15.170:6817/12433226": "2020-01-27T15:35:31.240361+0000", 2020-01-26T15:35:32.391 INFO:teuthology.orchestra.run.smithi170.stdout: "v1:172.21.15.170:6800/11008": "2020-01-27T15:35:10.598343+0000" 2020-01-26T15:35:32.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.391 INFO:teuthology.orchestra.run.smithi170.stdout: "erasure_code_profiles": { 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "default": { 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "crush-failure-domain": "osd", 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "k": "2", 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "m": "1", 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "plugin": "jerasure", 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "ruleset-failure-domain": "osd", 2020-01-26T15:35:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: "technique": "reed_sol_van" 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: } 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: "removed_snaps_queue": [], 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: "new_removed_snaps": [], 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: "new_purged_snaps": [], 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_node_flags": {}, 2020-01-26T15:35:32.393 INFO:teuthology.orchestra.run.smithi170.stdout: "device_class_flags": {} 2020-01-26T15:35:32.394 INFO:teuthology.orchestra.run.smithi170.stdout:} 2020-01-26T15:35:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 >> v1:172.21.15.170:6800/17396 conn(0x7fe39804a1b0 legacy=0x7fe39804c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 msgr2=0x7fe3980045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b8323700 1 -- 172.21.15.170:0/2413662750 reap_dead start 2020-01-26T15:35:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe3ac0018d0 tx=0x7fe3ac011870).stop 2020-01-26T15:35:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 shutdown_connections 2020-01-26T15:35:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 --2- 172.21.15.170:0/2413662750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe398003c30 0x7fe3980045a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 >> 172.21.15.170:0/2413662750 conn(0x7fe3b0097670 msgr2=0x7fe3b00a3750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 shutdown_connections 2020-01-26T15:35:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.304+0000 7fe3b70c1700 1 -- 172.21.15.170:0/2413662750 wait complete. 2020-01-26T15:35:32.397 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config rm global mon_warn_on_msgr2_not_enabled' 2020-01-26T15:35:32.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.508+0000 7fe8ad26e700 1 Processor -- start 2020-01-26T15:35:32.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.508+0000 7fe8ad26e700 1 -- start start 2020-01-26T15:35:32.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe8a8065e30 0x7fe8a8060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:32.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe8a805f5a0 0x7fe8a80a7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a80a77b0 con 0x7fe8a8097720 2020-01-26T15:35:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a8065bd0 con 0x7fe8a8065e30 2020-01-26T15:35:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a81442e0 con 0x7fe8a805f5a0 2020-01-26T15:35:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a7fff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe8a8097720 0x7fe8a8144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47852/0 (socket says 172.21.15.170:47852) 2020-01-26T15:35:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a7fff700 1 -- 172.21.15.170:0/2588665710 learned_addr learned my addr 172.21.15.170:0/2588665710 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8aca6d700 -1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6790/0 conn(0x7fe8a8065e30 0x7fe8a8060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ae4d0700 -1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6791/0 conn(0x7fe8a805f5a0 0x7fe8a80a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8aca6d700 1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6790/0 conn(0x7fe8a8065e30 0x7fe8a8060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6791/0 conn(0x7fe8a805f5a0 0x7fe8a80a7260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769079930 0 0) 0x7fe8a80a77b0 con 0x7fe8a8097720 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe890003230 con 0x7fe8a8097720 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2314913268 0 0) 0x7fe890003230 con 0x7fe8a8097720 2020-01-26T15:35:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6791/0 conn(0x7fe8a805f5a0 msgr2=0x7fe8a80a7260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6791/0 conn(0x7fe8a805f5a0 0x7fe8a80a7260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6790/0 conn(0x7fe8a8065e30 msgr2=0x7fe8a8060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6790/0 conn(0x7fe8a8065e30 0x7fe8a8060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8145160 con 0x7fe8a8097720 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe89c001710 con 0x7fe8a8097720 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fe89c0019b0 con 0x7fe8a8097720 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8a77fe700 1 -- 172.21.15.170:0/2588665710 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe89c004760 con 0x7fe8a8097720 2020-01-26T15:35:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- 172.21.15.170:0/2588665710 >> v1:172.21.15.170:6790/0 conn(0x7fe8a8097720 legacy=0x7fe8a8144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- 172.21.15.170:0/2588665710 shutdown_connections 2020-01-26T15:35:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6791/0 conn(0x7fe8a805f5a0 0x7fe8a80a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 --2- 172.21.15.170:0/2588665710 >> v2:172.21.15.170:6790/0 conn(0x7fe8a8065e30 0x7fe8a8060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- 172.21.15.170:0/2588665710 >> 172.21.15.170:0/2588665710 conn(0x7fe8a8060030 msgr2=0x7fe8a805e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- 172.21.15.170:0/2588665710 shutdown_connections 2020-01-26T15:35:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 -- 172.21.15.170:0/2588665710 wait complete. 2020-01-26T15:35:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.512+0000 7fe8ad26e700 1 Processor -- start 2020-01-26T15:35:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ad26e700 1 -- start start 2020-01-26T15:35:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ad26e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a805ed90 con 0x7fe8a8098a10 2020-01-26T15:35:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ad26e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a8025700 con 0x7fe8a81303d0 2020-01-26T15:35:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ad26e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a814b080 con 0x7fe8a80a4550 2020-01-26T15:35:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8aca6d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe8a8098a10 0x7fe8a8099660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:50982/0 (socket says 172.21.15.170:50982) 2020-01-26T15:35:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8aca6d700 1 -- 172.21.15.170:0/3276425724 learned_addr learned my addr 172.21.15.170:0/3276425724 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481483354 0 0) 0x7fe8a805ed90 con 0x7fe8a8098a10 2020-01-26T15:35:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003230 con 0x7fe8a8098a10 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809473326 0 0) 0x7fe8a814b080 con 0x7fe8a80a4550 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a805ed90 con 0x7fe8a80a4550 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238433377 0 0) 0x7fe8a8025700 con 0x7fe8a81303d0 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a814b080 con 0x7fe8a81303d0 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 243934545 0 0) 0x7fe888003230 con 0x7fe8a8098a10 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8a8025700 con 0x7fe8a8098a10 2020-01-26T15:35:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe898002740 con 0x7fe8a8098a10 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 >> v1:172.21.15.170:6791/0 conn(0x7fe8a80a4550 legacy=0x7fe8a80a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 >> v1:172.21.15.170:6790/0 conn(0x7fe8a81303d0 legacy=0x7fe8a8132810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 >> v1:172.21.15.170:6789/0 conn(0x7fe8a8098a10 legacy=0x7fe8a8099660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe8a814b080 con 0x7fe888004da0 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe8a805ed90 con 0x7fe888003e60 2020-01-26T15:35:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880051d0 con 0x7fe88800c000 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047634065 0 0) 0x7fe8a814b080 con 0x7fe888004da0 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003230 con 0x7fe888004da0 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101866522 0 0) 0x7fe8a805ed90 con 0x7fe888003e60 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a814b080 con 0x7fe888003e60 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 -- 172.21.15.170:0/3276425724 >> v1:172.21.15.170:6791/0 conn(0x7fe888003e60 legacy=0x7fe8880045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 -- 172.21.15.170:0/3276425724 >> v1:172.21.15.170:6790/0 conn(0x7fe888004da0 legacy=0x7fe88800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 -- 172.21.15.170:0/3276425724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a807e940 con 0x7fe88800c000 2020-01-26T15:35:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a8145410 con 0x7fe88800c000 2020-01-26T15:35:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a80a4550 con 0x7fe88800c000 2020-01-26T15:35:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe8a000e160 con 0x7fe88800c000 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe8a000e360 con 0x7fe88800c000 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.516+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe8a000e7c0 con 0x7fe88800c000 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.520+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.520+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880003360 con 0x7fe88800c000 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.520+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe8a00100b0 con 0x7fe88800c000 2020-01-26T15:35:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.520+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.520+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2897+0+0 (secure 0 0 0) 0x7fe8a004e080 con 0x7fe88800c000 2020-01-26T15:35:32.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.524+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.524+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe8a0010a50 con 0x7fe88800c000 2020-01-26T15:35:32.648 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.644+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config rm", "who": "global", "name": "mon_warn_on_msgr2_not_enabled"} v 0) v1 -- 0x7fe880002240 con 0x7fe88800c000 2020-01-26T15:35:32.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.656+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.656+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 7 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0034400 con 0x7fe88800c000 2020-01-26T15:35:32.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.656+0000 7fe8ae4d0700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.656+0000 7fe8a57fa700 1 -- 172.21.15.170:0/3276425724 <== mon.0 v2:172.21.15.170:3300/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "global", "name": "mon_warn_on_msgr2_not_enabled"}]=0 v3) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe8a0034fe0 con 0x7fe88800c000 2020-01-26T15:35:32.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 >> v1:172.21.15.170:6800/17396 conn(0x7fe888048360 legacy=0x7fe88804a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 msgr2=0x7fe88800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 --2- 172.21.15.170:0/3276425724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88800c000 0x7fe88800e440 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fe8a0002b10 tx=0x7fe8a00116b0).stop 2020-01-26T15:35:32.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ae4d0700 1 -- 172.21.15.170:0/3276425724 reap_dead start 2020-01-26T15:35:32.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 shutdown_connections 2020-01-26T15:35:32.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 >> 172.21.15.170:0/3276425724 conn(0x7fe8a805e960 msgr2=0x7fe8a807f410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:32.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 shutdown_connections 2020-01-26T15:35:32.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.660+0000 7fe8ad26e700 1 -- 172.21.15.170:0/3276425724 wait complete. 2020-01-26T15:35:32.676 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release octopus' 2020-01-26T15:35:32.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 Processor -- start 2020-01-26T15:35:32.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- start start 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0a7a60 con 0x7f680c05f5a0 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c060460 con 0x7f680c065e30 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c060690 con 0x7f680c097720 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811f51700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f680c097720 0x7f680c0a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:42998/0 (socket says 172.21.15.170:42998) 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812752700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f680c065e30 0x7f680c144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47874/0 (socket says 172.21.15.170:47874) 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811f51700 1 -- 172.21.15.170:0/114314224 learned_addr learned my addr 172.21.15.170:0/114314224 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:32.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065642419 0 0) 0x7f680c0a7a60 con 0x7f680c05f5a0 2020-01-26T15:35:32.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f8003230 con 0x7f680c05f5a0 2020-01-26T15:35:32.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701892848 0 0) 0x7f680c060460 con 0x7f680c065e30 2020-01-26T15:35:32.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c0a7a60 con 0x7f680c065e30 2020-01-26T15:35:32.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825061982 0 0) 0x7f680c060690 con 0x7f680c097720 2020-01-26T15:35:32.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c060460 con 0x7f680c097720 2020-01-26T15:35:32.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3744087468 0 0) 0x7f67f8003230 con 0x7f680c05f5a0 2020-01-26T15:35:32.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 >> v1:172.21.15.170:6791/0 conn(0x7f680c097720 legacy=0x7f680c0a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 >> v1:172.21.15.170:6790/0 conn(0x7f680c065e30 legacy=0x7f680c144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c145160 con 0x7f680c05f5a0 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6804001a90 con 0x7f680c05f5a0 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 >> v1:172.21.15.170:6789/0 conn(0x7f680c05f5a0 legacy=0x7f680c14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f67f8003230 con 0x7f67f8004db0 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f680c0a7a60 con 0x7f67f8003d40 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8004170 con 0x7f67f800c000 2020-01-26T15:35:32.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:32.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379017129 0 0) 0x7f67f8003230 con 0x7f67f8004db0 2020-01-26T15:35:32.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c060690 con 0x7f67f8004db0 2020-01-26T15:35:32.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251828014 0 0) 0x7f680c0a7a60 con 0x7f67f8003d40 2020-01-26T15:35:32.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f8003230 con 0x7f67f8003d40 2020-01-26T15:35:32.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 -- 172.21.15.170:0/114314224 >> v1:172.21.15.170:6791/0 conn(0x7f67f8003d40 legacy=0x7f67f800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 -- 172.21.15.170:0/114314224 >> v1:172.21.15.170:6790/0 conn(0x7f67f8004db0 legacy=0x7f67f8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 -- 172.21.15.170:0/114314224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80549c0 con 0x7f67f800c000 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68040018a0 tx=0x7f680400c5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68040018a0 tx=0x7f680400c5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f68040018a0 tx=0x7f680400c5e0).ready entity=mon.0 client_cookie=487d86e9b053ccf3 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f68040018a0 tx=0x7f680400c5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6804006bc0 con 0x7f67f800c000 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f68040018a0 tx=0x7f680400c5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f68141b5700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f68040018a0 tx=0x7f680400c5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6804006dc0 con 0x7f67f800c000 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6811750700 1 -- 172.21.15.170:0/114314224 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6804010310 con 0x7f67f800c000 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 msgr2=0x7f67f800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f68040018a0 tx=0x7f680400c5e0).stop 2020-01-26T15:35:32.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- 172.21.15.170:0/114314224 shutdown_connections 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 --2- 172.21.15.170:0/114314224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f800c000 0x7f67f800e440 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.784+0000 7f6812f53700 1 -- 172.21.15.170:0/114314224 >> 172.21.15.170:0/114314224 conn(0x7f680c060030 msgr2=0x7f680c05e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 -- 172.21.15.170:0/114314224 shutdown_connections 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 -- 172.21.15.170:0/114314224 wait complete. 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 Processor -- start 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 -- start start 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f680c0622f0 0x7f680c062720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:32.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c061e30 con 0x7f680c137980 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0630b0 con 0x7f680c07f500 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812f53700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f680c121420 con 0x7f680c0622f0 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812752700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f680c0622f0 0x7f680c062720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6811f51700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f680c07f500 0x7f680c07f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43012/0 (socket says 172.21.15.170:43012) 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6811f51700 1 -- 172.21.15.170:0/599080492 learned_addr learned my addr 172.21.15.170:0/599080492 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f6812752700 1 --2- 172.21.15.170:0/599080492 >> v2:172.21.15.170:6791/0 conn(0x7f680c0622f0 0x7f680c062720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:32.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165617381 0 0) 0x7f680c061e30 con 0x7f680c137980 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f4003230 con 0x7f680c137980 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710451559 0 0) 0x7f680c0630b0 con 0x7f680c07f500 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c061e30 con 0x7f680c07f500 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 555483113 0 0) 0x7f67f4003230 con 0x7f680c137980 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f680c0630b0 con 0x7f680c137980 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.788+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f680400bef0 con 0x7f680c137980 2020-01-26T15:35:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 >> v2:172.21.15.170:6791/0 conn(0x7f680c0622f0 msgr2=0x7f680c062720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 --2- 172.21.15.170:0/599080492 >> v2:172.21.15.170:6791/0 conn(0x7f680c0622f0 0x7f680c062720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 >> v1:172.21.15.170:6791/0 conn(0x7f680c07f500 legacy=0x7f680c07f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 >> v1:172.21.15.170:6789/0 conn(0x7f680c137980 legacy=0x7f680c139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f67f4003230 con 0x7f67f40040a0 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f67f400f570 con 0x7f67f4003c30 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c121420 con 0x7f67f4004e50 2020-01-26T15:35:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649726830 0 0) 0x7f67f4003230 con 0x7f67f40040a0 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f400f7a0 con 0x7f67f40040a0 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793599494 0 0) 0x7f67f400f570 con 0x7f67f4003c30 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f4003230 con 0x7f67f4003c30 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 -- 172.21.15.170:0/599080492 >> v1:172.21.15.170:6791/0 conn(0x7f67f4003c30 legacy=0x7f67f40045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 -- 172.21.15.170:0/599080492 >> v1:172.21.15.170:6790/0 conn(0x7f67f40040a0 legacy=0x7f67f400a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:32.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 -- 172.21.15.170:0/599080492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c099440 con 0x7f67f4004e50 2020-01-26T15:35:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c07f500 con 0x7f67f4004e50 2020-01-26T15:35:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c07fa00 con 0x7f67f4004e50 2020-01-26T15:35:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:32.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f680400b590 con 0x7f67f4004e50 2020-01-26T15:35:32.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680400a300 con 0x7f67f4004e50 2020-01-26T15:35:32.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f680400a6e0 con 0x7f67f4004e50 2020-01-26T15:35:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e8003360 con 0x7f67f4004e50 2020-01-26T15:35:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f680400a8e0 con 0x7f67f4004e50 2020-01-26T15:35:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.792+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2897+0+0 (secure 0 0 0) 0x7f680404e230 con 0x7f67f4004e50 2020-01-26T15:35:32.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.796+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:32.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.796+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f680c145160 con 0x7f67f4004e50 2020-01-26T15:35:32.932 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:32.928+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "octopus"} v 0) v1 -- 0x7f67e8002220 con 0x7f67f4004e50 2020-01-26T15:35:33.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f68141b5700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:33.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f67feffd700 1 -- 172.21.15.170:0/599080492 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "octopus"}]=0 v30) v1 ==== 93+0+0 (secure 0 0 0) 0x7f68040343e0 con 0x7f67f4004e50 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 >> v1:172.21.15.170:6800/17396 conn(0x7f67f40484e0 legacy=0x7f67f404a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 msgr2=0x7f67f400e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f68141b5700 1 -- 172.21.15.170:0/599080492 reap_dead start 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f68040031c0 tx=0x7f68040109a0).stop 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 shutdown_connections 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 --2- 172.21.15.170:0/599080492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67f4004e50 0x7f67f400e010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 >> 172.21.15.170:0/599080492 conn(0x7f680c07e770 msgr2=0x7f680c121630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 shutdown_connections 2020-01-26T15:35:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.868+0000 7f6812f53700 1 -- 172.21.15.170:0/599080492 wait complete. 2020-01-26T15:35:33.885 INFO:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2020-01-26T15:35:34.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 Processor -- start 2020-01-26T15:35:34.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- start start 2020-01-26T15:35:34.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f37bc05f5a0 0x7f37bc060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc0a7a60 con 0x7f37bc065e30 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc14d6f0 con 0x7f37bc097720 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc065bd0 con 0x7f37bc05f5a0 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c0bdc700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f37bc065e30 0x7f37bc144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51022/0 (socket says 172.21.15.170:51022) 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c0bdc700 1 -- 172.21.15.170:0/1784400026 learned_addr learned my addr 172.21.15.170:0/1784400026 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c263f700 -1 --2- 172.21.15.170:0/1784400026 >> v2:172.21.15.170:6790/0 conn(0x7f37bc05f5a0 0x7f37bc060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:34.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c263f700 1 --2- 172.21.15.170:0/1784400026 >> v2:172.21.15.170:6790/0 conn(0x7f37bc05f5a0 0x7f37bc060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392736221 0 0) 0x7f37bc14d6f0 con 0x7f37bc097720 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003230 con 0x7f37bc097720 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539712455 0 0) 0x7f37bc0a7a60 con 0x7f37bc065e30 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37bc14d6f0 con 0x7f37bc065e30 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1043595905 0 0) 0x7f37a8003230 con 0x7f37bc097720 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 >> v2:172.21.15.170:6790/0 conn(0x7f37bc05f5a0 msgr2=0x7f37bc060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 --2- 172.21.15.170:0/1784400026 >> v2:172.21.15.170:6790/0 conn(0x7f37bc05f5a0 0x7f37bc060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 >> v1:172.21.15.170:6789/0 conn(0x7f37bc065e30 legacy=0x7f37bc144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc145160 con 0x7f37bc097720 2020-01-26T15:35:34.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f37a4001710 con 0x7f37bc097720 2020-01-26T15:35:34.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f37a40019e0 con 0x7f37bc097720 2020-01-26T15:35:34.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37bb7fe700 1 -- 172.21.15.170:0/1784400026 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f37a4001e00 con 0x7f37bc097720 2020-01-26T15:35:34.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- 172.21.15.170:0/1784400026 >> v1:172.21.15.170:6790/0 conn(0x7f37bc097720 legacy=0x7f37bc0a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- 172.21.15.170:0/1784400026 shutdown_connections 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 --2- 172.21.15.170:0/1784400026 >> v2:172.21.15.170:6790/0 conn(0x7f37bc05f5a0 0x7f37bc060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- 172.21.15.170:0/1784400026 >> 172.21.15.170:0/1784400026 conn(0x7f37bc060030 msgr2=0x7f37bc05e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- 172.21.15.170:0/1784400026 shutdown_connections 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.992+0000 7f37c13dd700 1 -- 172.21.15.170:0/1784400026 wait complete. 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 Processor -- start 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 -- start start 2020-01-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f37bc07fe90 0x7f37bc07b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc094fc0 con 0x7f37bc121e30 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc1214f0 con 0x7f37bc120dc0 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc1202e0 con 0x7f37bc07fe90 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f37bc120dc0 0x7f37bc094700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47904/0 (socket says 172.21.15.170:47904) 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37bbfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f37bc121e30 0x7f37bc07ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51030/0 (socket says 172.21.15.170:51030) 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 -- 172.21.15.170:0/1988232496 learned_addr learned my addr 172.21.15.170:0/1988232496 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:34.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c263f700 -1 --2- 172.21.15.170:0/1988232496 >> v2:172.21.15.170:6791/0 conn(0x7f37bc07fe90 0x7f37bc07b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c263f700 1 --2- 172.21.15.170:0/1988232496 >> v2:172.21.15.170:6791/0 conn(0x7f37bc07fe90 0x7f37bc07b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277536853 0 0) 0x7f37bc094fc0 con 0x7f37bc121e30 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a0003230 con 0x7f37bc121e30 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540827893 0 0) 0x7f37bc1214f0 con 0x7f37bc120dc0 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37bc094fc0 con 0x7f37bc120dc0 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1549637229 0 0) 0x7f37a0003230 con 0x7f37bc121e30 2020-01-26T15:35:34.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37bc1214f0 con 0x7f37bc121e30 2020-01-26T15:35:34.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f37a4001b90 con 0x7f37bc121e30 2020-01-26T15:35:34.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 >> v2:172.21.15.170:6791/0 conn(0x7f37bc07fe90 msgr2=0x7f37bc07b390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:34.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 --2- 172.21.15.170:0/1988232496 >> v2:172.21.15.170:6791/0 conn(0x7f37bc07fe90 0x7f37bc07b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 >> v1:172.21.15.170:6790/0 conn(0x7f37bc120dc0 legacy=0x7f37bc094700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 >> v1:172.21.15.170:6789/0 conn(0x7f37bc121e30 legacy=0x7f37bc07ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:34.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f37a0003230 con 0x7f37a0005120 2020-01-26T15:35:34.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f37a000f450 con 0x7f37a000a7f0 2020-01-26T15:35:34.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1202e0 con 0x7f37a0004c90 2020-01-26T15:35:34.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:34.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238832072 0 0) 0x7f37a000f450 con 0x7f37a000a7f0 2020-01-26T15:35:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 -- 172.21.15.170:0/1988232496 >> v1:172.21.15.170:6791/0 conn(0x7f37a000a7f0 legacy=0x7f37a000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 -- 172.21.15.170:0/1988232496 >> v1:172.21.15.170:6790/0 conn(0x7f37a0005120 legacy=0x7f37a0003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 -- 172.21.15.170:0/1988232496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc07b8e0 con 0x7f37a0004c90 2020-01-26T15:35:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc120dc0 con 0x7f37a0004c90 2020-01-26T15:35:34.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc0948a0 con 0x7f37a0004c90 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f37b400ca20 con 0x7f37a0004c90 2020-01-26T15:35:34.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400cc20 con 0x7f37a0004c90 2020-01-26T15:35:34.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:33.996+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f37b40046a0 con 0x7f37a0004c90 2020-01-26T15:35:34.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.000+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.000+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3794003360 con 0x7f37a0004c90 2020-01-26T15:35:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.000+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f37b4013060 con 0x7f37a0004c90 2020-01-26T15:35:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.000+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.000+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f37b404d140 con 0x7f37a0004c90 2020-01-26T15:35:34.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.004+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.004+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f37b4033550 con 0x7f37a0004c90 2020-01-26T15:35:34.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f3794003790 con 0x7f37a0004c90 2020-01-26T15:35:34.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c0bdc700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37b97fa700 1 -- 172.21.15.170:0/1988232496 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v30) v1 ==== 59+0+32 (secure 0 0 0) 0x7f37b4034100 con 0x7f37a0004c90 2020-01-26T15:35:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 >> v1:172.21.15.170:6800/17396 conn(0x7f37a0048070 legacy=0x7f37a004a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 msgr2=0x7f37a0003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 --2- 172.21.15.170:0/1988232496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a0004c90 0x7f37a0003540 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f37b4001280 tx=0x7f37b4010c80).stop 2020-01-26T15:35:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c263f700 1 -- 172.21.15.170:0/1988232496 reap_dead start 2020-01-26T15:35:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c263f700 1 -- 172.21.15.170:0/1988232496 reap_dead start 2020-01-26T15:35:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 shutdown_connections 2020-01-26T15:35:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 >> 172.21.15.170:0/1988232496 conn(0x7f37bc097720 msgr2=0x7f37bc07d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 shutdown_connections 2020-01-26T15:35:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.120+0000 7f37c13dd700 1 -- 172.21.15.170:0/1988232496 wait complete. 2020-01-26T15:35:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 Processor -- start 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 -- start start 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7faacc0a8510 0x7faacc0a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7faacc07e6e0 0x7faacc07eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0a73c0 con 0x7faacc0977f0 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7faacc07f060 con 0x7faacc0a8510 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2f27700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7faacc09a310 con 0x7faacc07e6e0 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2726700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7faacc0977f0 0x7faacc060ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43044/0 (socket says 172.21.15.170:43044) 2020-01-26T15:35:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad2726700 1 -- 172.21.15.170:0/524207569 learned_addr learned my addr 172.21.15.170:0/524207569 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad4189700 -1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6791/0 conn(0x7faacc07e6e0 0x7faacc07eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad1f25700 -1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6790/0 conn(0x7faacc0a8510 0x7faacc0a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad1f25700 1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6790/0 conn(0x7faacc0a8510 0x7faacc0a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad4189700 1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6791/0 conn(0x7faacc07e6e0 0x7faacc07eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738359317 0 0) 0x7faacc0a73c0 con 0x7faacc0977f0 2020-01-26T15:35:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.236+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab8003230 con 0x7faacc0977f0 2020-01-26T15:35:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1612032176 0 0) 0x7faab8003230 con 0x7faacc0977f0 2020-01-26T15:35:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6791/0 conn(0x7faacc07e6e0 msgr2=0x7faacc07eb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6791/0 conn(0x7faacc07e6e0 0x7faacc07eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6790/0 conn(0x7faacc0a8510 msgr2=0x7faacc0a6e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6790/0 conn(0x7faacc0a8510 0x7faacc0a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc14c530 con 0x7faacc0977f0 2020-01-26T15:35:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faac8001710 con 0x7faacc0977f0 2020-01-26T15:35:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faac8001910 con 0x7faacc0977f0 2020-01-26T15:35:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad1724700 1 -- 172.21.15.170:0/524207569 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faac80045b0 con 0x7faacc0977f0 2020-01-26T15:35:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 -- 172.21.15.170:0/524207569 >> v1:172.21.15.170:6791/0 conn(0x7faacc0977f0 legacy=0x7faacc060ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 -- 172.21.15.170:0/524207569 shutdown_connections 2020-01-26T15:35:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6791/0 conn(0x7faacc07e6e0 0x7faacc07eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 --2- 172.21.15.170:0/524207569 >> v2:172.21.15.170:6790/0 conn(0x7faacc0a8510 0x7faacc0a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 -- 172.21.15.170:0/524207569 >> 172.21.15.170:0/524207569 conn(0x7faacc066370 msgr2=0x7faacc060030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 -- 172.21.15.170:0/524207569 shutdown_connections 2020-01-26T15:35:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 -- 172.21.15.170:0/524207569 wait complete. 2020-01-26T15:35:34.256 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.240+0000 7faad2f27700 1 Processor -- start 2020-01-26T15:35:34.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2f27700 1 -- start start 2020-01-26T15:35:34.257 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2f27700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc07d5d0 con 0x7faacc0620c0 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2f27700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0624f0 con 0x7faacc063d80 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2f27700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc12b380 con 0x7faacc063870 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2726700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7faacc063870 0x7faacc12ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43050/0 (socket says 172.21.15.170:43050) 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad1f25700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7faacc063d80 0x7faacc1362a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47926/0 (socket says 172.21.15.170:47926) 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2726700 1 -- 172.21.15.170:0/3254010869 learned_addr learned my addr 172.21.15.170:0/3254010869 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239830610 0 0) 0x7faacc12b380 con 0x7faacc063870 2020-01-26T15:35:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab4003230 con 0x7faacc063870 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442808678 0 0) 0x7faacc07d5d0 con 0x7faacc0620c0 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc12b380 con 0x7faacc0620c0 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855217827 0 0) 0x7faacc0624f0 con 0x7faacc063d80 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc07d5d0 con 0x7faacc063d80 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3792786016 0 0) 0x7faab4003230 con 0x7faacc063870 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faacc0624f0 con 0x7faacc063870 2020-01-26T15:35:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faac8001830 con 0x7faacc063870 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2335216235 0 0) 0x7faacc12b380 con 0x7faacc0620c0 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faab4003230 con 0x7faacc0620c0 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2346022952 0 0) 0x7faacc07d5d0 con 0x7faacc063d80 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faacc12b380 con 0x7faacc063d80 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faac4001960 con 0x7faacc0620c0 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 >> v1:172.21.15.170:6791/0 conn(0x7faacc063870 legacy=0x7faacc12ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 >> v1:172.21.15.170:6790/0 conn(0x7faacc063d80 legacy=0x7faacc1362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 >> v1:172.21.15.170:6789/0 conn(0x7faacc0620c0 legacy=0x7faacc139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7faacc0624f0 con 0x7faab4003540 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7faacc07d5d0 con 0x7faab40087e0 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab4004250 con 0x7faab400c430 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118387590 0 0) 0x7faacc0624f0 con 0x7faab4003540 2020-01-26T15:35:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab400edc0 con 0x7faab4003540 2020-01-26T15:35:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274873446 0 0) 0x7faacc07d5d0 con 0x7faab40087e0 2020-01-26T15:35:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc0624f0 con 0x7faab40087e0 2020-01-26T15:35:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 -- 172.21.15.170:0/3254010869 >> v1:172.21.15.170:6791/0 conn(0x7faab40087e0 legacy=0x7faab400ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 -- 172.21.15.170:0/3254010869 >> v1:172.21.15.170:6790/0 conn(0x7faab4003540 legacy=0x7faab4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 -- 172.21.15.170:0/3254010869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7faacc07dcd0 con 0x7faab400c430 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc063870 con 0x7faab400c430 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc063d80 con 0x7faab400c430 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7faac400e160 con 0x7faab400c430 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.244+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac400e360 con 0x7faab400c430 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.248+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.248+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa8003360 con 0x7faab400c430 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.248+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7faac400e550 con 0x7faab400c430 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.248+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.248+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(30..30 src has 1..30) v4 ==== 3301+0+0 (secure 0 0 0) 0x7faac404dbc0 con 0x7faab400c430 2020-01-26T15:35:34.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.252+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.252+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7faac4033f70 con 0x7faab400c430 2020-01-26T15:35:34.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.372+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7faaa8002240 con 0x7faab400c430 2020-01-26T15:35:34.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.876+0000 7faad4189700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:34.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.876+0000 7faac2ffd700 1 -- 172.21.15.170:0/3254010869 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7faac400e860 con 0x7faab400c430 2020-01-26T15:35:34.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 >> v1:172.21.15.170:6800/17396 conn(0x7faab4048aa0 legacy=0x7faab404afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 msgr2=0x7faab400e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 --2- 172.21.15.170:0/3254010869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faab400c430 0x7faab400e870 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7faac4001730 tx=0x7faac40116c0).stop 2020-01-26T15:35:34.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad4189700 1 -- 172.21.15.170:0/3254010869 reap_dead start 2020-01-26T15:35:34.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 shutdown_connections 2020-01-26T15:35:34.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 >> 172.21.15.170:0/3254010869 conn(0x7faacc07b580 msgr2=0x7faacc05e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:34.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 shutdown_connections 2020-01-26T15:35:34.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.880+0000 7faad2f27700 1 -- 172.21.15.170:0/3254010869 wait complete. 2020-01-26T15:35:34.884 INFO:teuthology.orchestra.run.smithi170.stderr:set pool 1 pg_autoscale_mode to off 2020-01-26T15:35:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 Processor -- start 2020-01-26T15:35:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 -- start start 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f18780a8510 0x7f18780a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18780a73c0 con 0x7f18780977f0 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187809a310 con 0x7f187807e6e0 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f187814e550 con 0x7f18780a8510 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f187d729700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f187807e6e0 0x7f187807eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43068/0 (socket says 172.21.15.170:43068) 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1876ffd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f18780a8510 0x7f18780a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f187d729700 1 -- 172.21.15.170:0/1492127544 learned_addr learned my addr 172.21.15.170:0/1492127544 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1876ffd700 1 --2- 172.21.15.170:0/1492127544 >> v2:172.21.15.170:6791/0 conn(0x7f18780a8510 0x7f18780a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245840062 0 0) 0x7f187809a310 con 0x7f187807e6e0 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1864003230 con 0x7f187807e6e0 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110737731 0 0) 0x7f18780a73c0 con 0x7f18780977f0 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187809a310 con 0x7f18780977f0 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3158652219 0 0) 0x7f1864003230 con 0x7f187807e6e0 2020-01-26T15:35:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 >> v2:172.21.15.170:6791/0 conn(0x7f18780a8510 msgr2=0x7f18780a6e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 --2- 172.21.15.170:0/1492127544 >> v2:172.21.15.170:6791/0 conn(0x7f18780a8510 0x7f18780a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 >> v1:172.21.15.170:6790/0 conn(0x7f18780977f0 legacy=0x7f1878060ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187814e710 con 0x7f187807e6e0 2020-01-26T15:35:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1870001710 con 0x7f187807e6e0 2020-01-26T15:35:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f18700019e0 con 0x7f187807e6e0 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f18767fc700 1 -- 172.21.15.170:0/1492127544 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f18700045b0 con 0x7f187807e6e0 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.988+0000 7f1877fff700 1 -- 172.21.15.170:0/1492127544 >> v1:172.21.15.170:6791/0 conn(0x7f187807e6e0 legacy=0x7f187807eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 -- 172.21.15.170:0/1492127544 shutdown_connections 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 --2- 172.21.15.170:0/1492127544 >> v2:172.21.15.170:6791/0 conn(0x7f18780a8510 0x7f18780a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 -- 172.21.15.170:0/1492127544 >> 172.21.15.170:0/1492127544 conn(0x7f1878066370 msgr2=0x7f1878060030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 -- 172.21.15.170:0/1492127544 shutdown_connections 2020-01-26T15:35:34.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 -- 172.21.15.170:0/1492127544 wait complete. 2020-01-26T15:35:35.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 Processor -- start 2020-01-26T15:35:35.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.992+0000 7f1877fff700 1 -- start start 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f187812aed0 0x7f187812b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187807fdb0 con 0x7f187807f980 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187812b850 con 0x7f18781366d0 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f18780a3fa0 con 0x7f187812aed0 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1876ffd700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f187812aed0 0x7f187812b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f18777fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f187807f980 0x7f1878061e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47944/0 (socket says 172.21.15.170:47944) 2020-01-26T15:35:35.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f18777fe700 1 -- 172.21.15.170:0/3766931818 learned_addr learned my addr 172.21.15.170:0/3766931818 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1876ffd700 1 --2- 172.21.15.170:0/3766931818 >> v2:172.21.15.170:6790/0 conn(0x7f187812aed0 0x7f187812b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986360968 0 0) 0x7f187809a310 con 0x7f187807f980 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185c003230 con 0x7f187807f980 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203801576 0 0) 0x7f187812b850 con 0x7f18781366d0 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187809a310 con 0x7f18781366d0 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2528765836 0 0) 0x7f185c003230 con 0x7f187807f980 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f187812b850 con 0x7f187807f980 2020-01-26T15:35:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1868002cc0 con 0x7f187807f980 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3646331172 0 0) 0x7f187809a310 con 0x7f18781366d0 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f185c003230 con 0x7f18781366d0 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1870001420 con 0x7f18781366d0 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1467522063 0 0) 0x7f187812b850 con 0x7f187807f980 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 >> v2:172.21.15.170:6790/0 conn(0x7f187812aed0 msgr2=0x7f187812b300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 --2- 172.21.15.170:0/3766931818 >> v2:172.21.15.170:6790/0 conn(0x7f187812aed0 0x7f187812b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 >> v1:172.21.15.170:6791/0 conn(0x7f18781366d0 legacy=0x7f1878138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780a3af0 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18780617b0 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878062e20 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1868001940 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1868001d20 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850003360 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:34.996+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f1868001f20 con 0x7f187807f980 2020-01-26T15:35:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.000+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(31..31 src has 1..31) v4 ==== 3301+0+0 (unknown 308764436 0 0) 0x7f187807fdb0 con 0x7f187807f980 2020-01-26T15:35:35.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.004+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f18680312b0 con 0x7f187807f980 2020-01-26T15:35:35.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.124+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f1850002260 con 0x7f187807f980 2020-01-26T15:35:35.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.884+0000 7f186ffff700 1 -- 172.21.15.170:0/3766931818 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v32) v1 ==== 164+0+0 (unknown 3692496525 0 0) 0x7f1868002f90 con 0x7f187807f980 2020-01-26T15:35:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.884+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 >> v1:172.21.15.170:6800/17396 conn(0x7f185c03e510 legacy=0x7f185c040a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:35.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.884+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 >> v1:172.21.15.170:6790/0 conn(0x7f187807f980 legacy=0x7f1878061e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.884+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 shutdown_connections 2020-01-26T15:35:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.884+0000 7f1877fff700 1 --2- 172.21.15.170:0/3766931818 >> v2:172.21.15.170:6790/0 conn(0x7f187812aed0 0x7f187812b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:35.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.884+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 >> 172.21.15.170:0/3766931818 conn(0x7f18780a6e70 msgr2=0x7f1878024fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:35.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.888+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 shutdown_connections 2020-01-26T15:35:35.890 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:35.888+0000 7f1877fff700 1 -- 172.21.15.170:0/3766931818 wait complete. 2020-01-26T15:35:35.893 INFO:teuthology.orchestra.run.smithi170.stderr:set pool 2 pg_autoscale_mode to off 2020-01-26T15:35:36.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 Processor -- start 2020-01-26T15:35:36.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- start start 2020-01-26T15:35:36.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f01ac093d90 0x7f01ac095d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:36.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f01ac097140 0x7f01ac14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac098220 con 0x7f01ac092e20 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0941c0 con 0x7f01ac093d90 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0962b0 con 0x7f01ac097140 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b13c8700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f01ac093d90 0x7f01ac095d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b23ca700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f01ac097140 0x7f01ac14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b1bc9700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f01ac092e20 0x7f01ac096940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43080/0 (socket says 172.21.15.170:43080) 2020-01-26T15:35:36.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b1bc9700 1 -- 172.21.15.170:0/302972477 learned_addr learned my addr 172.21.15.170:0/302972477 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:36.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b13c8700 1 --2- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6790/0 conn(0x7f01ac093d90 0x7f01ac095d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:36.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b23ca700 1 --2- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6791/0 conn(0x7f01ac097140 0x7f01ac14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:36.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440637203 0 0) 0x7f01ac098220 con 0x7f01ac092e20 2020-01-26T15:35:36.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0198003230 con 0x7f01ac092e20 2020-01-26T15:35:36.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2100680104 0 0) 0x7f0198003230 con 0x7f01ac092e20 2020-01-26T15:35:36.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6791/0 conn(0x7f01ac097140 msgr2=0x7f01ac14bbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 --2- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6791/0 conn(0x7f01ac097140 0x7f01ac14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6790/0 conn(0x7f01ac093d90 msgr2=0x7f01ac095d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 --2- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6790/0 conn(0x7f01ac093d90 0x7f01ac095d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac05b340 con 0x7f01ac092e20 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f01a4001a90 con 0x7f01ac092e20 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f01a4001e20 con 0x7f01ac092e20 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b0bc7700 1 -- 172.21.15.170:0/302972477 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f01a4004ae0 con 0x7f01ac092e20 2020-01-26T15:35:36.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- 172.21.15.170:0/302972477 >> v1:172.21.15.170:6791/0 conn(0x7f01ac092e20 legacy=0x7f01ac096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:36.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- 172.21.15.170:0/302972477 shutdown_connections 2020-01-26T15:35:36.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 --2- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6791/0 conn(0x7f01ac097140 0x7f01ac14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:36.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 --2- 172.21.15.170:0/302972477 >> v2:172.21.15.170:6790/0 conn(0x7f01ac093d90 0x7f01ac095d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:36.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- 172.21.15.170:0/302972477 >> 172.21.15.170:0/302972477 conn(0x7f01ac05ec00 msgr2=0x7f01ac05f030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:36.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- 172.21.15.170:0/302972477 shutdown_connections 2020-01-26T15:35:36.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.000+0000 7f01b362c700 1 -- 172.21.15.170:0/302972477 wait complete. 2020-01-26T15:35:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 Processor -- start 2020-01-26T15:35:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 -- start start 2020-01-26T15:35:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f01ac11f8e0 0x7f01ac11ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f01ac120a70 0x7f01ac120ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac11fe60 con 0x7f01ac11cb00 2020-01-26T15:35:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac11dbe0 con 0x7f01ac120a70 2020-01-26T15:35:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac1213f0 con 0x7f01ac11f8e0 2020-01-26T15:35:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b13c8700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f01ac120a70 0x7f01ac120ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b1bc9700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f01ac11f8e0 0x7f01ac11ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b23ca700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f01ac11cb00 0x7f01ac11cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43088/0 (socket says 172.21.15.170:43088) 2020-01-26T15:35:36.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b13c8700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f01ac120a70 0x7f01ac120ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:36.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b23ca700 1 -- 172.21.15.170:0/691029493 learned_addr learned my addr 172.21.15.170:0/691029493 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:36.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b1bc9700 1 --2- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6791/0 conn(0x7f01ac11f8e0 0x7f01ac11ecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:36.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342940574 0 0) 0x7f01ac11fe60 con 0x7f01ac11cb00 2020-01-26T15:35:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0194003230 con 0x7f01ac11cb00 2020-01-26T15:35:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 749811747 0 0) 0x7f0194003230 con 0x7f01ac11cb00 2020-01-26T15:35:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01ac11fe60 con 0x7f01ac11cb00 2020-01-26T15:35:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f01a8001610 con 0x7f01ac11cb00 2020-01-26T15:35:36.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3683604774 0 0) 0x7f01ac11fe60 con 0x7f01ac11cb00 2020-01-26T15:35:36.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6791/0 conn(0x7f01ac11f8e0 msgr2=0x7f01ac11ecc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:36.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 --2- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6791/0 conn(0x7f01ac11f8e0 0x7f01ac11ecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:36.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6790/0 conn(0x7f01ac120a70 msgr2=0x7f01ac120ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:36.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 --2- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6790/0 conn(0x7f01ac120a70 0x7f01ac120ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:36.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac092080 con 0x7f01ac11cb00 2020-01-26T15:35:36.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac11d730 con 0x7f01ac11cb00 2020-01-26T15:35:36.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac096a10 con 0x7f01ac11cb00 2020-01-26T15:35:36.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f01a8001ec0 con 0x7f01ac11cb00 2020-01-26T15:35:36.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.004+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f01a80022a0 con 0x7f01ac11cb00 2020-01-26T15:35:36.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.008+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f01a80024a0 con 0x7f01ac11cb00 2020-01-26T15:35:36.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.008+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac056600 con 0x7f01ac11cb00 2020-01-26T15:35:36.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.008+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(32..32 src has 1..32) v4 ==== 3301+0+0 (unknown 666551986 0 0) 0x7f01a804ba20 con 0x7f01ac11cb00 2020-01-26T15:35:36.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.016+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f01a8030fa0 con 0x7f01ac11cb00 2020-01-26T15:35:36.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.136+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f01ac05e220 con 0x7f01ac11cb00 2020-01-26T15:35:36.903 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.900+0000 7f01a27fc700 1 -- 172.21.15.170:0/691029493 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v33) v1 ==== 160+0+0 (unknown 3865343736 0 0) 0x7f01a804a6f0 con 0x7f01ac11cb00 2020-01-26T15:35:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 >> v1:172.21.15.170:6800/17396 conn(0x7f019403e0a0 legacy=0x7f01940405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 >> v1:172.21.15.170:6791/0 conn(0x7f01ac11cb00 legacy=0x7f01ac11cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 shutdown_connections 2020-01-26T15:35:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 --2- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6791/0 conn(0x7f01ac11f8e0 0x7f01ac11ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 --2- 172.21.15.170:0/691029493 >> v2:172.21.15.170:6790/0 conn(0x7f01ac120a70 0x7f01ac120ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 >> 172.21.15.170:0/691029493 conn(0x7f01ac094450 msgr2=0x7f01ac0a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 shutdown_connections 2020-01-26T15:35:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:36.904+0000 7f01b362c700 1 -- 172.21.15.170:0/691029493 wait complete. 2020-01-26T15:35:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:set pool 3 pg_autoscale_mode to off 2020-01-26T15:35:36.918 INFO:teuthology.run_tasks:Running task ceph.healthy... 2020-01-26T15:35:36.932 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-26T15:35:36.932 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-26T15:35:36.932 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-26T15:35:37.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 Processor -- start 2020-01-26T15:35:37.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- start start 2020-01-26T15:35:37.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fed2005edd0 0x7fed2005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed20098000 con 0x7fed20149040 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2005e050 con 0x7fed200a6870 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fed200a6ca0 con 0x7fed2005edd0 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1ed9d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fed2005edd0 0x7fed2005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1e59c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fed200a6870 0x7fed2007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47968/0 (socket says 172.21.15.170:47968) 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1e59c700 1 -- 172.21.15.170:0/3604888776 learned_addr learned my addr 172.21.15.170:0/3604888776 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed24f9b700 1 --1- 172.21.15.170:0/3604888776 >> v1:172.21.15.170:6789/0 conn(0x7fed20149040 0x7fed2014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51092/0 (socket says 172.21.15.170:51092) 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1ed9d700 1 --2- 172.21.15.170:0/3604888776 >> v2:172.21.15.170:6791/0 conn(0x7fed2005edd0 0x7fed2005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959635533 0 0) 0x7fed20098000 con 0x7fed20149040 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed0c003230 con 0x7fed20149040 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740883521 0 0) 0x7fed2005e050 con 0x7fed200a6870 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed20098000 con 0x7fed200a6870 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 735868563 0 0) 0x7fed20098000 con 0x7fed200a6870 2020-01-26T15:35:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 >> v2:172.21.15.170:6791/0 conn(0x7fed2005edd0 msgr2=0x7fed2005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 --2- 172.21.15.170:0/3604888776 >> v2:172.21.15.170:6791/0 conn(0x7fed2005edd0 0x7fed2005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 >> v1:172.21.15.170:6789/0 conn(0x7fed20149040 legacy=0x7fed2014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2014ecb0 con 0x7fed200a6870 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fed080016f0 con 0x7fed200a6870 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fed080019c0 con 0x7fed200a6870 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1dd9b700 1 -- 172.21.15.170:0/3604888776 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fed080045b0 con 0x7fed200a6870 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- 172.21.15.170:0/3604888776 >> v1:172.21.15.170:6790/0 conn(0x7fed200a6870 legacy=0x7fed2007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- 172.21.15.170:0/3604888776 shutdown_connections 2020-01-26T15:35:37.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 --2- 172.21.15.170:0/3604888776 >> v2:172.21.15.170:6791/0 conn(0x7fed2005edd0 0x7fed2005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- 172.21.15.170:0/3604888776 >> 172.21.15.170:0/3604888776 conn(0x7fed20098e70 msgr2=0x7fed200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- 172.21.15.170:0/3604888776 shutdown_connections 2020-01-26T15:35:37.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.048+0000 7fed1f59e700 1 -- 172.21.15.170:0/3604888776 wait complete. 2020-01-26T15:35:37.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1f59e700 1 Processor -- start 2020-01-26T15:35:37.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1f59e700 1 -- start start 2020-01-26T15:35:37.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1f59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fed200a1030 0x7fed20077990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1f59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2011e0a0 con 0x7fed20077ee0 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1f59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2011f2b0 con 0x7fed200a04c0 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1f59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fed200a1460 con 0x7fed200a1030 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1ed9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fed200a04c0 0x7fed2011eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43098/0 (socket says 172.21.15.170:43098) 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1ed9d700 1 -- 172.21.15.170:0/95171495 learned_addr learned my addr 172.21.15.170:0/95171495 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed24f9b700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fed20077ee0 0x7fed201375d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47974/0 (socket says 172.21.15.170:47974) 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1e59c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fed200a1030 0x7fed20077990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed1e59c700 1 --2- 172.21.15.170:0/95171495 >> v2:172.21.15.170:6790/0 conn(0x7fed200a1030 0x7fed20077990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377742072 0 0) 0x7fed2011e0a0 con 0x7fed20077ee0 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed04003230 con 0x7fed20077ee0 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846301835 0 0) 0x7fed2011f2b0 con 0x7fed200a04c0 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed2011e0a0 con 0x7fed200a04c0 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 595326126 0 0) 0x7fed04003230 con 0x7fed20077ee0 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fed2011f2b0 con 0x7fed20077ee0 2020-01-26T15:35:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fed18001c90 con 0x7fed20077ee0 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 523557243 0 0) 0x7fed2011e0a0 con 0x7fed200a04c0 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fed04003230 con 0x7fed200a04c0 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.052+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fed10002770 con 0x7fed200a04c0 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1003614728 0 0) 0x7fed2011f2b0 con 0x7fed20077ee0 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 >> v2:172.21.15.170:6790/0 conn(0x7fed200a1030 msgr2=0x7fed20077990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 --2- 172.21.15.170:0/95171495 >> v2:172.21.15.170:6790/0 conn(0x7fed200a1030 0x7fed20077990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 >> v1:172.21.15.170:6791/0 conn(0x7fed200a04c0 legacy=0x7fed2011eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200a3c80 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed20078dc0 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fed200a3400 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fed18001fc0 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fed18004dd0 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed20056600 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fed18005050 con 0x7fed20077ee0 2020-01-26T15:35:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.056+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7fed1804bcd0 con 0x7fed20077ee0 2020-01-26T15:35:37.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.064+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fed18031250 con 0x7fed20077ee0 2020-01-26T15:35:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.212+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fed2005cc60 con 0x7fed20077ee0 2020-01-26T15:35:37.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed177fe700 1 -- 172.21.15.170:0/95171495 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v8) v1 ==== 74+0+97429 (unknown 4182151985 0 908825000) 0x7fed1804a9a0 con 0x7fed20077ee0 2020-01-26T15:35:37.219 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 >> v1:172.21.15.170:6800/17396 conn(0x7fed0403e440 legacy=0x7fed04040950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 >> v1:172.21.15.170:6790/0 conn(0x7fed20077ee0 legacy=0x7fed201375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 shutdown_connections 2020-01-26T15:35:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 --2- 172.21.15.170:0/95171495 >> v2:172.21.15.170:6790/0 conn(0x7fed200a1030 0x7fed20077990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 >> 172.21.15.170:0/95171495 conn(0x7fed2007dca0 msgr2=0x7fed2007c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 shutdown_connections 2020-01-26T15:35:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.216+0000 7fed1f59e700 1 -- 172.21.15.170:0/95171495 wait complete. 2020-01-26T15:35:37.237 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":8,"active_gid":64101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6800","nonce":17396}]},"active_addr":"172.21.15.170:6800/17396","active_change":"2020-01-26T15:35:10.598853+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":64105,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":18,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3164847708}]},{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3675662826}]},{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":4202748683}]}]}} 2020-01-26T15:35:37.243 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-26T15:35:37.244 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:35:37.244 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:37.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.348+0000 7f26968fc700 1 Processor -- start 2020-01-26T15:35:37.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.348+0000 7f26968fc700 1 -- start start 2020-01-26T15:35:37.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f269005e5f0 0x7f26900a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2690149040 0x7f269014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26900a6dc0 con 0x7f269005edd0 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f269005ea20 con 0x7f269005e5f0 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2690098000 con 0x7f2690149040 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26958fa700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f269005e5f0 0x7f26900a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f2697b5e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2690149040 0x7f269014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26960fb700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f269005edd0 0x7f269007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:47982/0 (socket says 172.21.15.170:47982) 2020-01-26T15:35:37.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26958fa700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f269005e5f0 0x7f26900a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26960fb700 1 -- 172.21.15.170:0/2414258328 learned_addr learned my addr 172.21.15.170:0/2414258328 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f2697b5e700 1 --2- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6791/0 conn(0x7f2690149040 0x7f269014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250728328 0 0) 0x7f26900a6dc0 con 0x7f269005edd0 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f267c003230 con 0x7f269005edd0 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3124117269 0 0) 0x7f267c003230 con 0x7f269005edd0 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6791/0 conn(0x7f2690149040 msgr2=0x7f269014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:37.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 --2- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6791/0 conn(0x7f2690149040 0x7f269014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6790/0 conn(0x7f269005e5f0 msgr2=0x7f26900a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 --2- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6790/0 conn(0x7f269005e5f0 0x7f26900a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269005e050 con 0x7f269005edd0 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f268c001710 con 0x7f269005edd0 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f268c001aa0 con 0x7f269005edd0 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- 172.21.15.170:0/2414258328 >> v1:172.21.15.170:6790/0 conn(0x7f269005edd0 legacy=0x7f269007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26950f9700 1 -- 172.21.15.170:0/2414258328 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f268c004760 con 0x7f269005edd0 2020-01-26T15:35:37.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- 172.21.15.170:0/2414258328 shutdown_connections 2020-01-26T15:35:37.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 --2- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6791/0 conn(0x7f2690149040 0x7f269014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 --2- 172.21.15.170:0/2414258328 >> v2:172.21.15.170:6790/0 conn(0x7f269005e5f0 0x7f26900a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- 172.21.15.170:0/2414258328 >> 172.21.15.170:0/2414258328 conn(0x7f2690098e70 msgr2=0x7f26900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.360 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- 172.21.15.170:0/2414258328 shutdown_connections 2020-01-26T15:35:37.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.352+0000 7f26968fc700 1 -- 172.21.15.170:0/2414258328 wait complete. 2020-01-26T15:35:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 Processor -- start 2020-01-26T15:35:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 -- start start 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f269012fdf0 0x7f2690130220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2690130ba0 con 0x7f2690099a00 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269007e710 con 0x7f2690130770 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f26900a2030 con 0x7f269012fdf0 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2697b5e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f2690130770 0x7f2690137240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43116/0 (socket says 172.21.15.170:43116) 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26958fa700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f269012fdf0 0x7f2690130220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2697b5e700 1 -- 172.21.15.170:0/503432417 learned_addr learned my addr 172.21.15.170:0/503432417 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26958fa700 1 --2- 172.21.15.170:0/503432417 >> v2:172.21.15.170:6791/0 conn(0x7f269012fdf0 0x7f2690130220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591574183 0 0) 0x7f2690130ba0 con 0x7f2690099a00 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2678003230 con 0x7f2690099a00 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967718532 0 0) 0x7f269007e710 con 0x7f2690130770 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2690130ba0 con 0x7f2690130770 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 529402142 0 0) 0x7f2678003230 con 0x7f2690099a00 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f269007e710 con 0x7f2690099a00 2020-01-26T15:35:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f268c004720 con 0x7f2690099a00 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3220534542 0 0) 0x7f2690130ba0 con 0x7f2690130770 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2678003230 con 0x7f2690130770 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2688001960 con 0x7f2690130770 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2617645017 0 0) 0x7f269007e710 con 0x7f2690099a00 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 >> v2:172.21.15.170:6791/0 conn(0x7f269012fdf0 msgr2=0x7f2690130220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 --2- 172.21.15.170:0/503432417 >> v2:172.21.15.170:6791/0 conn(0x7f269012fdf0 0x7f2690130220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 >> v1:172.21.15.170:6791/0 conn(0x7f2690130770 legacy=0x7f2690137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690122e10 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26900a2510 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f268c001860 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f268c004b60 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f269005efe0 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.356+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f268c010620 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.360+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7f268c04b980 con 0x7f2690099a00 2020-01-26T15:35:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.360+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2690056600 con 0x7f2690099a00 2020-01-26T15:35:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.364+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f268c030f60 con 0x7f2690099a00 2020-01-26T15:35:37.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f269005cc60 con 0x7f2690099a00 2020-01-26T15:35:37.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f2682ffd700 1 -- 172.21.15.170:0/503432417 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+9078 (unknown 2892004667 0 4239173831) 0x7f268c004de0 con 0x7f2690099a00 2020-01-26T15:35:37.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:37.489 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":33,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:36.890152+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":18374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":18374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":18374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":18374}]},"public_addr":"172.21.15.170:6809/18374","cluster_addr":"172.21.15.170:6810/18374","heartbeat_back_addr":"172.21.15.170:6812/18374","heartbeat_front_addr":"172.21.15.170:6811/18374","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":18293}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":18293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":18293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":18293}]},"public_addr":"172.21.15.170:6801/18293","cluster_addr":"172.21.15.170:6802/18293","heartbeat_back_addr":"172.21.15.170:6804/18293","heartbeat_front_addr":"172.21.15.170:6803/18293","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":26,"up_thru":26,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":18671}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":18671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":18671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":18671}]},"public_addr":"172.21.15.170:6813/18671","cluster_addr":"172.21.15.170:6814/18671","heartbeat_back_addr":"172.21.15.170:6816/18671","heartbeat_front_addr":"172.21.15.170:6815/18671","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":18499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":18499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":18499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":18499}]},"public_addr":"172.21.15.170:6805/18499","cluster_addr":"172.21.15.170:6806/18499","heartbeat_back_addr":"172.21.15.170:6808/18499","heartbeat_front_addr":"172.21.15.170:6807/18499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:35:19.809376+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000","172.21.15.170:6817/12433226":"2020-01-27T15:35:31.240361+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:37.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 >> v1:172.21.15.170:6800/17396 conn(0x7f267803e490 legacy=0x7f26780409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 >> v1:172.21.15.170:6790/0 conn(0x7f2690099a00 legacy=0x7f26900a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 shutdown_connections 2020-01-26T15:35:37.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f26968fc700 1 --2- 172.21.15.170:0/503432417 >> v2:172.21.15.170:6791/0 conn(0x7f269012fdf0 0x7f2690130220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.484+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 >> 172.21.15.170:0/503432417 conn(0x7f2690123020 msgr2=0x7f269007f040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.488+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 shutdown_connections 2020-01-26T15:35:37.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.488+0000 7f26968fc700 1 -- 172.21.15.170:0/503432417 wait complete. 2020-01-26T15:35:37.500 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:35:37.501 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:35:37.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.608+0000 7f01108cb700 1 Processor -- start 2020-01-26T15:35:37.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.608+0000 7f01108cb700 1 -- start start 2020-01-26T15:35:37.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f010c05e5f0 0x7f010c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:37.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c0a6dc0 con 0x7f010c05edd0 2020-01-26T15:35:37.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c05ea20 con 0x7f010c149040 2020-01-26T15:35:37.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f010c098000 con 0x7f010c05e5f0 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010b7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f010c05e5f0 0x7f010c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010b7fe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f010c05e5f0 0x7f010c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f0111b2d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f010c149040 0x7f010c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43126/0 (socket says 172.21.15.170:43126) 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f0111b2d700 1 -- 172.21.15.170:0/3065411152 learned_addr learned my addr 172.21.15.170:0/3065411152 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758557595 0 0) 0x7f010c05ea20 con 0x7f010c149040 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f8003230 con 0x7f010c149040 2020-01-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050673298 0 0) 0x7f010c0a6dc0 con 0x7f010c05edd0 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f010c05ea20 con 0x7f010c05edd0 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2122603658 0 0) 0x7f00f8003230 con 0x7f010c149040 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 >> v2:172.21.15.170:6791/0 conn(0x7f010c05e5f0 msgr2=0x7f010c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 --2- 172.21.15.170:0/3065411152 >> v2:172.21.15.170:6791/0 conn(0x7f010c05e5f0 0x7f010c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 >> v1:172.21.15.170:6789/0 conn(0x7f010c05edd0 legacy=0x7f010c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c05e050 con 0x7f010c149040 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f00fc001710 con 0x7f010c149040 2020-01-26T15:35:37.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f00fc0019e0 con 0x7f010c149040 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f010affd700 1 -- 172.21.15.170:0/3065411152 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f00fc0045b0 con 0x7f010c149040 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- 172.21.15.170:0/3065411152 >> v1:172.21.15.170:6791/0 conn(0x7f010c149040 legacy=0x7f010c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- 172.21.15.170:0/3065411152 shutdown_connections 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 --2- 172.21.15.170:0/3065411152 >> v2:172.21.15.170:6791/0 conn(0x7f010c05e5f0 0x7f010c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- 172.21.15.170:0/3065411152 >> 172.21.15.170:0/3065411152 conn(0x7f010c098e70 msgr2=0x7f010c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- 172.21.15.170:0/3065411152 shutdown_connections 2020-01-26T15:35:37.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- 172.21.15.170:0/3065411152 wait complete. 2020-01-26T15:35:37.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 Processor -- start 2020-01-26T15:35:37.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.612+0000 7f01108cb700 1 -- start start 2020-01-26T15:35:37.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f01108cb700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f010c0a36a0 0x7f010c12ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f01108cb700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c0a22d0 con 0x7f010c11fa70 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f01108cb700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c079450 con 0x7f010c0a25e0 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f01108cb700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f010c09e320 con 0x7f010c0a36a0 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0111b2d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f010c0a36a0 0x7f010c12ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0111b2d700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f010c0a36a0 0x7f010c12ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f010bfff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f010c0a25e0 0x7f010c078c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48002/0 (socket says 172.21.15.170:48002) 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f010bfff700 1 -- 172.21.15.170:0/3459928498 learned_addr learned my addr 172.21.15.170:0/3459928498 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924499381 0 0) 0x7f010c0a22d0 con 0x7f010c11fa70 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0003230 con 0x7f010c11fa70 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819551085 0 0) 0x7f010c079450 con 0x7f010c0a25e0 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f010c0a22d0 con 0x7f010c0a25e0 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2960165015 0 0) 0x7f00f0003230 con 0x7f010c11fa70 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f010c079450 con 0x7f010c11fa70 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f00f4002a70 con 0x7f010c11fa70 2020-01-26T15:35:37.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 >> v2:172.21.15.170:6790/0 conn(0x7f010c0a36a0 msgr2=0x7f010c12ae90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 --2- 172.21.15.170:0/3459928498 >> v2:172.21.15.170:6790/0 conn(0x7f010c0a36a0 0x7f010c12ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 >> v1:172.21.15.170:6790/0 conn(0x7f010c0a25e0 legacy=0x7f010c078c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 >> v1:172.21.15.170:6789/0 conn(0x7f010c11fa70 legacy=0x7f010c127670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 --2- 172.21.15.170:0/3459928498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00f0004ea0 0x7f00f000e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f00f0003230 con 0x7f00f0004120 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f00f000f570 con 0x7f00f0003c30 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c09e320 con 0x7f00f0004ea0 2020-01-26T15:35:37.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0111b2d700 1 --2- 172.21.15.170:0/3459928498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00f0004ea0 0x7f00f000e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39212285 0 0) 0x7f00f000f570 con 0x7f00f0003c30 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f000f800 con 0x7f00f0003c30 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259399893 0 0) 0x7f00f0003230 con 0x7f00f0004120 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f000f570 con 0x7f00f0004120 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 220427486 0 0) 0x7f00f000f800 con 0x7f00f0003c30 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f00f0003230 con 0x7f00f0003c30 2020-01-26T15:35:37.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0104001aa0 con 0x7f00f0003c30 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2759608156 0 0) 0x7f00f0003230 con 0x7f00f0003c30 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00f0004ea0 msgr2=0x7f00f000e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 --2- 172.21.15.170:0/3459928498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00f0004ea0 0x7f00f000e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 >> v1:172.21.15.170:6790/0 conn(0x7f00f0004120 legacy=0x7f00f000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0a3fe0 con 0x7f00f0003c30 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c0a3ad0 con 0x7f00f0003c30 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c0a2780 con 0x7f00f0003c30 2020-01-26T15:35:37.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f01040047c0 con 0x7f00f0003c30 2020-01-26T15:35:37.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f01040049b0 con 0x7f00f0003c30 2020-01-26T15:35:37.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.616+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f01040103f0 con 0x7f00f0003c30 2020-01-26T15:35:37.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.620+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7f010404b830 con 0x7f00f0003c30 2020-01-26T15:35:37.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.620+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c05c510 con 0x7f00f0003c30 2020-01-26T15:35:37.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.624+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f0104030b30 con 0x7f00f0003c30 2020-01-26T15:35:37.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.744+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f010c056600 con 0x7f00f0003c30 2020-01-26T15:35:37.746 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.744+0000 7f0108ff9700 1 -- 172.21.15.170:0/3459928498 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+9078 (unknown 2892004667 0 4239173831) 0x7f0104030d90 con 0x7f00f0003c30 2020-01-26T15:35:37.747 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:37.747 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":33,"fsid":"8497d181-a5c1-4388-9117-8dc8db8c2871","created":"2020-01-26T15:32:02.055148+0000","modified":"2020-01-26T15:35:36.890152+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:32:11.534039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:32:14.037219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:32:14.435582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6fdaa328-9697-4ff6-9ca7-e68075640913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6809","nonce":18374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6810","nonce":18374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6812","nonce":18374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6811","nonce":18374}]},"public_addr":"172.21.15.170:6809/18374","cluster_addr":"172.21.15.170:6810/18374","heartbeat_back_addr":"172.21.15.170:6812/18374","heartbeat_front_addr":"172.21.15.170:6811/18374","state":["exists","up"]},{"osd":1,"uuid":"32b5087d-d77d-4c3d-8736-f4f41237b81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6801","nonce":18293}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6802","nonce":18293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6804","nonce":18293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6803","nonce":18293}]},"public_addr":"172.21.15.170:6801/18293","cluster_addr":"172.21.15.170:6802/18293","heartbeat_back_addr":"172.21.15.170:6804/18293","heartbeat_front_addr":"172.21.15.170:6803/18293","state":["exists","up"]},{"osd":2,"uuid":"f8248e42-e78d-4926-9c81-1a1c4199b946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":26,"up_thru":26,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6813","nonce":18671}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6814","nonce":18671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6816","nonce":18671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6815","nonce":18671}]},"public_addr":"172.21.15.170:6813/18671","cluster_addr":"172.21.15.170:6814/18671","heartbeat_back_addr":"172.21.15.170:6816/18671","heartbeat_front_addr":"172.21.15.170:6815/18671","state":["exists","up"]},{"osd":3,"uuid":"6e582686-4f2c-467b-8c9a-c79a94d3887f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6805","nonce":18499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6806","nonce":18499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6808","nonce":18499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.170:6807","nonce":18499}]},"public_addr":"172.21.15.170:6805/18499","cluster_addr":"172.21.15.170:6806/18499","heartbeat_back_addr":"172.21.15.170:6808/18499","heartbeat_front_addr":"172.21.15.170:6807/18499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:35:19.809376+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.170:6800/11008":"2020-01-27T15:35:10.598343+0000","172.21.15.170:6817/12433226":"2020-01-27T15:35:31.240361+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:35:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 >> v1:172.21.15.170:6800/17396 conn(0x7f00f0048f80 legacy=0x7f00f004b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 >> v1:172.21.15.170:6791/0 conn(0x7f00f0003c30 legacy=0x7f00f00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f0111b2d700 1 -- 172.21.15.170:0/3459928498 reap_dead start 2020-01-26T15:35:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 shutdown_connections 2020-01-26T15:35:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 >> 172.21.15.170:0/3459928498 conn(0x7f010c097b10 msgr2=0x7f010c0a4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 shutdown_connections 2020-01-26T15:35:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.748+0000 7f01108cb700 1 -- 172.21.15.170:0/3459928498 wait complete. 2020-01-26T15:35:37.768 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-26T15:35:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.876+0000 7f4a7ffff700 1 Processor -- start 2020-01-26T15:35:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.876+0000 7f4a7ffff700 1 -- start start 2020-01-26T15:35:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f4a800a6870 0x7f4a8014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8005ea20 con 0x7f4a8005e5f0 2020-01-26T15:35:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a80098000 con 0x7f4a8005edd0 2020-01-26T15:35:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8005e050 con 0x7f4a800a6870 2020-01-26T15:35:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7effd700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4a8005e5f0 0x7f4a80149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51142/0 (socket says 172.21.15.170:51142) 2020-01-26T15:35:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f4a8005edd0 0x7f4a8007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43142/0 (socket says 172.21.15.170:43142) 2020-01-26T15:35:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7effd700 1 -- 172.21.15.170:0/1044533256 learned_addr learned my addr 172.21.15.170:0/1044533256 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a85802700 -1 --2- 172.21.15.170:0/1044533256 >> v2:172.21.15.170:6791/0 conn(0x7f4a800a6870 0x7f4a8014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a85802700 1 --2- 172.21.15.170:0/1044533256 >> v2:172.21.15.170:6791/0 conn(0x7f4a800a6870 0x7f4a8014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566620273 0 0) 0x7f4a8005ea20 con 0x7f4a8005e5f0 2020-01-26T15:35:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c003230 con 0x7f4a8005e5f0 2020-01-26T15:35:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592013371 0 0) 0x7f4a80098000 con 0x7f4a8005edd0 2020-01-26T15:35:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a8005ea20 con 0x7f4a8005edd0 2020-01-26T15:35:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 713013184 0 0) 0x7f4a6c003230 con 0x7f4a8005e5f0 2020-01-26T15:35:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 >> v2:172.21.15.170:6791/0 conn(0x7f4a800a6870 msgr2=0x7f4a8014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 --2- 172.21.15.170:0/1044533256 >> v2:172.21.15.170:6791/0 conn(0x7f4a800a6870 0x7f4a8014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:37.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 >> v1:172.21.15.170:6791/0 conn(0x7f4a8005edd0 legacy=0x7f4a8007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a800a6ca0 con 0x7f4a8005e5f0 2020-01-26T15:35:37.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4a68001710 con 0x7f4a8005e5f0 2020-01-26T15:35:37.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 >> v1:172.21.15.170:6789/0 conn(0x7f4a8005e5f0 legacy=0x7f4a80149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4a6c003230 con 0x7f4a6c00a7f0 2020-01-26T15:35:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4a80098000 con 0x7f4a6c003540 2020-01-26T15:35:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8005e050 con 0x7f4a6c004b20 2020-01-26T15:35:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272919788 0 0) 0x7f4a80098000 con 0x7f4a6c003540 2020-01-26T15:35:37.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c00f720 con 0x7f4a6c003540 2020-01-26T15:35:37.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497405397 0 0) 0x7f4a6c003230 con 0x7f4a6c00a7f0 2020-01-26T15:35:37.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/1044533256 >> v1:172.21.15.170:6791/0 conn(0x7f4a6c003540 legacy=0x7f4a6c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/1044533256 >> v1:172.21.15.170:6790/0 conn(0x7f4a6c00a7f0 legacy=0x7f4a6c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/1044533256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c00f450 con 0x7f4a6c004b20 2020-01-26T15:35:37.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).ready entity=mon.0 client_cookie=260c63ab5695fac1 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:37.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4a70010bf0 con 0x7f4a6c004b20 2020-01-26T15:35:37.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70010df0 con 0x7f4a6c004b20 2020-01-26T15:35:37.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7e7fc700 1 -- 172.21.15.170:0/1044533256 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4a70011270 con 0x7f4a6c004b20 2020-01-26T15:35:37.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 msgr2=0x7f4a6c004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 --2- 172.21.15.170:0/1044533256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c004b20 0x7f4a6c004f50 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f4a70000fc0 tx=0x7f4a7000ff40).stop 2020-01-26T15:35:37.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a85802700 1 -- 172.21.15.170:0/1044533256 reap_dead start 2020-01-26T15:35:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- 172.21.15.170:0/1044533256 shutdown_connections 2020-01-26T15:35:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- 172.21.15.170:0/1044533256 >> 172.21.15.170:0/1044533256 conn(0x7f4a80098e70 msgr2=0x7f4a800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- 172.21.15.170:0/1044533256 shutdown_connections 2020-01-26T15:35:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.880+0000 7f4a7ffff700 1 -- 172.21.15.170:0/1044533256 wait complete. 2020-01-26T15:35:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.884+0000 7f4a7ffff700 1 Processor -- start 2020-01-26T15:35:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.884+0000 7f4a7ffff700 1 -- start start 2020-01-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f4a8009e0e0 0x7f4a80060fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4a80135240 0x7f4a80137680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4a8009d1f0 0x7f4a8012cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51152/0 (socket says 172.21.15.170:51152) 2020-01-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/413926548 learned_addr learned my addr 172.21.15.170:0/413926548 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7effd700 -1 --2- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6791/0 conn(0x7f4a8009e0e0 0x7f4a80060fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8009e510 con 0x7f4a8009d1f0 2020-01-26T15:35:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7effd700 1 --2- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6791/0 conn(0x7f4a8009e0e0 0x7f4a80060fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8009cbf0 con 0x7f4a80135240 2020-01-26T15:35:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8009e840 con 0x7f4a8009e0e0 2020-01-26T15:35:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a85802700 -1 --2- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6790/0 conn(0x7f4a80135240 0x7f4a80137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a85802700 1 --2- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6790/0 conn(0x7f4a80135240 0x7f4a80137680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751155954 0 0) 0x7f4a8009e510 con 0x7f4a8009d1f0 2020-01-26T15:35:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a64003230 con 0x7f4a8009d1f0 2020-01-26T15:35:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 178174509 0 0) 0x7f4a64003230 con 0x7f4a8009d1f0 2020-01-26T15:35:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4a8009e510 con 0x7f4a8009d1f0 2020-01-26T15:35:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4a7000f820 con 0x7f4a8009d1f0 2020-01-26T15:35:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6791/0 conn(0x7f4a8009e0e0 msgr2=0x7f4a80060fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 --2- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6791/0 conn(0x7f4a8009e0e0 0x7f4a80060fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6790/0 conn(0x7f4a80135240 msgr2=0x7f4a80137680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 --2- 172.21.15.170:0/413926548 >> v2:172.21.15.170:6790/0 conn(0x7f4a80135240 0x7f4a80137680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 >> v1:172.21.15.170:6789/0 conn(0x7f4a8009d1f0 legacy=0x7f4a8012cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4a64003230 con 0x7f4a6400a7f0 2020-01-26T15:35:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4a6400f450 con 0x7f4a640045a0 2020-01-26T15:35:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8009cbf0 con 0x7f4a64003a20 2020-01-26T15:35:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547689696 0 0) 0x7f4a64003230 con 0x7f4a6400a7f0 2020-01-26T15:35:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6400e440 con 0x7f4a6400a7f0 2020-01-26T15:35:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538114425 0 0) 0x7f4a6400f450 con 0x7f4a640045a0 2020-01-26T15:35:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a64003230 con 0x7f4a640045a0 2020-01-26T15:35:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/413926548 >> v1:172.21.15.170:6791/0 conn(0x7f4a640045a0 legacy=0x7f4a640049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/413926548 >> v1:172.21.15.170:6790/0 conn(0x7f4a6400a7f0 legacy=0x7f4a6400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 -- 172.21.15.170:0/413926548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8005f060 con 0x7f4a64003a20 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a85802700 1 -- 172.21.15.170:0/413926548 reap_dead start 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8009c6c0 con 0x7f4a64003a20 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4a70004a60 con 0x7f4a64003a20 2020-01-26T15:35:37.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70004c60 con 0x7f4a64003a20 2020-01-26T15:35:37.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80065eb0 con 0x7f4a64003a20 2020-01-26T15:35:37.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4a70009170 con 0x7f4a64003a20 2020-01-26T15:35:37.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.888+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a80056600 con 0x7f4a64003a20 2020-01-26T15:35:37.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f4a700093c0 con 0x7f4a64003a20 2020-01-26T15:35:37.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a7f7fe700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f4a7004dfb0 con 0x7f4a64003a20 2020-01-26T15:35:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6809/18374 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a6404d490 con 0x7f4a64049740 2020-01-26T15:35:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a70052b80 con 0x7f4a64003a20 2020-01-26T15:35:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.892+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== osd.0 v1:172.21.15.170:6809/18374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7f4a6404d490 con 0x7f4a64049740 2020-01-26T15:35:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 --> v1:172.21.15.170:6809/18374 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a800a0cc0 con 0x7f4a64049740 2020-01-26T15:35:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a77fff700 1 -- 172.21.15.170:0/413926548 <== osd.0 v1:172.21.15.170:6809/18374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3404885766) 0x7f4a800a0cc0 con 0x7f4a64049740 2020-01-26T15:35:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 >> v1:172.21.15.170:6809/18374 conn(0x7f4a64049740 legacy=0x7f4a6404bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 >> v1:172.21.15.170:6800/17396 conn(0x7f4a64042d60 legacy=0x7f4a64045270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 msgr2=0x7f4a64003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f4a70000ee0 tx=0x7f4a70011cd0).stop 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 shutdown_connections 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 --2- 172.21.15.170:0/413926548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a64003a20 0x7f4a64003e90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 >> 172.21.15.170:0/413926548 conn(0x7f4a800804b0 msgr2=0x7f4a800a39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 shutdown_connections 2020-01-26T15:35:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:37.912+0000 7f4a7ffff700 1 -- 172.21.15.170:0/413926548 wait complete. 2020-01-26T15:35:37.927 INFO:teuthology.orchestra.run.smithi170.stdout:103079215109 2020-01-26T15:35:37.927 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-26T15:35:38.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 Processor -- start 2020-01-26T15:35:38.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 -- start start 2020-01-26T15:35:38.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7febe405e5f0 0x7febe40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7febe4149040 0x7febe414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40a6dc0 con 0x7febe405edd0 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7febe405ea20 con 0x7febe405e5f0 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7febe4098000 con 0x7febe4149040 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe37fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7febe405edd0 0x7febe407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48044/0 (socket says 172.21.15.170:48044) 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe37fe700 1 -- 172.21.15.170:0/6671188 learned_addr learned my addr 172.21.15.170:0/6671188 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe2ffd700 -1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6790/0 conn(0x7febe405e5f0 0x7febe40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe98b5700 -1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6791/0 conn(0x7febe4149040 0x7febe414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe2ffd700 1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6790/0 conn(0x7febe405e5f0 0x7febe40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe98b5700 1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6791/0 conn(0x7febe4149040 0x7febe414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170989767 0 0) 0x7febe40a6dc0 con 0x7febe405edd0 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd0003230 con 0x7febe405edd0 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2987690170 0 0) 0x7febd0003230 con 0x7febe405edd0 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6791/0 conn(0x7febe4149040 msgr2=0x7febe414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6791/0 conn(0x7febe4149040 0x7febe414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6790/0 conn(0x7febe405e5f0 msgr2=0x7febe40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:38.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6790/0 conn(0x7febe405e5f0 0x7febe40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe405e050 con 0x7febe405edd0 2020-01-26T15:35:38.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7febd4001a90 con 0x7febe405edd0 2020-01-26T15:35:38.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7febd4001e20 con 0x7febe405edd0 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe27fc700 1 -- 172.21.15.170:0/6671188 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7febd4004930 con 0x7febe405edd0 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.036+0000 7febe3fff700 1 -- 172.21.15.170:0/6671188 >> v1:172.21.15.170:6790/0 conn(0x7febe405edd0 legacy=0x7febe407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- 172.21.15.170:0/6671188 shutdown_connections 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6791/0 conn(0x7febe4149040 0x7febe414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 --2- 172.21.15.170:0/6671188 >> v2:172.21.15.170:6790/0 conn(0x7febe405e5f0 0x7febe40a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- 172.21.15.170:0/6671188 >> 172.21.15.170:0/6671188 conn(0x7febe4098e70 msgr2=0x7febe40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- 172.21.15.170:0/6671188 shutdown_connections 2020-01-26T15:35:38.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- 172.21.15.170:0/6671188 wait complete. 2020-01-26T15:35:38.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 Processor -- start 2020-01-26T15:35:38.050 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- start start 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7febe4131cd0 0x7febe4139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe4099a00 con 0x7febe41310a0 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe409a9b0 con 0x7febe409ad30 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7febe41215e0 con 0x7febe4131cd0 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe37fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7febe409ad30 0x7febe409bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43178/0 (socket says 172.21.15.170:43178) 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe37fe700 1 -- 172.21.15.170:0/2915672355 learned_addr learned my addr 172.21.15.170:0/2915672355 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe98b5700 -1 --2- 172.21.15.170:0/2915672355 >> v2:172.21.15.170:6791/0 conn(0x7febe4131cd0 0x7febe4139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe98b5700 1 --2- 172.21.15.170:0/2915672355 >> v2:172.21.15.170:6791/0 conn(0x7febe4131cd0 0x7febe4139800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584530690 0 0) 0x7febe4099a00 con 0x7febe41310a0 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc8003230 con 0x7febe41310a0 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511914858 0 0) 0x7febe409a9b0 con 0x7febe409ad30 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe4099a00 con 0x7febe409ad30 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4169811616 0 0) 0x7febc8003230 con 0x7febe41310a0 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febe409a9b0 con 0x7febe41310a0 2020-01-26T15:35:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7febcc0026f0 con 0x7febe41310a0 2020-01-26T15:35:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3083418487 0 0) 0x7febe4099a00 con 0x7febe409ad30 2020-01-26T15:35:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febc8003230 con 0x7febe409ad30 2020-01-26T15:35:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7febd40017a0 con 0x7febe409ad30 2020-01-26T15:35:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2669459183 0 0) 0x7febe409a9b0 con 0x7febe41310a0 2020-01-26T15:35:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 >> v2:172.21.15.170:6791/0 conn(0x7febe4131cd0 msgr2=0x7febe4139800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:38.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 --2- 172.21.15.170:0/2915672355 >> v2:172.21.15.170:6791/0 conn(0x7febe4131cd0 0x7febe4139800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 >> v1:172.21.15.170:6791/0 conn(0x7febe409ad30 legacy=0x7febe409bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40a1db0 con 0x7febe41310a0 2020-01-26T15:35:38.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.040+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe409c320 con 0x7febe41310a0 2020-01-26T15:35:38.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4025310 con 0x7febe41310a0 2020-01-26T15:35:38.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7febcc000fa0 con 0x7febe41310a0 2020-01-26T15:35:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7febcc001480 con 0x7febe41310a0 2020-01-26T15:35:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7febcc001680 con 0x7febe41310a0 2020-01-26T15:35:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febe405c510 con 0x7febe41310a0 2020-01-26T15:35:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7febcc04b920 con 0x7febe41310a0 2020-01-26T15:35:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6801/18293 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febc8048d40 con 0x7febc8044ff0 2020-01-26T15:35:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (unknown 758375209 0 0) 0x7febcc04be00 con 0x7febe41310a0 2020-01-26T15:35:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.044+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== osd.1 v1:172.21.15.170:6801/18293 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7febc8048d40 con 0x7febc8044ff0 2020-01-26T15:35:38.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 --> v1:172.21.15.170:6801/18293 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febe407f470 con 0x7febc8044ff0 2020-01-26T15:35:38.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febdbfff700 1 -- 172.21.15.170:0/2915672355 <== osd.1 v1:172.21.15.170:6801/18293 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2356506950) 0x7febe407f470 con 0x7febc8044ff0 2020-01-26T15:35:38.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 >> v1:172.21.15.170:6801/18293 conn(0x7febc8044ff0 legacy=0x7febc8047480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 >> v1:172.21.15.170:6800/17396 conn(0x7febc803e4e0 legacy=0x7febc80409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 >> v1:172.21.15.170:6790/0 conn(0x7febe41310a0 legacy=0x7febe41314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe98b5700 1 -- 172.21.15.170:0/2915672355 reap_dead start 2020-01-26T15:35:38.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 shutdown_connections 2020-01-26T15:35:38.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 >> 172.21.15.170:0/2915672355 conn(0x7febe40a67d0 msgr2=0x7febe40a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 shutdown_connections 2020-01-26T15:35:38.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.064+0000 7febe3fff700 1 -- 172.21.15.170:0/2915672355 wait complete. 2020-01-26T15:35:38.078 INFO:teuthology.orchestra.run.smithi170.stdout:94489280517 2020-01-26T15:35:38.078 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-26T15:35:38.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.188+0000 7f81a0d49700 1 Processor -- start 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.188+0000 7f81a0d49700 1 -- start start 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.188+0000 7f81a0d49700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f819c0a6870 0x7f819c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c05ea20 con 0x7f819c05edd0 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c098000 con 0x7f819c05e5f0 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f819c05e050 con 0x7f819c0a6870 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a1fab700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f819c0a6870 0x7f819c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:38.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819bfff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f819c05edd0 0x7f819c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48060/0 (socket says 172.21.15.170:48060) 2020-01-26T15:35:38.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819bfff700 1 -- 172.21.15.170:0/2356599440 learned_addr learned my addr 172.21.15.170:0/2356599440 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a1fab700 1 --2- 172.21.15.170:0/2356599440 >> v2:172.21.15.170:6790/0 conn(0x7f819c0a6870 0x7f819c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567017672 0 0) 0x7f819c05ea20 con 0x7f819c05edd0 2020-01-26T15:35:38.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8188003230 con 0x7f819c05edd0 2020-01-26T15:35:38.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779458080 0 0) 0x7f819c098000 con 0x7f819c05e5f0 2020-01-26T15:35:38.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f819c05ea20 con 0x7f819c05e5f0 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 191052693 0 0) 0x7f8188003230 con 0x7f819c05edd0 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 >> v2:172.21.15.170:6790/0 conn(0x7f819c0a6870 msgr2=0x7f819c14c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 --2- 172.21.15.170:0/2356599440 >> v2:172.21.15.170:6790/0 conn(0x7f819c0a6870 0x7f819c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 >> v1:172.21.15.170:6791/0 conn(0x7f819c05e5f0 legacy=0x7f819c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0a6ca0 con 0x7f819c05edd0 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8194001710 con 0x7f819c05edd0 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8194001960 con 0x7f819c05edd0 2020-01-26T15:35:38.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- 172.21.15.170:0/2356599440 >> v1:172.21.15.170:6790/0 conn(0x7f819c05edd0 legacy=0x7f819c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f819affd700 1 -- 172.21.15.170:0/2356599440 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f81940045b0 con 0x7f819c05edd0 2020-01-26T15:35:38.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- 172.21.15.170:0/2356599440 shutdown_connections 2020-01-26T15:35:38.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 --2- 172.21.15.170:0/2356599440 >> v2:172.21.15.170:6790/0 conn(0x7f819c0a6870 0x7f819c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- 172.21.15.170:0/2356599440 >> 172.21.15.170:0/2356599440 conn(0x7f819c098e70 msgr2=0x7f819c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- 172.21.15.170:0/2356599440 shutdown_connections 2020-01-26T15:35:38.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- 172.21.15.170:0/2356599440 wait complete. 2020-01-26T15:35:38.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 Processor -- start 2020-01-26T15:35:38.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.192+0000 7f81a0d49700 1 -- start start 2020-01-26T15:35:38.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f819c12dbb0 0x7f819c0a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.205 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c09ee70 con 0x7f819c1365b0 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c09f4e0 con 0x7f819c0a08a0 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f819c1232a0 con 0x7f819c12dbb0 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819bfff700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f819c12dbb0 0x7f819c0a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f819c0a08a0 0x7f819c0799b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48066/0 (socket says 172.21.15.170:48066) 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 -- 172.21.15.170:0/3731388831 learned_addr learned my addr 172.21.15.170:0/3731388831 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819bfff700 1 --2- 172.21.15.170:0/3731388831 >> v2:172.21.15.170:6791/0 conn(0x7f819c12dbb0 0x7f819c0a0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325443943 0 0) 0x7f819c09f4e0 con 0x7f819c0a08a0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8180003230 con 0x7f819c0a08a0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588041737 0 0) 0x7f819c09ee70 con 0x7f819c1365b0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f819c09f4e0 con 0x7f819c1365b0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 814155859 0 0) 0x7f819c09f4e0 con 0x7f819c1365b0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f819c09ee70 con 0x7f819c1365b0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f818c001620 con 0x7f819c1365b0 2020-01-26T15:35:38.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 >> v2:172.21.15.170:6791/0 conn(0x7f819c12dbb0 msgr2=0x7f819c0a0190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 --2- 172.21.15.170:0/3731388831 >> v2:172.21.15.170:6791/0 conn(0x7f819c12dbb0 0x7f819c0a0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 >> v1:172.21.15.170:6790/0 conn(0x7f819c0a08a0 legacy=0x7f819c0799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 >> v1:172.21.15.170:6789/0 conn(0x7f819c1365b0 legacy=0x7f819c1389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8180003230 con 0x7f818000a7f0 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f819c09f4e0 con 0x7f8180004cc0 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c1232a0 con 0x7f8180005120 2020-01-26T15:35:38.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650778295 0 0) 0x7f819c09f4e0 con 0x7f8180004cc0 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f818000e440 con 0x7f8180004cc0 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671268773 0 0) 0x7f8180003230 con 0x7f818000a7f0 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 -- 172.21.15.170:0/3731388831 >> v1:172.21.15.170:6791/0 conn(0x7f8180004cc0 legacy=0x7f8180003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 -- 172.21.15.170:0/3731388831 >> v1:172.21.15.170:6790/0 conn(0x7f818000a7f0 legacy=0x7f818000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 -- 172.21.15.170:0/3731388831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0a0cd0 con 0x7f8180005120 2020-01-26T15:35:38.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c11e300 con 0x7f8180005120 2020-01-26T15:35:38.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c0a08a0 con 0x7f8180005120 2020-01-26T15:35:38.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:38.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8184012480 con 0x7f8180005120 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184012680 con 0x7f8180005120 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8184012a60 con 0x7f8180005120 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81740035b0 con 0x7f8180005120 2020-01-26T15:35:38.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.196+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8184008250 con 0x7f8180005120 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f819b7fe700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f818404e4b0 con 0x7f8180005120 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6813/18671 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8180052980 con 0x7f818004ec30 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f818404e8c0 con 0x7f8180005120 2020-01-26T15:35:38.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.200+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== osd.2 v1:172.21.15.170:6813/18671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7f8180052980 con 0x7f818004ec30 2020-01-26T15:35:38.228 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 --> v1:172.21.15.170:6813/18671 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81740026e0 con 0x7f818004ec30 2020-01-26T15:35:38.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f8198ff9700 1 -- 172.21.15.170:0/3731388831 <== osd.2 v1:172.21.15.170:6813/18671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2387057154) 0x7f81740026e0 con 0x7f818004ec30 2020-01-26T15:35:38.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 >> v1:172.21.15.170:6813/18671 conn(0x7f818004ec30 legacy=0x7f81800510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a1fab700 1 -- 172.21.15.170:0/3731388831 reap_dead start 2020-01-26T15:35:38.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 >> v1:172.21.15.170:6800/17396 conn(0x7f8180048200 legacy=0x7f818004a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 msgr2=0x7f8180003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f8184001490 tx=0x7f81840118d0).stop 2020-01-26T15:35:38.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 shutdown_connections 2020-01-26T15:35:38.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 --2- 172.21.15.170:0/3731388831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8180005120 0x7f8180003da0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 >> 172.21.15.170:0/3731388831 conn(0x7f819c0a67d0 msgr2=0x7f819c097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 shutdown_connections 2020-01-26T15:35:38.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.220+0000 7f81a0d49700 1 -- 172.21.15.170:0/3731388831 wait complete. 2020-01-26T15:35:38.235 INFO:teuthology.orchestra.run.smithi170.stdout:111669149701 2020-01-26T15:35:38.235 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-26T15:35:38.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 Processor -- start 2020-01-26T15:35:38.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- start start 2020-01-26T15:35:38.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b0805e5f0 0x7f6b080a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080a6dc0 con 0x7f6b0805edd0 2020-01-26T15:35:38.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0805ea20 con 0x7f6b08149040 2020-01-26T15:35:38.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6b08098000 con 0x7f6b0805e5f0 2020-01-26T15:35:38.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b06ffd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b0805e5f0 0x7f6b080a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b077fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f6b0805edd0 0x7f6b0807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48082/0 (socket says 172.21.15.170:48082) 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b077fe700 1 -- 172.21.15.170:0/1291088465 learned_addr learned my addr 172.21.15.170:0/1291088465 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b0d380700 1 --1- 172.21.15.170:0/1291088465 >> v1:172.21.15.170:6791/0 conn(0x7f6b08149040 0x7f6b0814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43212/0 (socket says 172.21.15.170:43212) 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b06ffd700 1 --2- 172.21.15.170:0/1291088465 >> v2:172.21.15.170:6791/0 conn(0x7f6b0805e5f0 0x7f6b080a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375301094 0 0) 0x7f6b0805ea20 con 0x7f6b08149040 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af4003230 con 0x7f6b08149040 2020-01-26T15:35:38.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041439997 0 0) 0x7f6b080a6dc0 con 0x7f6b0805edd0 2020-01-26T15:35:38.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b0805ea20 con 0x7f6b0805edd0 2020-01-26T15:35:38.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3429979645 0 0) 0x7f6af4003230 con 0x7f6b08149040 2020-01-26T15:35:38.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 >> v2:172.21.15.170:6791/0 conn(0x7f6b0805e5f0 msgr2=0x7f6b080a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:38.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 --2- 172.21.15.170:0/1291088465 >> v2:172.21.15.170:6791/0 conn(0x7f6b0805e5f0 0x7f6b080a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 >> v1:172.21.15.170:6790/0 conn(0x7f6b0805edd0 legacy=0x7f6b0807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0805e050 con 0x7f6b08149040 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b00001a90 con 0x7f6b08149040 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6b00001d60 con 0x7f6b08149040 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b067fc700 1 -- 172.21.15.170:0/1291088465 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b00004870 con 0x7f6b08149040 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- 172.21.15.170:0/1291088465 >> v1:172.21.15.170:6791/0 conn(0x7f6b08149040 legacy=0x7f6b0814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- 172.21.15.170:0/1291088465 shutdown_connections 2020-01-26T15:35:38.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 --2- 172.21.15.170:0/1291088465 >> v2:172.21.15.170:6791/0 conn(0x7f6b0805e5f0 0x7f6b080a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- 172.21.15.170:0/1291088465 >> 172.21.15.170:0/1291088465 conn(0x7f6b08098e70 msgr2=0x7f6b080a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- 172.21.15.170:0/1291088465 shutdown_connections 2020-01-26T15:35:38.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.348+0000 7f6b07fff700 1 -- 172.21.15.170:0/1291088465 wait complete. 2020-01-26T15:35:38.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 Processor -- start 2020-01-26T15:35:38.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 -- start start 2020-01-26T15:35:38.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6b0806f910 0x7f6b080a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b0806fd40 0x7f6b080a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080a3440 con 0x7f6b080a2060 2020-01-26T15:35:38.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6b08122cf0 con 0x7f6b0806f910 2020-01-26T15:35:38.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b07fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6b08070250 con 0x7f6b0806fd40 2020-01-26T15:35:38.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b06ffd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b0806fd40 0x7f6b080a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b077fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6b0806f910 0x7f6b080a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:38.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b06ffd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b0806fd40 0x7f6b080a1630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b077fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6b0806f910 0x7f6b080a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.365 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b0d380700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f6b080a2060 0x7f6b080a2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51214/0 (socket says 172.21.15.170:51214) 2020-01-26T15:35:38.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.352+0000 7f6b0d380700 1 -- 172.21.15.170:0/573286527 learned_addr learned my addr 172.21.15.170:0/573286527 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842843130 0 0) 0x7f6b080a3440 con 0x7f6b080a2060 2020-01-26T15:35:38.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec003230 con 0x7f6b080a2060 2020-01-26T15:35:38.366 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1873408135 0 0) 0x7f6aec003230 con 0x7f6b080a2060 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b080a3440 con 0x7f6b080a2060 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b000017a0 con 0x7f6b080a2060 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 >> v2:172.21.15.170:6791/0 conn(0x7f6b0806fd40 msgr2=0x7f6b080a1630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 --2- 172.21.15.170:0/573286527 >> v2:172.21.15.170:6791/0 conn(0x7f6b0806fd40 0x7f6b080a1630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 >> v2:172.21.15.170:6790/0 conn(0x7f6b0806f910 msgr2=0x7f6b080a10e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 --2- 172.21.15.170:0/573286527 >> v2:172.21.15.170:6790/0 conn(0x7f6b0806f910 0x7f6b080a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.367 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 >> v1:172.21.15.170:6789/0 conn(0x7f6b080a2060 legacy=0x7f6b080a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6aec003230 con 0x7f6aec0045a0 2020-01-26T15:35:38.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6aec00f450 con 0x7f6aec00a7f0 2020-01-26T15:35:38.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08122cf0 con 0x7f6aec003aa0 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489680025 0 0) 0x7f6aec00f450 con 0x7f6aec00a7f0 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec00e440 con 0x7f6aec00a7f0 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525084022 0 0) 0x7f6aec003230 con 0x7f6aec0045a0 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec00f450 con 0x7f6aec0045a0 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 -- 172.21.15.170:0/573286527 >> v1:172.21.15.170:6791/0 conn(0x7f6aec00a7f0 legacy=0x7f6aec00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 -- 172.21.15.170:0/573286527 >> v1:172.21.15.170:6790/0 conn(0x7f6aec0045a0 legacy=0x7f6aec0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b0d380700 1 -- 172.21.15.170:0/573286527 reap_dead start 2020-01-26T15:35:38.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 -- 172.21.15.170:0/573286527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b081226d0 con 0x7f6aec003aa0 2020-01-26T15:35:38.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0806f910 con 0x7f6aec003aa0 2020-01-26T15:35:38.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0806fe00 con 0x7f6aec003aa0 2020-01-26T15:35:38.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.371 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:38.371 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.371 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6af8007330 con 0x7f6aec003aa0 2020-01-26T15:35:38.371 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8007530 con 0x7f6aec003aa0 2020-01-26T15:35:38.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6af80078f0 con 0x7f6aec003aa0 2020-01-26T15:35:38.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ae00035b0 con 0x7f6aec003aa0 2020-01-26T15:35:38.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.356+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f6af8007c00 con 0x7f6aec003aa0 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6b077fe700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f6af804cff0 con 0x7f6aec003aa0 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6805/18499 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6aec04b3b0 con 0x7f6aec047660 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6af804d400 con 0x7f6aec003aa0 2020-01-26T15:35:38.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.360+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== osd.3 v1:172.21.15.170:6805/18499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7f6aec04b3b0 con 0x7f6aec047660 2020-01-26T15:35:38.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 --> v1:172.21.15.170:6805/18499 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ae0002720 con 0x7f6aec047660 2020-01-26T15:35:38.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6afffff700 1 -- 172.21.15.170:0/573286527 <== osd.3 v1:172.21.15.170:6805/18499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3588811899) 0x7f6ae0002720 con 0x7f6aec047660 2020-01-26T15:35:38.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 >> v1:172.21.15.170:6805/18499 conn(0x7f6aec047660 legacy=0x7f6aec049af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 >> v1:172.21.15.170:6800/17396 conn(0x7f6aec040c30 legacy=0x7f6aec043140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 msgr2=0x7f6aec003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f6af8000e90 tx=0x7f6af80109c0).stop 2020-01-26T15:35:38.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 shutdown_connections 2020-01-26T15:35:38.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 --2- 172.21.15.170:0/573286527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec003aa0 0x7f6aec003f10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 >> 172.21.15.170:0/573286527 conn(0x7f6b08097b60 msgr2=0x7f6b080a4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 shutdown_connections 2020-01-26T15:35:38.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.384+0000 7f6b07fff700 1 -- 172.21.15.170:0/573286527 wait complete. 2020-01-26T15:35:38.400 INFO:teuthology.orchestra.run.smithi170.stdout:107374182405 2020-01-26T15:35:38.400 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:38.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 Processor -- start 2020-01-26T15:35:38.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 -- start start 2020-01-26T15:35:38.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f830805edd0 0x7f830805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f83080a6870 0x7f830807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8308098000 con 0x7f83080804d0 2020-01-26T15:35:38.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f830805e050 con 0x7f830805edd0 2020-01-26T15:35:38.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830c81f700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f83080a6ca0 con 0x7f83080a6870 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f830805edd0 0x7f830805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f8306d9d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f83080a6870 0x7f830807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830d020700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f83080804d0 0x7f83080247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51232/0 (socket says 172.21.15.170:51232) 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f830805edd0 0x7f830805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830d020700 1 -- 172.21.15.170:0/3968721882 learned_addr learned my addr 172.21.15.170:0/3968721882 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f8306d9d700 1 --2- 172.21.15.170:0/3968721882 >> v2:172.21.15.170:6791/0 conn(0x7f83080a6870 0x7f830807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281770526 0 0) 0x7f8308098000 con 0x7f83080804d0 2020-01-26T15:35:38.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f4003230 con 0x7f83080804d0 2020-01-26T15:35:38.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1204039337 0 0) 0x7f82f4003230 con 0x7f83080804d0 2020-01-26T15:35:38.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 >> v2:172.21.15.170:6791/0 conn(0x7f83080a6870 msgr2=0x7f830807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:38.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 --2- 172.21.15.170:0/3968721882 >> v2:172.21.15.170:6791/0 conn(0x7f83080a6870 0x7f830807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 >> v2:172.21.15.170:6790/0 conn(0x7f830805edd0 msgr2=0x7f830805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 --2- 172.21.15.170:0/3968721882 >> v2:172.21.15.170:6790/0 conn(0x7f830805edd0 0x7f830805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8308024fb0 con 0x7f83080804d0 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8300001a90 con 0x7f83080804d0 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 >> v1:172.21.15.170:6789/0 conn(0x7f83080804d0 legacy=0x7f83080247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:38.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f82f4003230 con 0x7f82f40045a0 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8308098000 con 0x7f82f400a7f0 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830805e050 con 0x7f82f4003860 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328287212 0 0) 0x7f8308098000 con 0x7f82f400a7f0 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f400e520 con 0x7f82f400a7f0 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302189879 0 0) 0x7f82f4003230 con 0x7f82f40045a0 2020-01-26T15:35:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8308098000 con 0x7f82f40045a0 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1860423298 0 0) 0x7f82f400e520 con 0x7f82f400a7f0 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 1 -- 172.21.15.170:0/3968721882 >> v1:172.21.15.170:6791/0 conn(0x7f82f400a7f0 legacy=0x7f82f400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 1 -- 172.21.15.170:0/3968721882 >> v1:172.21.15.170:6790/0 conn(0x7f82f40045a0 legacy=0x7f82f40049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 1 -- 172.21.15.170:0/3968721882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f4054470 con 0x7f82f4003860 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830d020700 1 -- 172.21.15.170:0/3968721882 reap_dead start 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.516+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f82f8001110 tx=0x7f82f8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f82f8001110 tx=0x7f82f8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f82f8001110 tx=0x7f82f8001190).ready entity=mon.0 client_cookie=9b2de92b599913cb server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:38.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f82f8001110 tx=0x7f82f8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f82f8001400 con 0x7f82f4003860 2020-01-26T15:35:38.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f82f8001110 tx=0x7f82f8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830759e700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f82f8001110 tx=0x7f82f8001190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:38.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8000f20 con 0x7f82f4003860 2020-01-26T15:35:38.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830659c700 1 -- 172.21.15.170:0/3968721882 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8300004ba0 con 0x7f82f4003860 2020-01-26T15:35:38.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 -- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 msgr2=0x7f82f4003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f82f8001110 tx=0x7f82f8001190).stop 2020-01-26T15:35:38.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 -- 172.21.15.170:0/3968721882 shutdown_connections 2020-01-26T15:35:38.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 --2- 172.21.15.170:0/3968721882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82f4003860 0x7f82f4003cd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 -- 172.21.15.170:0/3968721882 >> 172.21.15.170:0/3968721882 conn(0x7f8308098e70 msgr2=0x7f83080a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 -- 172.21.15.170:0/3968721882 shutdown_connections 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 -- 172.21.15.170:0/3968721882 wait complete. 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 Processor -- start 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.520+0000 7f830c81f700 1 -- start start 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f83080a07e0 0x7f830806fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830809f200 con 0x7f830809fc40 2020-01-26T15:35:38.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8308073060 con 0x7f8308121960 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f830809ed20 con 0x7f83080a07e0 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f8306d9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f830809fc40 0x7f8308072860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48116/0 (socket says 172.21.15.170:48116) 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f8306d9d700 1 -- 172.21.15.170:0/2280308487 learned_addr learned my addr 172.21.15.170:0/2280308487 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830759e700 -1 --2- 172.21.15.170:0/2280308487 >> v2:172.21.15.170:6791/0 conn(0x7f83080a07e0 0x7f830806fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830759e700 1 --2- 172.21.15.170:0/2280308487 >> v2:172.21.15.170:6791/0 conn(0x7f83080a07e0 0x7f830806fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653563141 0 0) 0x7f830809f200 con 0x7f830809fc40 2020-01-26T15:35:38.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ec003230 con 0x7f830809fc40 2020-01-26T15:35:38.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110610900 0 0) 0x7f8308073060 con 0x7f8308121960 2020-01-26T15:35:38.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f830809f200 con 0x7f8308121960 2020-01-26T15:35:38.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 172118942 0 0) 0x7f82ec003230 con 0x7f830809fc40 2020-01-26T15:35:38.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8308073060 con 0x7f830809fc40 2020-01-26T15:35:38.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f82f8001a80 con 0x7f830809fc40 2020-01-26T15:35:38.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3056990217 0 0) 0x7f830809f200 con 0x7f8308121960 2020-01-26T15:35:38.540 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82ec003230 con 0x7f8308121960 2020-01-26T15:35:38.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f83000018e0 con 0x7f8308121960 2020-01-26T15:35:38.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3682903471 0 0) 0x7f8308073060 con 0x7f830809fc40 2020-01-26T15:35:38.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 >> v2:172.21.15.170:6791/0 conn(0x7f83080a07e0 msgr2=0x7f830806fc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:38.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 --2- 172.21.15.170:0/2280308487 >> v2:172.21.15.170:6791/0 conn(0x7f83080a07e0 0x7f830806fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.542 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 >> v1:172.21.15.170:6791/0 conn(0x7f8308121960 legacy=0x7f8308138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.542 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8308121d90 con 0x7f830809fc40 2020-01-26T15:35:38.542 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8308122060 con 0x7f830809fc40 2020-01-26T15:35:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8308139e20 con 0x7f830809fc40 2020-01-26T15:35:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f82f8002100 con 0x7f830809fc40 2020-01-26T15:35:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f82f8002520 con 0x7f830809fc40 2020-01-26T15:35:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e0003360 con 0x7f830809fc40 2020-01-26T15:35:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f82f80027a0 con 0x7f830809fc40 2020-01-26T15:35:38.544 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.524+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7f82f804bcc0 con 0x7f830809fc40 2020-01-26T15:35:38.545 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.532+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f82f8002d10 con 0x7f830809fc40 2020-01-26T15:35:38.653 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82e00021f0 con 0x7f830809fc40 2020-01-26T15:35:38.654 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f82fffff700 1 -- 172.21.15.170:0/2280308487 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (unknown 574334944 0 1579918792) 0x7f82f8031240 con 0x7f830809fc40 2020-01-26T15:35:38.654 INFO:teuthology.orchestra.run.smithi170.stdout:103079215108 2020-01-26T15:35:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 >> v1:172.21.15.170:6800/17396 conn(0x7f82ec03e490 legacy=0x7f82ec0409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 >> v1:172.21.15.170:6790/0 conn(0x7f830809fc40 legacy=0x7f8308072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 shutdown_connections 2020-01-26T15:35:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 --2- 172.21.15.170:0/2280308487 >> v2:172.21.15.170:6791/0 conn(0x7f83080a07e0 0x7f830806fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 >> 172.21.15.170:0/2280308487 conn(0x7f83080a8280 msgr2=0x7f83080a41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 shutdown_connections 2020-01-26T15:35:38.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:38.652+0000 7f830c81f700 1 -- 172.21.15.170:0/2280308487 wait complete. 2020-01-26T15:35:38.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215108 for osd.0 2020-01-26T15:35:39.672 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:35:39.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 Processor -- start 2020-01-26T15:35:39.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 -- start start 2020-01-26T15:35:39.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7faaec05edd0 0x7faaec05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:39.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7faaec149040 0x7faaec14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:39.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec098000 con 0x7faaec0a6870 2020-01-26T15:35:39.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7faaec05e050 con 0x7faaec149040 2020-01-26T15:35:39.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7faaec0a6ca0 con 0x7faaec05edd0 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaeb59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7faaec05edd0 0x7faaec05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaead9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7faaec0a6870 0x7faaec07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48124/0 (socket says 172.21.15.170:48124) 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaead9d700 1 -- 172.21.15.170:0/569177075 learned_addr learned my addr 172.21.15.170:0/569177075 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaeb59e700 1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6791/0 conn(0x7faaec05edd0 0x7faaec05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf1219700 -1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6790/0 conn(0x7faaec149040 0x7faaec14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf1219700 1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6790/0 conn(0x7faaec149040 0x7faaec14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:39.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145920817 0 0) 0x7faaec098000 con 0x7faaec0a6870 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad4003230 con 0x7faaec0a6870 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3991385024 0 0) 0x7faad4003230 con 0x7faaec0a6870 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6791/0 conn(0x7faaec05edd0 msgr2=0x7faaec05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6791/0 conn(0x7faaec05edd0 0x7faaec05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6790/0 conn(0x7faaec149040 msgr2=0x7faaec14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6790/0 conn(0x7faaec149040 0x7faaec14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:39.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec14c9e0 con 0x7faaec0a6870 2020-01-26T15:35:39.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faae0001710 con 0x7faaec0a6870 2020-01-26T15:35:39.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faae0001aa0 con 0x7faaec0a6870 2020-01-26T15:35:39.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaea59c700 1 -- 172.21.15.170:0/569177075 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faae0004760 con 0x7faaec0a6870 2020-01-26T15:35:39.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.792+0000 7faaf0a18700 1 -- 172.21.15.170:0/569177075 >> v1:172.21.15.170:6790/0 conn(0x7faaec0a6870 legacy=0x7faaec07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 -- 172.21.15.170:0/569177075 shutdown_connections 2020-01-26T15:35:39.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6790/0 conn(0x7faaec149040 0x7faaec14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:39.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 --2- 172.21.15.170:0/569177075 >> v2:172.21.15.170:6791/0 conn(0x7faaec05edd0 0x7faaec05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:39.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 -- 172.21.15.170:0/569177075 >> 172.21.15.170:0/569177075 conn(0x7faaec098e70 msgr2=0x7faaec0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:39.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 -- 172.21.15.170:0/569177075 shutdown_connections 2020-01-26T15:35:39.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 -- 172.21.15.170:0/569177075 wait complete. 2020-01-26T15:35:39.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 Processor -- start 2020-01-26T15:35:39.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.796+0000 7faaf0a18700 1 -- start start 2020-01-26T15:35:39.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaf0a18700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec122280 con 0x7faaec136020 2020-01-26T15:35:39.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaf0a18700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec12ca40 con 0x7faaec121e50 2020-01-26T15:35:39.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaf0a18700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0a4d80 con 0x7faaec12c610 2020-01-26T15:35:39.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7faaec121e50 0x7faaec0a2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48130/0 (socket says 172.21.15.170:48130) 2020-01-26T15:35:39.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 -- 172.21.15.170:0/3452659065 learned_addr learned my addr 172.21.15.170:0/3452659065 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:39.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892093464 0 0) 0x7faaec12ca40 con 0x7faaec121e50 2020-01-26T15:35:39.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc003230 con 0x7faaec121e50 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130798342 0 0) 0x7faaec0a4d80 con 0x7faaec12c610 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec12ca40 con 0x7faaec12c610 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706876553 0 0) 0x7faaec122280 con 0x7faaec136020 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec0a4d80 con 0x7faaec136020 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 403044106 0 0) 0x7faacc003230 con 0x7faaec121e50 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faaec122280 con 0x7faaec121e50 2020-01-26T15:35:39.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faadc002780 con 0x7faaec121e50 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2807347210 0 0) 0x7faaec12ca40 con 0x7faaec12c610 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faacc003230 con 0x7faaec12c610 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4228111108 0 0) 0x7faaec0a4d80 con 0x7faaec136020 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faaec12ca40 con 0x7faaec136020 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faae00046a0 con 0x7faaec12c610 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faae4001810 con 0x7faaec136020 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 >> v1:172.21.15.170:6791/0 conn(0x7faaec12c610 legacy=0x7faaec079be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 >> v1:172.21.15.170:6790/0 conn(0x7faaec121e50 legacy=0x7faaec0a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 >> v1:172.21.15.170:6789/0 conn(0x7faaec136020 legacy=0x7faaec138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7faaec0a4d80 con 0x7faacc003ec0 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7faacc00fc50 con 0x7faacc00aff0 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0130a0 con 0x7faacc003540 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:39.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058586796 0 0) 0x7faacc00fc50 con 0x7faacc00aff0 2020-01-26T15:35:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc00ec40 con 0x7faacc00aff0 2020-01-26T15:35:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129614232 0 0) 0x7faaec0a4d80 con 0x7faacc003ec0 2020-01-26T15:35:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc00fc50 con 0x7faacc003ec0 2020-01-26T15:35:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 -- 172.21.15.170:0/3452659065 >> v1:172.21.15.170:6791/0 conn(0x7faacc00aff0 legacy=0x7faacc00d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 -- 172.21.15.170:0/3452659065 >> v1:172.21.15.170:6790/0 conn(0x7faacc003ec0 legacy=0x7faacc0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 -- 172.21.15.170:0/3452659065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7faaec122dc0 con 0x7faacc003540 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec12c610 con 0x7faacc003540 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec122070 con 0x7faacc003540 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7faadc012160 con 0x7faacc003540 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.800+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc012360 con 0x7faacc003540 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.804+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.804+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7faadc012550 con 0x7faacc003540 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.804+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.804+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac4003360 con 0x7faacc003540 2020-01-26T15:35:39.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.804+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7faadc051f20 con 0x7faacc003540 2020-01-26T15:35:39.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.808+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.808+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7faadc0380d0 con 0x7faacc003540 2020-01-26T15:35:39.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faac40021f0 con 0x7faacc003540 2020-01-26T15:35:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaeb59e700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faad3fff700 1 -- 172.21.15.170:0/3452659065 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faadc038330 con 0x7faacc003540 2020-01-26T15:35:39.931 INFO:teuthology.orchestra.run.smithi170.stdout:103079215109 2020-01-26T15:35:39.932 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 >> v1:172.21.15.170:6800/17396 conn(0x7faacc048e20 legacy=0x7faacc04b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.932 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 msgr2=0x7faacc003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:39.932 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 --2- 172.21.15.170:0/3452659065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc003540 0x7faacc003970 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7faadc010ba0 tx=0x7faadc015960).stop 2020-01-26T15:35:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf1219700 1 -- 172.21.15.170:0/3452659065 reap_dead start 2020-01-26T15:35:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 shutdown_connections 2020-01-26T15:35:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 >> 172.21.15.170:0/3452659065 conn(0x7faaec0a5520 msgr2=0x7faaec07f200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 shutdown_connections 2020-01-26T15:35:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:39.928+0000 7faaf0a18700 1 -- 172.21.15.170:0/3452659065 wait complete. 2020-01-26T15:35:39.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215109 for osd.0 2020-01-26T15:35:39.944 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:35:40.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 Processor -- start 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 -- start start 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7faf0c0a5750 0x7faf0c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0a5b80 con 0x7faf0c05f250 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c080440 con 0x7faf0c0a4b50 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0a43f0 con 0x7faf0c0a5750 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf11020700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7faf0c0a5750 0x7faf0c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf1081f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7faf0c0a4b50 0x7faf0c05ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48148/0 (socket says 172.21.15.170:48148) 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf1081f700 1 -- 172.21.15.170:0/3526486787 learned_addr learned my addr 172.21.15.170:0/3526486787 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf11020700 1 --2- 172.21.15.170:0/3526486787 >> v2:172.21.15.170:6791/0 conn(0x7faf0c0a5750 0x7faf0c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916288971 0 0) 0x7faf0c080440 con 0x7faf0c0a4b50 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4003230 con 0x7faf0c0a4b50 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357875895 0 0) 0x7faf0c0a5b80 con 0x7faf0c05f250 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf0c080440 con 0x7faf0c05f250 2020-01-26T15:35:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2617292501 0 0) 0x7faef4003230 con 0x7faf0c0a4b50 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 >> v2:172.21.15.170:6791/0 conn(0x7faf0c0a5750 msgr2=0x7faf0c0a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 --2- 172.21.15.170:0/3526486787 >> v2:172.21.15.170:6791/0 conn(0x7faf0c0a5750 0x7faf0c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 >> v1:172.21.15.170:6789/0 conn(0x7faf0c05f250 legacy=0x7faf0c14bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0a3210 con 0x7faf0c0a4b50 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faf00001710 con 0x7faf0c0a4b50 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faf000019e0 con 0x7faf0c0a4b50 2020-01-26T15:35:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf0bfff700 1 -- 172.21.15.170:0/3526486787 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faf000045b0 con 0x7faf0c0a4b50 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.052+0000 7faf12a83700 1 -- 172.21.15.170:0/3526486787 >> v1:172.21.15.170:6790/0 conn(0x7faf0c0a4b50 legacy=0x7faf0c05ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 -- 172.21.15.170:0/3526486787 shutdown_connections 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 --2- 172.21.15.170:0/3526486787 >> v2:172.21.15.170:6791/0 conn(0x7faf0c0a5750 0x7faf0c0a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 -- 172.21.15.170:0/3526486787 >> 172.21.15.170:0/3526486787 conn(0x7faf0c05e050 msgr2=0x7faf0c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 -- 172.21.15.170:0/3526486787 shutdown_connections 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 -- 172.21.15.170:0/3526486787 wait complete. 2020-01-26T15:35:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 Processor -- start 2020-01-26T15:35:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 -- start start 2020-01-26T15:35:40.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7faf0c1202d0 0x7faf0c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:40.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.056+0000 7faf12a83700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c1214d0 con 0x7faf0c120c50 2020-01-26T15:35:40.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf12a83700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c096a10 con 0x7faf0c0961d0 2020-01-26T15:35:40.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf12a83700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c121080 con 0x7faf0c1202d0 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf11020700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7faf0c0961d0 0x7faf0c061690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43278/0 (socket says 172.21.15.170:43278) 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf11020700 1 -- 172.21.15.170:0/755075212 learned_addr learned my addr 172.21.15.170:0/755075212 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf1081f700 -1 --2- 172.21.15.170:0/755075212 >> v2:172.21.15.170:6791/0 conn(0x7faf0c1202d0 0x7faf0c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf1081f700 1 --2- 172.21.15.170:0/755075212 >> v2:172.21.15.170:6791/0 conn(0x7faf0c1202d0 0x7faf0c120700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291243024 0 0) 0x7faf0c096a10 con 0x7faf0c0961d0 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeec003230 con 0x7faf0c0961d0 2020-01-26T15:35:40.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240719531 0 0) 0x7faf04001260 con 0x7faf0c120c50 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf0c096a10 con 0x7faf0c120c50 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2347809059 0 0) 0x7faeec003230 con 0x7faf0c0961d0 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faf04001260 con 0x7faf0c0961d0 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faefc0027a0 con 0x7faf0c0961d0 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1393525789 0 0) 0x7faf0c096a10 con 0x7faf0c120c50 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faeec003230 con 0x7faf0c120c50 2020-01-26T15:35:40.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faf04001d10 con 0x7faf0c120c50 2020-01-26T15:35:40.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1960225790 0 0) 0x7faf04001260 con 0x7faf0c0961d0 2020-01-26T15:35:40.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 >> v2:172.21.15.170:6791/0 conn(0x7faf0c1202d0 msgr2=0x7faf0c120700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:40.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 --2- 172.21.15.170:0/755075212 >> v2:172.21.15.170:6791/0 conn(0x7faf0c1202d0 0x7faf0c120700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 >> v1:172.21.15.170:6790/0 conn(0x7faf0c120c50 legacy=0x7faf0c138320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c121f00 con 0x7faf0c0961d0 2020-01-26T15:35:40.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c061e90 con 0x7faf0c0961d0 2020-01-26T15:35:40.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c139b30 con 0x7faf0c0961d0 2020-01-26T15:35:40.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faefc000f10 con 0x7faf0c0961d0 2020-01-26T15:35:40.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7faefc0012f0 con 0x7faf0c0961d0 2020-01-26T15:35:40.072 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4003360 con 0x7faf0c0961d0 2020-01-26T15:35:40.072 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.060+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7faefc001570 con 0x7faf0c0961d0 2020-01-26T15:35:40.072 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.064+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7faefc04bad0 con 0x7faf0c0961d0 2020-01-26T15:35:40.072 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.068+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7faefc031050 con 0x7faf0c0961d0 2020-01-26T15:35:40.186 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faee40021f0 con 0x7faf0c0961d0 2020-01-26T15:35:40.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf09ffb700 1 -- 172.21.15.170:0/755075212 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 213165853) 0x7faefc04a7a0 con 0x7faf0c0961d0 2020-01-26T15:35:40.187 INFO:teuthology.orchestra.run.smithi170.stdout:94489280517 2020-01-26T15:35:40.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 >> v1:172.21.15.170:6800/17396 conn(0x7faeec03e470 legacy=0x7faeec040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 >> v1:172.21.15.170:6791/0 conn(0x7faf0c0961d0 legacy=0x7faf0c061690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 shutdown_connections 2020-01-26T15:35:40.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 --2- 172.21.15.170:0/755075212 >> v2:172.21.15.170:6791/0 conn(0x7faf0c1202d0 0x7faf0c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 >> 172.21.15.170:0/755075212 conn(0x7faf0c05b370 msgr2=0x7faf0c1229e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 shutdown_connections 2020-01-26T15:35:40.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.184+0000 7faf12a83700 1 -- 172.21.15.170:0/755075212 wait complete. 2020-01-26T15:35:40.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.1 2020-01-26T15:35:40.199 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-26T15:35:40.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.308+0000 7f8c7759e700 1 Processor -- start 2020-01-26T15:35:40.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.308+0000 7f8c7759e700 1 -- start start 2020-01-26T15:35:40.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.308+0000 7f8c7759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8c780a6870 0x7f8c7814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.308+0000 7f8c7759e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7805ea20 con 0x7f8c7805e5f0 2020-01-26T15:35:40.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.308+0000 7f8c7759e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c78098000 con 0x7f8c7805edd0 2020-01-26T15:35:40.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.308+0000 7f8c7759e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7805e050 con 0x7f8c780a6870 2020-01-26T15:35:40.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7c9d1700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8c780a6870 0x7f8c7814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7c9d1700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8c780a6870 0x7f8c7814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8c7805e5f0 0x7f8c78149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51284/0 (socket says 172.21.15.170:51284) 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 -- 172.21.15.170:0/2753167267 learned_addr learned my addr 172.21.15.170:0/2753167267 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c76d9d700 1 --1- 172.21.15.170:0/2753167267 >> v1:172.21.15.170:6791/0 conn(0x7f8c7805edd0 0x7f8c7807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43286/0 (socket says 172.21.15.170:43286) 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006218303 0 0) 0x7f8c7805ea20 con 0x7f8c7805e5f0 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c60003230 con 0x7f8c7805e5f0 2020-01-26T15:35:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208430783 0 0) 0x7f8c78098000 con 0x7f8c7805edd0 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c7805ea20 con 0x7f8c7805edd0 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 373407858 0 0) 0x7f8c60003230 con 0x7f8c7805e5f0 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 >> v2:172.21.15.170:6790/0 conn(0x7f8c780a6870 msgr2=0x7f8c7814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 --2- 172.21.15.170:0/2753167267 >> v2:172.21.15.170:6790/0 conn(0x7f8c780a6870 0x7f8c7814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 >> v1:172.21.15.170:6791/0 conn(0x7f8c7805edd0 legacy=0x7f8c7807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780a6ca0 con 0x7f8c7805e5f0 2020-01-26T15:35:40.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8c6c001710 con 0x7f8c7805e5f0 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 >> v1:172.21.15.170:6789/0 conn(0x7f8c7805e5f0 legacy=0x7f8c78149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8c60003230 con 0x7f8c60003ac0 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8c78098000 con 0x7f8c6000a7f0 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7805e050 con 0x7f8c60003f30 2020-01-26T15:35:40.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999555751 0 0) 0x7f8c60003230 con 0x7f8c60003ac0 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6000e440 con 0x7f8c60003ac0 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748925735 0 0) 0x7f8c78098000 con 0x7f8c6000a7f0 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c60003230 con 0x7f8c6000a7f0 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3351708013 0 0) 0x7f8c60003230 con 0x7f8c6000a7f0 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 -- 172.21.15.170:0/2753167267 >> v1:172.21.15.170:6791/0 conn(0x7f8c6000a7f0 legacy=0x7f8c6000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 -- 172.21.15.170:0/2753167267 >> v1:172.21.15.170:6790/0 conn(0x7f8c60003ac0 legacy=0x7f8c600045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 -- 172.21.15.170:0/2753167267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60010570 con 0x7f8c60003f30 2020-01-26T15:35:40.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8c680012b0 tx=0x7f8c68001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8c680012b0 tx=0x7f8c68001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f8c680012b0 tx=0x7f8c68001840).ready entity=mon.0 client_cookie=626a2c3e4756311d server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:40.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8c680012b0 tx=0x7f8c68001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8c68001ab0 con 0x7f8c60003f30 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8c680012b0 tx=0x7f8c68001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f8c680012b0 tx=0x7f8c68001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68001610 con 0x7f8c60003f30 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c75d9b700 1 -- 172.21.15.170:0/2753167267 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8c70001490 con 0x7f8c60003f30 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7759e700 1 -- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 msgr2=0x7f8c60004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7759e700 1 --2- 172.21.15.170:0/2753167267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c60003f30 0x7f8c60004da0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f8c680012b0 tx=0x7f8c68001840).stop 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7c9d1700 1 -- 172.21.15.170:0/2753167267 reap_dead start 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7759e700 1 -- 172.21.15.170:0/2753167267 shutdown_connections 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7759e700 1 -- 172.21.15.170:0/2753167267 >> 172.21.15.170:0/2753167267 conn(0x7f8c78098e70 msgr2=0x7f8c780a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7759e700 1 -- 172.21.15.170:0/2753167267 shutdown_connections 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.312+0000 7f8c7759e700 1 -- 172.21.15.170:0/2753167267 wait complete. 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7759e700 1 Processor -- start 2020-01-26T15:35:40.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7759e700 1 -- start start 2020-01-26T15:35:40.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8c7811f300 0x7f8c7809ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:40.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7759e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7807d7c0 con 0x7f8c781383b0 2020-01-26T15:35:40.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7759e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780a3520 con 0x7f8c780a1170 2020-01-26T15:35:40.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7759e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7809e460 con 0x7f8c7811f300 2020-01-26T15:35:40.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c76d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f8c780a1170 0x7f8c7807cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43298/0 (socket says 172.21.15.170:43298) 2020-01-26T15:35:40.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c76d9d700 1 -- 172.21.15.170:0/2801869462 learned_addr learned my addr 172.21.15.170:0/2801869462 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7659c700 -1 --2- 172.21.15.170:0/2801869462 >> v2:172.21.15.170:6790/0 conn(0x7f8c7811f300 0x7f8c7809ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c7659c700 1 --2- 172.21.15.170:0/2801869462 >> v2:172.21.15.170:6790/0 conn(0x7f8c7811f300 0x7f8c7809ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602270099 0 0) 0x7f8c780a3520 con 0x7f8c780a1170 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c5c003230 con 0x7f8c780a1170 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988595175 0 0) 0x7f8c7807d7c0 con 0x7f8c781383b0 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c780a3520 con 0x7f8c781383b0 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2330964855 0 0) 0x7f8c5c003230 con 0x7f8c780a1170 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c7807d7c0 con 0x7f8c780a1170 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8c68004870 con 0x7f8c780a1170 2020-01-26T15:35:40.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3102787365 0 0) 0x7f8c780a3520 con 0x7f8c781383b0 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c5c003230 con 0x7f8c781383b0 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8c70001770 con 0x7f8c781383b0 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 >> v2:172.21.15.170:6790/0 conn(0x7f8c7811f300 msgr2=0x7f8c7809ecb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 --2- 172.21.15.170:0/2801869462 >> v2:172.21.15.170:6790/0 conn(0x7f8c7811f300 0x7f8c7809ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 >> v1:172.21.15.170:6791/0 conn(0x7f8c780a1170 legacy=0x7f8c7807cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 >> v1:172.21.15.170:6789/0 conn(0x7f8c781383b0 legacy=0x7f8c7813a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:40.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8c780a3520 con 0x7f8c5c004f20 2020-01-26T15:35:40.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8c5c00f820 con 0x7f8c5c004af0 2020-01-26T15:35:40.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7809e460 con 0x7f8c5c003ec0 2020-01-26T15:35:40.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:40.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573113085 0 0) 0x7f8c780a3520 con 0x7f8c5c004f20 2020-01-26T15:35:40.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.316+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c5c00e810 con 0x7f8c5c004f20 2020-01-26T15:35:40.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 -- 172.21.15.170:0/2801869462 >> v1:172.21.15.170:6791/0 conn(0x7f8c5c004af0 legacy=0x7f8c5c0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 -- 172.21.15.170:0/2801869462 >> v1:172.21.15.170:6790/0 conn(0x7f8c5c004f20 legacy=0x7f8c5c00d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 -- 172.21.15.170:0/2801869462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f8c7809df30 con 0x7f8c5c003ec0 2020-01-26T15:35:40.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780a1170 con 0x7f8c5c003ec0 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7807cfc0 con 0x7f8c5c003ec0 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8c6800a170 con 0x7f8c5c003ec0 2020-01-26T15:35:40.335 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800a370 con 0x7f8c5c003ec0 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78122d10 con 0x7f8c5c003ec0 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8c6800a560 con 0x7f8c5c003ec0 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.320+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f8c6804dce0 con 0x7f8c5c003ec0 2020-01-26T15:35:40.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.324+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.337 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.324+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8c68033e30 con 0x7f8c5c003ec0 2020-01-26T15:35:40.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c78056600 con 0x7f8c5c003ec0 2020-01-26T15:35:40.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c76d9d700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c677fe700 1 -- 172.21.15.170:0/2801869462 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c68034090 con 0x7f8c5c003ec0 2020-01-26T15:35:40.446 INFO:teuthology.orchestra.run.smithi170.stdout:111669149701 2020-01-26T15:35:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 >> v1:172.21.15.170:6800/17396 conn(0x7f8c5c0487e0 legacy=0x7f8c5c04acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 msgr2=0x7f8c5c0045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f8c68001380 tx=0x7f8c68011b40).stop 2020-01-26T15:35:40.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7c9d1700 1 -- 172.21.15.170:0/2801869462 reap_dead start 2020-01-26T15:35:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 shutdown_connections 2020-01-26T15:35:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 --2- 172.21.15.170:0/2801869462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c5c003ec0 0x7f8c5c0045a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 >> 172.21.15.170:0/2801869462 conn(0x7f8c7805e5f0 msgr2=0x7f8c7807f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 shutdown_connections 2020-01-26T15:35:40.451 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.444+0000 7f8c7759e700 1 -- 172.21.15.170:0/2801869462 wait complete. 2020-01-26T15:35:40.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149701 got 111669149701 for osd.2 2020-01-26T15:35:40.462 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-26T15:35:40.585 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 Processor -- start 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- start start 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc146c30 0x7f07dc149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc0a5b80 con 0x7f07dc0a5750 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc080440 con 0x7f07dc1495c0 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc0a43f0 con 0x7f07dc146c30 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc146c30 0x7f07dc149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e241f700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f07dc0a5750 0x7f07dc0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51310/0 (socket says 172.21.15.170:51310) 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc146c30 0x7f07dc149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e241f700 1 -- 172.21.15.170:0/394670023 learned_addr learned my addr 172.21.15.170:0/394670023 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e2c20700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f07dc1495c0 0x7f07dc14ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43316/0 (socket says 172.21.15.170:43316) 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290703679 0 0) 0x7f07dc0a5b80 con 0x7f07dc0a5750 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c8003230 con 0x7f07dc0a5750 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092286441 0 0) 0x7f07dc080440 con 0x7f07dc1495c0 2020-01-26T15:35:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc0a5b80 con 0x7f07dc1495c0 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3045826413 0 0) 0x7f07c8003230 con 0x7f07dc0a5750 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 >> v2:172.21.15.170:6790/0 conn(0x7f07dc146c30 msgr2=0x7f07dc149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 --2- 172.21.15.170:0/394670023 >> v2:172.21.15.170:6790/0 conn(0x7f07dc146c30 0x7f07dc149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 >> v1:172.21.15.170:6791/0 conn(0x7f07dc1495c0 legacy=0x7f07dc14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0a4e00 con 0x7f07dc0a5750 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f07cc001a90 con 0x7f07dc0a5750 2020-01-26T15:35:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 >> v1:172.21.15.170:6789/0 conn(0x7f07dc0a5750 legacy=0x7f07dc0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f07c8003230 con 0x7f07c8004af0 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f07dc080440 con 0x7f07c800a7f0 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc0a43f0 con 0x7f07c8004f60 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541106844 0 0) 0x7f07dc080440 con 0x7f07c800a7f0 2020-01-26T15:35:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c800e440 con 0x7f07c800a7f0 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 -- 172.21.15.170:0/394670023 >> v1:172.21.15.170:6791/0 conn(0x7f07c800a7f0 legacy=0x7f07c800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 -- 172.21.15.170:0/394670023 >> v1:172.21.15.170:6790/0 conn(0x7f07c8004af0 legacy=0x7f07c8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 -- 172.21.15.170:0/394670023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8054530 con 0x7f07c8004f60 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07c4002f30 tx=0x7f07c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07c4002f30 tx=0x7f07c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f07c4002f30 tx=0x7f07c400fe60).ready entity=mon.0 client_cookie=7f31b0e531e45d8e server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f07c4002f30 tx=0x7f07c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f07c4008c60 con 0x7f07c8004f60 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f07c4002f30 tx=0x7f07c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e1c1e700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f07c4002f30 tx=0x7f07c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c4005780 con 0x7f07c8004f60 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e141d700 1 -- 172.21.15.170:0/394670023 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f07c4005b20 con 0x7f07c8004f60 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 msgr2=0x7f07c8003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 --2- 172.21.15.170:0/394670023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c8004f60 0x7f07c8003d40 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f07c4002f30 tx=0x7f07c400fe60).stop 2020-01-26T15:35:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e2c20700 1 -- 172.21.15.170:0/394670023 reap_dead start 2020-01-26T15:35:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- 172.21.15.170:0/394670023 shutdown_connections 2020-01-26T15:35:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- 172.21.15.170:0/394670023 >> 172.21.15.170:0/394670023 conn(0x7f07dc05e050 msgr2=0x7f07dc098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- 172.21.15.170:0/394670023 shutdown_connections 2020-01-26T15:35:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.580+0000 7f07e3e82700 1 -- 172.21.15.170:0/394670023 wait complete. 2020-01-26T15:35:40.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e3e82700 1 Processor -- start 2020-01-26T15:35:40.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e3e82700 1 -- start start 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e3e82700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc11eae0 0x7f07dc11cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e3e82700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc07f050 con 0x7f07dc11d450 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e3e82700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc139400 con 0x7f07dc12d780 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e3e82700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc07e180 con 0x7f07dc11eae0 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e2c20700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc11eae0 0x7f07dc11cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e2c20700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f07dc11eae0 0x7f07dc11cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e241f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f07dc11d450 0x7f07dc12cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48198/0 (socket says 172.21.15.170:48198) 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07e241f700 1 -- 172.21.15.170:0/143381016 learned_addr learned my addr 172.21.15.170:0/143381016 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720571892 0 0) 0x7f07dc139400 con 0x7f07dc12d780 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c0003230 con 0x7f07dc12d780 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428662660 0 0) 0x7f07dc07f050 con 0x7f07dc11d450 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc139400 con 0x7f07dc11d450 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 432700381 0 0) 0x7f07c0003230 con 0x7f07dc12d780 2020-01-26T15:35:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07dc07f050 con 0x7f07dc12d780 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.584+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f07c4005dc0 con 0x7f07dc12d780 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3229929500 0 0) 0x7f07dc139400 con 0x7f07dc11d450 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07c0003230 con 0x7f07dc11d450 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f07cc001990 con 0x7f07dc11d450 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 220943960 0 0) 0x7f07dc07f050 con 0x7f07dc12d780 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 >> v2:172.21.15.170:6790/0 conn(0x7f07dc11eae0 msgr2=0x7f07dc11cbb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 --2- 172.21.15.170:0/143381016 >> v2:172.21.15.170:6790/0 conn(0x7f07dc11eae0 0x7f07dc11cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 >> v1:172.21.15.170:6790/0 conn(0x7f07dc11d450 legacy=0x7f07dc12cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc095e90 con 0x7f07dc12d780 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc096160 con 0x7f07dc12d780 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc0966b0 con 0x7f07dc12d780 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f07c4008680 con 0x7f07dc12d780 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f07c4005b30 con 0x7f07dc12d780 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f07c4010730 con 0x7f07dc12d780 2020-01-26T15:35:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7f07c404cc30 con 0x7f07dc12d780 2020-01-26T15:35:40.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.588+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc056600 con 0x7f07dc12d780 2020-01-26T15:35:40.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.596+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f07c4032070 con 0x7f07dc12d780 2020-01-26T15:35:40.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.712+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07dc096d20 con 0x7f07dc12d780 2020-01-26T15:35:40.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.712+0000 7f07daffd700 1 -- 172.21.15.170:0/143381016 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (unknown 383520633 0 2200322018) 0x7f07c40322d0 con 0x7f07dc12d780 2020-01-26T15:35:40.717 INFO:teuthology.orchestra.run.smithi170.stdout:107374182405 2020-01-26T15:35:40.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 >> v1:172.21.15.170:6800/17396 conn(0x7f07c003e490 legacy=0x7f07c00409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 >> v1:172.21.15.170:6791/0 conn(0x7f07dc12d780 legacy=0x7f07dc11e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 shutdown_connections 2020-01-26T15:35:40.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 --2- 172.21.15.170:0/143381016 >> v2:172.21.15.170:6790/0 conn(0x7f07dc11eae0 0x7f07dc11cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 >> 172.21.15.170:0/143381016 conn(0x7f07dc0a3750 msgr2=0x7f07dc05ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 shutdown_connections 2020-01-26T15:35:40.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.716+0000 7f07e3e82700 1 -- 172.21.15.170:0/143381016 wait complete. 2020-01-26T15:35:40.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182405 for osd.3 2020-01-26T15:35:40.741 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-26T15:35:40.741 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf37bb700 1 Processor -- start 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf37bb700 1 -- start start 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf37bb700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4cec146c30 0x7f4cec149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf37bb700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0a5b80 con 0x7f4cec0a5750 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf37bb700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec080440 con 0x7f4cec1495c0 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf37bb700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0a43f0 con 0x7f4cec146c30 2020-01-26T15:35:40.852 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf1d58700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4cec0a5750 0x7f4cec0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51330/0 (socket says 172.21.15.170:51330) 2020-01-26T15:35:40.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf1d58700 1 -- 172.21.15.170:0/996335311 learned_addr learned my addr 172.21.15.170:0/996335311 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf1557700 -1 --2- 172.21.15.170:0/996335311 >> v2:172.21.15.170:6790/0 conn(0x7f4cec146c30 0x7f4cec149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> v2:172.21.15.170:6790/0 conn(0x7f4cec146c30 0x7f4cec149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.853 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396811254 0 0) 0x7f4cec0a5b80 con 0x7f4cec0a5750 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd4003230 con 0x7f4cec0a5750 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391537517 0 0) 0x7f4cec080440 con 0x7f4cec1495c0 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec0a5b80 con 0x7f4cec1495c0 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3275582662 0 0) 0x7f4cd4003230 con 0x7f4cec0a5750 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 >> v2:172.21.15.170:6790/0 conn(0x7f4cec146c30 msgr2=0x7f4cec149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 --2- 172.21.15.170:0/996335311 >> v2:172.21.15.170:6790/0 conn(0x7f4cec146c30 0x7f4cec149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:40.854 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 >> v1:172.21.15.170:6790/0 conn(0x7f4cec1495c0 legacy=0x7f4cec14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0a4e00 con 0x7f4cec0a5750 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4ce4001a90 con 0x7f4cec0a5750 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 >> v1:172.21.15.170:6789/0 conn(0x7f4cec0a5750 legacy=0x7f4cec0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4cd4003230 con 0x7f4cd400a7f0 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4cec080440 con 0x7f4cd4003a90 2020-01-26T15:35:40.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0a43f0 con 0x7f4cd4003f00 2020-01-26T15:35:40.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.844+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:40.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316277620 0 0) 0x7f4cd4003230 con 0x7f4cd400a7f0 2020-01-26T15:35:40.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd400e440 con 0x7f4cd400a7f0 2020-01-26T15:35:40.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 -- 172.21.15.170:0/996335311 >> v1:172.21.15.170:6791/0 conn(0x7f4cd4003a90 legacy=0x7f4cd40045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83731646 0 0) 0x7f4cec080440 con 0x7f4cd4003a90 2020-01-26T15:35:40.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 -- 172.21.15.170:0/996335311 >> v1:172.21.15.170:6790/0 conn(0x7f4cd400a7f0 legacy=0x7f4cd400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.857 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 -- 172.21.15.170:0/996335311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4054530 con 0x7f4cd4003f00 2020-01-26T15:35:40.857 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.857 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.857 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).ready entity=mon.0 client_cookie=6f1dfb98f66bbf73 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:40.857 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4ce8008c60 con 0x7f4cd4003f00 2020-01-26T15:35:40.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005780 con 0x7f4cd4003f00 2020-01-26T15:35:40.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf1557700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:40.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf0d56700 1 -- 172.21.15.170:0/996335311 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4ce8005b60 con 0x7f4cd4003f00 2020-01-26T15:35:40.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 -- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 msgr2=0x7f4cd4004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 --2- 172.21.15.170:0/996335311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cd4003f00 0x7f4cd4004da0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f4ce8002f30 tx=0x7f4ce800fe60).stop 2020-01-26T15:35:40.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf2559700 1 -- 172.21.15.170:0/996335311 reap_dead start 2020-01-26T15:35:40.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 -- 172.21.15.170:0/996335311 shutdown_connections 2020-01-26T15:35:40.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 -- 172.21.15.170:0/996335311 >> 172.21.15.170:0/996335311 conn(0x7f4cec05e050 msgr2=0x7f4cec098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 -- 172.21.15.170:0/996335311 shutdown_connections 2020-01-26T15:35:40.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 -- 172.21.15.170:0/996335311 wait complete. 2020-01-26T15:35:40.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 Processor -- start 2020-01-26T15:35:40.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.848+0000 7f4cf37bb700 1 -- start start 2020-01-26T15:35:40.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf37bb700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4cec07a1b0 0x7f4cec139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:40.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf37bb700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec07d740 con 0x7f4cec07c140 2020-01-26T15:35:40.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf37bb700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec07ad20 con 0x7f4cec07bd10 2020-01-26T15:35:40.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf37bb700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec07da60 con 0x7f4cec07a1b0 2020-01-26T15:35:40.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf1d58700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f4cec07bd10 0x7f4cec07cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43346/0 (socket says 172.21.15.170:43346) 2020-01-26T15:35:40.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf1d58700 1 -- 172.21.15.170:0/1894071420 learned_addr learned my addr 172.21.15.170:0/1894071420 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:40.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf2559700 -1 --2- 172.21.15.170:0/1894071420 >> v2:172.21.15.170:6790/0 conn(0x7f4cec07a1b0 0x7f4cec139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf2559700 1 --2- 172.21.15.170:0/1894071420 >> v2:172.21.15.170:6790/0 conn(0x7f4cec07a1b0 0x7f4cec139970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:40.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923347102 0 0) 0x7f4cec07ad20 con 0x7f4cec07bd10 2020-01-26T15:35:40.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ccc003230 con 0x7f4cec07bd10 2020-01-26T15:35:40.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151367480 0 0) 0x7f4cec07d740 con 0x7f4cec07c140 2020-01-26T15:35:40.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec07ad20 con 0x7f4cec07c140 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4072654565 0 0) 0x7f4ccc003230 con 0x7f4cec07bd10 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4cec07d740 con 0x7f4cec07bd10 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4ce4001a10 con 0x7f4cec07bd10 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3749460290 0 0) 0x7f4cec07d740 con 0x7f4cec07bd10 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 >> v2:172.21.15.170:6790/0 conn(0x7f4cec07a1b0 msgr2=0x7f4cec139970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 --2- 172.21.15.170:0/1894071420 >> v2:172.21.15.170:6790/0 conn(0x7f4cec07a1b0 0x7f4cec139970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 >> v1:172.21.15.170:6790/0 conn(0x7f4cec07c140 legacy=0x7f4cec0799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec07b0a0 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec065c70 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec139ec0 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4ce4001550 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.852+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4ce4004e90 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.856+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f4ce4005150 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.856+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc8003360 con 0x7f4cec07bd10 2020-01-26T15:35:40.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.856+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7f4ce404be70 con 0x7f4cec07bd10 2020-01-26T15:35:40.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.860+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f4ce40313c0 con 0x7f4cec07bd10 2020-01-26T15:35:40.867 INFO:tasks.ceph.mds.a.smithi170.stderr:terminate called after throwing an instance of 'ceph::buffer::v14_2_0::end_of_buffer' 2020-01-26T15:35:40.867 INFO:tasks.ceph.mds.a.smithi170.stderr: what(): buffer::end_of_buffer 2020-01-26T15:35:40.867 INFO:tasks.ceph.mds.a.smithi170.stderr:*** Caught signal (Aborted) ** 2020-01-26T15:35:40.867 INFO:tasks.ceph.mds.a.smithi170.stderr: in thread 7f82e0d3c700 thread_name:MR_Finisher 2020-01-26T15:35:40.869 INFO:tasks.ceph.mds.a.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:40.869 INFO:tasks.ceph.mds.a.smithi170.stderr: 1: (()+0x12890) [0x7f82edf3a890] 2020-01-26T15:35:40.869 INFO:tasks.ceph.mds.a.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f82ed032e97] 2020-01-26T15:35:40.869 INFO:tasks.ceph.mds.a.smithi170.stderr: 3: (abort()+0x141) [0x7f82ed034801] 2020-01-26T15:35:40.869 INFO:tasks.ceph.mds.a.smithi170.stderr: 4: (()+0x8c957) [0x7f82eda27957] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 5: (()+0x92ab6) [0x7f82eda2dab6] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 6: (()+0x92af1) [0x7f82eda2daf1] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 7: (()+0x92d24) [0x7f82eda2dd24] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 8: (()+0x26a540) [0x7f82ee621540] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 9: (()+0x57ff67) [0x7f82ee936f67] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55c16b2b745d] 2020-01-26T15:35:40.870 INFO:tasks.ceph.mds.a.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55c16b2b7df6] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55c16b2b528c] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55c16b2bdd42] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55c16b2be021] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f82ee675175] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: 16: (()+0x76db) [0x7f82edf2f6db] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: 17: (clone()+0x3f) [0x7f82ed11588f] 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr:2020-01-26T15:35:40.860+0000 7f82e0d3c700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:35:40.871 INFO:tasks.ceph.mds.a.smithi170.stderr: in thread 7f82e0d3c700 thread_name:MR_Finisher 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: 1: (()+0x12890) [0x7f82edf3a890] 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f82ed032e97] 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: 3: (abort()+0x141) [0x7f82ed034801] 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: 4: (()+0x8c957) [0x7f82eda27957] 2020-01-26T15:35:40.872 INFO:tasks.ceph.mds.a.smithi170.stderr: 5: (()+0x92ab6) [0x7f82eda2dab6] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 6: (()+0x92af1) [0x7f82eda2daf1] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 7: (()+0x92d24) [0x7f82eda2dd24] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 8: (()+0x26a540) [0x7f82ee621540] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 9: (()+0x57ff67) [0x7f82ee936f67] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55c16b2b745d] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55c16b2b7df6] 2020-01-26T15:35:40.873 INFO:tasks.ceph.mds.a.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55c16b2b528c] 2020-01-26T15:35:40.874 INFO:tasks.ceph.mds.a.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55c16b2bdd42] 2020-01-26T15:35:40.874 INFO:tasks.ceph.mds.a.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55c16b2be021] 2020-01-26T15:35:40.874 INFO:tasks.ceph.mds.a.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f82ee675175] 2020-01-26T15:35:40.874 INFO:tasks.ceph.mds.a.smithi170.stderr: 16: (()+0x76db) [0x7f82edf2f6db] 2020-01-26T15:35:40.874 INFO:tasks.ceph.mds.a.smithi170.stderr: 17: (clone()+0x3f) [0x7f82ed11588f] 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: -449> 2020-01-26T15:35:31.216+0000 7f82e954d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x55c16c591200 0x55c16d1fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: -448> 2020-01-26T15:35:31.216+0000 7f82e9d4e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55c16c590d80 0x55c16d1fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: -301> 2020-01-26T15:35:31.220+0000 7f82ea54f700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: -140> 2020-01-26T15:35:31.472+0000 7f82e0d3c700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:35:40.875 INFO:tasks.ceph.mds.a.smithi170.stderr: 0> 2020-01-26T15:35:40.860+0000 7f82e0d3c700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:35:40.876 INFO:tasks.ceph.mds.a.smithi170.stderr: in thread 7f82e0d3c700 thread_name:MR_Finisher 2020-01-26T15:35:40.876 INFO:tasks.ceph.mds.a.smithi170.stderr: 2020-01-26T15:35:40.876 INFO:tasks.ceph.mds.a.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:40.876 INFO:tasks.ceph.mds.a.smithi170.stderr: 1: (()+0x12890) [0x7f82edf3a890] 2020-01-26T15:35:40.876 INFO:tasks.ceph.mds.a.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f82ed032e97] 2020-01-26T15:35:40.876 INFO:tasks.ceph.mds.a.smithi170.stderr: 3: (abort()+0x141) [0x7f82ed034801] 2020-01-26T15:35:40.877 INFO:tasks.ceph.mds.a.smithi170.stderr: 4: (()+0x8c957) [0x7f82eda27957] 2020-01-26T15:35:40.877 INFO:tasks.ceph.mds.a.smithi170.stderr: 5: (()+0x92ab6) [0x7f82eda2dab6] 2020-01-26T15:35:40.877 INFO:tasks.ceph.mds.a.smithi170.stderr: 6: (()+0x92af1) [0x7f82eda2daf1] 2020-01-26T15:35:40.877 INFO:tasks.ceph.mds.a.smithi170.stderr: 7: (()+0x92d24) [0x7f82eda2dd24] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 8: (()+0x26a540) [0x7f82ee621540] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 9: (()+0x57ff67) [0x7f82ee936f67] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55c16b2b745d] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55c16b2b7df6] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55c16b2b528c] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55c16b2bdd42] 2020-01-26T15:35:40.878 INFO:tasks.ceph.mds.a.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55c16b2be021] 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f82ee675175] 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: 16: (()+0x76db) [0x7f82edf2f6db] 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: 17: (clone()+0x3f) [0x7f82ed11588f] 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: -449> 2020-01-26T15:35:31.216+0000 7f82e954d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x55c16c591200 0x55c16d1fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:40.879 INFO:tasks.ceph.mds.a.smithi170.stderr: -448> 2020-01-26T15:35:31.216+0000 7f82e9d4e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55c16c590d80 0x55c16d1fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: -301> 2020-01-26T15:35:31.220+0000 7f82ea54f700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: -140> 2020-01-26T15:35:31.472+0000 7f82e0d3c700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: 0> 2020-01-26T15:35:40.860+0000 7f82e0d3c700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: in thread 7f82e0d3c700 thread_name:MR_Finisher 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: 1: (()+0x12890) [0x7f82edf3a890] 2020-01-26T15:35:40.880 INFO:tasks.ceph.mds.a.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f82ed032e97] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 3: (abort()+0x141) [0x7f82ed034801] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 4: (()+0x8c957) [0x7f82eda27957] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 5: (()+0x92ab6) [0x7f82eda2dab6] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 6: (()+0x92af1) [0x7f82eda2daf1] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 7: (()+0x92d24) [0x7f82eda2dd24] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 8: (()+0x26a540) [0x7f82ee621540] 2020-01-26T15:35:40.881 INFO:tasks.ceph.mds.a.smithi170.stderr: 9: (()+0x57ff67) [0x7f82ee936f67] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55c16b2b745d] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55c16b2b7df6] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55c16b2b528c] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55c16b2bdd42] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55c16b2be021] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f82ee675175] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 16: (()+0x76db) [0x7f82edf2f6db] 2020-01-26T15:35:40.882 INFO:tasks.ceph.mds.a.smithi170.stderr: 17: (clone()+0x3f) [0x7f82ed11588f] 2020-01-26T15:35:40.883 INFO:tasks.ceph.mds.a.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:35:40.883 INFO:tasks.ceph.mds.a.smithi170.stderr: 2020-01-26T15:35:40.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.980+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 --> v1:172.21.15.170:6800/17396 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cc80021c0 con 0x7f4ccc03e160 2020-01-26T15:35:40.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.988+0000 7f4ce27fc700 1 -- 172.21.15.170:0/1894071420 <== mgr.64101 v1:172.21.15.170:6800/17396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63433 (unknown 2965378022 0 3250248512) 0x7f4cc80021c0 con 0x7f4ccc03e160 2020-01-26T15:35:40.993 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:40.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 >> v1:172.21.15.170:6800/17396 conn(0x7f4ccc03e160 legacy=0x7f4ccc040670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 >> v1:172.21.15.170:6791/0 conn(0x7f4cec07bd10 legacy=0x7f4cec07cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:40.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 shutdown_connections 2020-01-26T15:35:40.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 --2- 172.21.15.170:0/1894071420 >> v2:172.21.15.170:6790/0 conn(0x7f4cec07a1b0 0x7f4cec139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:40.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 >> 172.21.15.170:0/1894071420 conn(0x7f4cec099210 msgr2=0x7f4cec05ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:40.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 shutdown_connections 2020-01-26T15:35:40.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:40.992+0000 7f4cf37bb700 1 -- 172.21.15.170:0/1894071420 wait complete. 2020-01-26T15:35:40.995 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2020-01-26T15:35:41.007 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-01-26T15:35:40.754324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4199168,"kb_used_data":4800,"kb_used_omap":19,"kb_used_meta":4194284,"kb_avail":373288192,"statfs":{"total":386547056640,"available":382247108608,"internally_reserved":4294967296,"allocated":4915200,"data_stored":402260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20266,"internal_metadata":4294947030},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,5],"upper_bound":16384},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001656"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974902+0000","last_change":"2020-01-26T15:35:23.861238+0000","last_active":"2020-01-26T15:35:35.974902+0000","last_peered":"2020-01-26T15:35:35.974902+0000","last_clean":"2020-01-26T15:35:35.974902+0000","last_became_active":"2020-01-26T15:35:23.860868+0000","last_became_peered":"2020-01-26T15:35:23.860868+0000","last_unstale":"2020-01-26T15:35:35.974902+0000","last_undegraded":"2020-01-26T15:35:35.974902+0000","last_fullsized":"2020-01-26T15:35:35.974902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.885281+0000","last_change":"2020-01-26T15:35:24.862303+0000","last_active":"2020-01-26T15:35:35.885281+0000","last_peered":"2020-01-26T15:35:35.885281+0000","last_clean":"2020-01-26T15:35:35.885281+0000","last_became_active":"2020-01-26T15:35:24.861893+0000","last_became_peered":"2020-01-26T15:35:24.861893+0000","last_unstale":"2020-01-26T15:35:35.885281+0000","last_undegraded":"2020-01-26T15:35:35.885281+0000","last_fullsized":"2020-01-26T15:35:35.885281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'8","reported_seq":"46","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886262+0000","last_change":"2020-01-26T15:35:22.854086+0000","last_active":"2020-01-26T15:35:35.886262+0000","last_peered":"2020-01-26T15:35:35.886262+0000","last_clean":"2020-01-26T15:35:35.886262+0000","last_became_active":"2020-01-26T15:35:22.853648+0000","last_became_peered":"2020-01-26T15:35:22.853648+0000","last_unstale":"2020-01-26T15:35:35.886262+0000","last_undegraded":"2020-01-26T15:35:35.886262+0000","last_fullsized":"2020-01-26T15:35:35.886262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.834497+0000","last_change":"2020-01-26T15:35:36.834497+0000","last_active":"2020-01-26T15:35:36.834497+0000","last_peered":"2020-01-26T15:35:36.834497+0000","last_clean":"2020-01-26T15:35:36.834497+0000","last_became_active":"2020-01-26T15:35:22.852821+0000","last_became_peered":"2020-01-26T15:35:22.852821+0000","last_unstale":"2020-01-26T15:35:36.834497+0000","last_undegraded":"2020-01-26T15:35:36.834497+0000","last_fullsized":"2020-01-26T15:35:36.834497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974503+0000","last_change":"2020-01-26T15:35:23.865582+0000","last_active":"2020-01-26T15:35:35.974503+0000","last_peered":"2020-01-26T15:35:35.974503+0000","last_clean":"2020-01-26T15:35:35.974503+0000","last_became_active":"2020-01-26T15:35:23.864839+0000","last_became_peered":"2020-01-26T15:35:23.864839+0000","last_unstale":"2020-01-26T15:35:35.974503+0000","last_undegraded":"2020-01-26T15:35:35.974503+0000","last_fullsized":"2020-01-26T15:35:35.974503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"17'16","reported_seq":"49","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:35:35.975218+0000","last_change":"2020-01-26T15:35:31.477087+0000","last_active":"2020-01-26T15:35:35.975218+0000","last_peered":"2020-01-26T15:35:35.975218+0000","last_clean":"2020-01-26T15:35:35.975218+0000","last_became_active":"2020-01-26T15:35:23.864774+0000","last_became_peered":"2020-01-26T15:35:23.864774+0000","last_unstale":"2020-01-26T15:35:35.975218+0000","last_undegraded":"2020-01-26T15:35:35.975218+0000","last_fullsized":"2020-01-26T15:35:35.975218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":656,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.475917+0000","last_change":"2020-01-26T15:35:24.863226+0000","last_active":"2020-01-26T15:35:36.475917+0000","last_peered":"2020-01-26T15:35:36.475917+0000","last_clean":"2020-01-26T15:35:36.475917+0000","last_became_active":"2020-01-26T15:35:24.862810+0000","last_became_peered":"2020-01-26T15:35:24.862810+0000","last_unstale":"2020-01-26T15:35:36.475917+0000","last_undegraded":"2020-01-26T15:35:36.475917+0000","last_fullsized":"2020-01-26T15:35:36.475917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"33","reported_epoch":"33","state":"active+clean","last_fresh":"2020-01-26T15:35:36.905092+0000","last_change":"2020-01-26T15:35:38.971422+0000","last_active":"2020-01-26T15:35:36.905092+0000","last_peered":"2020-01-26T15:35:36.905092+0000","last_clean":"2020-01-26T15:35:36.905092+0000","last_became_active":"2020-01-26T15:35:24.861435+0000","last_became_peered":"2020-01-26T15:35:24.861435+0000","last_unstale":"2020-01-26T15:35:36.905092+0000","last_undegraded":"2020-01-26T15:35:36.905092+0000","last_fullsized":"2020-01-26T15:35:36.905092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'14","reported_seq":"49","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974450+0000","last_change":"2020-01-26T15:35:23.859918+0000","last_active":"2020-01-26T15:35:35.974450+0000","last_peered":"2020-01-26T15:35:35.974450+0000","last_clean":"2020-01-26T15:35:35.974450+0000","last_became_active":"2020-01-26T15:35:23.859493+0000","last_became_peered":"2020-01-26T15:35:23.859493+0000","last_unstale":"2020-01-26T15:35:35.974450+0000","last_undegraded":"2020-01-26T15:35:35.974450+0000","last_fullsized":"2020-01-26T15:35:35.974450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"33","reported_epoch":"33","state":"active+clean","last_fresh":"2020-01-26T15:35:36.904338+0000","last_change":"2020-01-26T15:35:38.971434+0000","last_active":"2020-01-26T15:35:36.904338+0000","last_peered":"2020-01-26T15:35:36.904338+0000","last_clean":"2020-01-26T15:35:36.904338+0000","last_became_active":"2020-01-26T15:35:24.861360+0000","last_became_peered":"2020-01-26T15:35:24.861360+0000","last_unstale":"2020-01-26T15:35:36.904338+0000","last_undegraded":"2020-01-26T15:35:36.904338+0000","last_fullsized":"2020-01-26T15:35:36.904338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"29","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.833885+0000","last_change":"2020-01-26T15:35:36.833885+0000","last_active":"2020-01-26T15:35:36.833885+0000","last_peered":"2020-01-26T15:35:36.833885+0000","last_clean":"2020-01-26T15:35:36.833885+0000","last_became_active":"2020-01-26T15:35:22.851150+0000","last_became_peered":"2020-01-26T15:35:22.851150+0000","last_unstale":"2020-01-26T15:35:36.833885+0000","last_undegraded":"2020-01-26T15:35:36.833885+0000","last_fullsized":"2020-01-26T15:35:36.833885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'4","reported_seq":"36","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.885728+0000","last_change":"2020-01-26T15:35:24.861366+0000","last_active":"2020-01-26T15:35:35.885728+0000","last_peered":"2020-01-26T15:35:35.885728+0000","last_clean":"2020-01-26T15:35:35.885728+0000","last_became_active":"2020-01-26T15:35:24.860634+0000","last_became_peered":"2020-01-26T15:35:24.860634+0000","last_unstale":"2020-01-26T15:35:35.885728+0000","last_undegraded":"2020-01-26T15:35:35.885728+0000","last_fullsized":"2020-01-26T15:35:35.885728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974692+0000","last_change":"2020-01-26T15:35:24.860954+0000","last_active":"2020-01-26T15:35:35.974692+0000","last_peered":"2020-01-26T15:35:35.974692+0000","last_clean":"2020-01-26T15:35:35.974692+0000","last_became_active":"2020-01-26T15:35:24.860508+0000","last_became_peered":"2020-01-26T15:35:24.860508+0000","last_unstale":"2020-01-26T15:35:35.974692+0000","last_undegraded":"2020-01-26T15:35:35.974692+0000","last_fullsized":"2020-01-26T15:35:35.974692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"33","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886156+0000","last_change":"2020-01-26T15:35:22.851880+0000","last_active":"2020-01-26T15:35:35.886156+0000","last_peered":"2020-01-26T15:35:35.886156+0000","last_clean":"2020-01-26T15:35:35.886156+0000","last_became_active":"2020-01-26T15:35:22.851512+0000","last_became_peered":"2020-01-26T15:35:22.851512+0000","last_unstale":"2020-01-26T15:35:35.886156+0000","last_undegraded":"2020-01-26T15:35:35.886156+0000","last_fullsized":"2020-01-26T15:35:35.886156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'21","reported_seq":"51","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:35:35.974555+0000","last_change":"2020-01-26T15:35:31.477065+0000","last_active":"2020-01-26T15:35:35.974555+0000","last_peered":"2020-01-26T15:35:35.974555+0000","last_clean":"2020-01-26T15:35:35.974555+0000","last_became_active":"2020-01-26T15:35:24.860517+0000","last_became_peered":"2020-01-26T15:35:24.860517+0000","last_unstale":"2020-01-26T15:35:35.974555+0000","last_undegraded":"2020-01-26T15:35:35.974555+0000","last_fullsized":"2020-01-26T15:35:35.974555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2240,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.475739+0000","last_change":"2020-01-26T15:35:24.861700+0000","last_active":"2020-01-26T15:35:36.475739+0000","last_peered":"2020-01-26T15:35:36.475739+0000","last_clean":"2020-01-26T15:35:36.475739+0000","last_became_active":"2020-01-26T15:35:24.861378+0000","last_became_peered":"2020-01-26T15:35:24.861378+0000","last_unstale":"2020-01-26T15:35:36.475739+0000","last_undegraded":"2020-01-26T15:35:36.475739+0000","last_fullsized":"2020-01-26T15:35:36.475739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974566+0000","last_change":"2020-01-26T15:35:23.865287+0000","last_active":"2020-01-26T15:35:35.974566+0000","last_peered":"2020-01-26T15:35:35.974566+0000","last_clean":"2020-01-26T15:35:35.974566+0000","last_became_active":"2020-01-26T15:35:23.864793+0000","last_became_peered":"2020-01-26T15:35:23.864793+0000","last_unstale":"2020-01-26T15:35:35.974566+0000","last_undegraded":"2020-01-26T15:35:35.974566+0000","last_fullsized":"2020-01-26T15:35:35.974566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'8","reported_seq":"43","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974820+0000","last_change":"2020-01-26T15:35:23.861347+0000","last_active":"2020-01-26T15:35:35.974820+0000","last_peered":"2020-01-26T15:35:35.974820+0000","last_clean":"2020-01-26T15:35:35.974820+0000","last_became_active":"2020-01-26T15:35:23.860869+0000","last_became_peered":"2020-01-26T15:35:23.860869+0000","last_unstale":"2020-01-26T15:35:35.974820+0000","last_undegraded":"2020-01-26T15:35:35.974820+0000","last_fullsized":"2020-01-26T15:35:35.974820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"33","reported_epoch":"33","state":"active+clean","last_fresh":"2020-01-26T15:35:36.905629+0000","last_change":"2020-01-26T15:35:38.971403+0000","last_active":"2020-01-26T15:35:36.905629+0000","last_peered":"2020-01-26T15:35:36.905629+0000","last_clean":"2020-01-26T15:35:36.905629+0000","last_became_active":"2020-01-26T15:35:24.861368+0000","last_became_peered":"2020-01-26T15:35:24.861368+0000","last_unstale":"2020-01-26T15:35:36.905629+0000","last_undegraded":"2020-01-26T15:35:36.905629+0000","last_fullsized":"2020-01-26T15:35:36.905629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974722+0000","last_change":"2020-01-26T15:35:23.861700+0000","last_active":"2020-01-26T15:35:35.974722+0000","last_peered":"2020-01-26T15:35:35.974722+0000","last_clean":"2020-01-26T15:35:35.974722+0000","last_became_active":"2020-01-26T15:35:23.861304+0000","last_became_peered":"2020-01-26T15:35:23.861304+0000","last_unstale":"2020-01-26T15:35:35.974722+0000","last_undegraded":"2020-01-26T15:35:35.974722+0000","last_fullsized":"2020-01-26T15:35:35.974722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'8","reported_seq":"41","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:35:35.974797+0000","last_change":"2020-01-26T15:35:31.477294+0000","last_active":"2020-01-26T15:35:35.974797+0000","last_peered":"2020-01-26T15:35:35.974797+0000","last_clean":"2020-01-26T15:35:35.974797+0000","last_became_active":"2020-01-26T15:35:23.862105+0000","last_became_peered":"2020-01-26T15:35:23.862105+0000","last_unstale":"2020-01-26T15:35:35.974797+0000","last_undegraded":"2020-01-26T15:35:35.974797+0000","last_fullsized":"2020-01-26T15:35:35.974797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.885434+0000","last_change":"2020-01-26T15:35:24.860802+0000","last_active":"2020-01-26T15:35:35.885434+0000","last_peered":"2020-01-26T15:35:35.885434+0000","last_clean":"2020-01-26T15:35:35.885434+0000","last_became_active":"2020-01-26T15:35:24.860376+0000","last_became_peered":"2020-01-26T15:35:24.860376+0000","last_unstale":"2020-01-26T15:35:35.885434+0000","last_undegraded":"2020-01-26T15:35:35.885434+0000","last_fullsized":"2020-01-26T15:35:35.885434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886273+0000","last_change":"2020-01-26T15:35:23.859961+0000","last_active":"2020-01-26T15:35:35.886273+0000","last_peered":"2020-01-26T15:35:35.886273+0000","last_clean":"2020-01-26T15:35:35.886273+0000","last_became_active":"2020-01-26T15:35:23.859529+0000","last_became_peered":"2020-01-26T15:35:23.859529+0000","last_unstale":"2020-01-26T15:35:35.886273+0000","last_undegraded":"2020-01-26T15:35:35.886273+0000","last_fullsized":"2020-01-26T15:35:35.886273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"18'17","reported_seq":"53","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886014+0000","last_change":"2020-01-26T15:35:22.852315+0000","last_active":"2020-01-26T15:35:35.886014+0000","last_peered":"2020-01-26T15:35:35.886014+0000","last_clean":"2020-01-26T15:35:35.886014+0000","last_became_active":"2020-01-26T15:35:22.851887+0000","last_became_peered":"2020-01-26T15:35:22.851887+0000","last_unstale":"2020-01-26T15:35:35.886014+0000","last_undegraded":"2020-01-26T15:35:35.886014+0000","last_fullsized":"2020-01-26T15:35:35.886014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":15992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182405,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049856,"kb_used_data":1264,"kb_used_omap":11,"kb_used_meta":1048564,"kb_avail":93321984,"statfs":{"total":96636764160,"available":95561711616,"internally_reserved":1073741824,"allocated":1294336,"data_stored":100279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12016,"internal_metadata":1073729808},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,5],"upper_bound":16384},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":26,"seq":111669149701,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049744,"kb_used_data":1152,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":93322096,"statfs":{"total":96636764160,"available":95561826304,"internally_reserved":1073741824,"allocated":1179648,"data_stored":98897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8250,"internal_metadata":1073733574},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215109,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049840,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322000,"statfs":{"total":96636764160,"available":95561728000,"internally_reserved":1073741824,"allocated":1277952,"data_stored":102233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280518,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049728,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322112,"statfs":{"total":96636764160,"available":95561842688,"internally_reserved":1073741824,"allocated":1163264,"data_stored":100851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-26T15:35:41.014 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:35:41.015 INFO:tasks.ceph.mds.a.smithi170.stderr:daemon-helper: command crashed with signal 6 2020-01-26T15:35:41.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 Processor -- start 2020-01-26T15:35:41.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 -- start start 2020-01-26T15:35:41.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b3c05e5f0 0x7f6b3c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:41.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c0a6dc0 con 0x7f6b3c149040 2020-01-26T15:35:41.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c05ea20 con 0x7f6b3c05edd0 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c098000 con 0x7f6b3c05e5f0 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b43d7a700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f6b3c149040 0x7f6b3c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48232/0 (socket says 172.21.15.170:48232) 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41b16700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6b3c05e5f0 0x7f6b3c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b43d7a700 1 -- 172.21.15.170:0/2689805305 learned_addr learned my addr 172.21.15.170:0/2689805305 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42317700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f6b3c05edd0 0x7f6b3c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43354/0 (socket says 172.21.15.170:43354) 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41b16700 1 --2- 172.21.15.170:0/2689805305 >> v2:172.21.15.170:6791/0 conn(0x7f6b3c05e5f0 0x7f6b3c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619772042 0 0) 0x7f6b3c0a6dc0 con 0x7f6b3c149040 2020-01-26T15:35:41.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28003230 con 0x7f6b3c149040 2020-01-26T15:35:41.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198395500 0 0) 0x7f6b3c05ea20 con 0x7f6b3c05edd0 2020-01-26T15:35:41.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b3c0a6dc0 con 0x7f6b3c05edd0 2020-01-26T15:35:41.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1204157346 0 0) 0x7f6b28003230 con 0x7f6b3c149040 2020-01-26T15:35:41.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 >> v2:172.21.15.170:6791/0 conn(0x7f6b3c05e5f0 msgr2=0x7f6b3c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:41.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 --2- 172.21.15.170:0/2689805305 >> v2:172.21.15.170:6791/0 conn(0x7f6b3c05e5f0 0x7f6b3c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:41.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 >> v1:172.21.15.170:6791/0 conn(0x7f6b3c05edd0 legacy=0x7f6b3c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c05e050 con 0x7f6b3c149040 2020-01-26T15:35:41.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b38001710 con 0x7f6b3c149040 2020-01-26T15:35:41.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6b380019e0 con 0x7f6b3c149040 2020-01-26T15:35:41.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b41315700 1 -- 172.21.15.170:0/2689805305 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b380045b0 con 0x7f6b3c149040 2020-01-26T15:35:41.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.112+0000 7f6b42b18700 1 -- 172.21.15.170:0/2689805305 >> v1:172.21.15.170:6790/0 conn(0x7f6b3c149040 legacy=0x7f6b3c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 -- 172.21.15.170:0/2689805305 shutdown_connections 2020-01-26T15:35:41.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 --2- 172.21.15.170:0/2689805305 >> v2:172.21.15.170:6791/0 conn(0x7f6b3c05e5f0 0x7f6b3c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:41.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 -- 172.21.15.170:0/2689805305 >> 172.21.15.170:0/2689805305 conn(0x7f6b3c098e70 msgr2=0x7f6b3c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:41.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 -- 172.21.15.170:0/2689805305 shutdown_connections 2020-01-26T15:35:41.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 -- 172.21.15.170:0/2689805305 wait complete. 2020-01-26T15:35:41.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 Processor -- start 2020-01-26T15:35:41.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.116+0000 7f6b42b18700 1 -- start start 2020-01-26T15:35:41.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42b18700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c024af0 con 0x7f6b3c1319c0 2020-01-26T15:35:41.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42b18700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c11ea80 con 0x7f6b3c078700 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42b18700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c11ecb0 con 0x7f6b3c11e650 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42317700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f6b3c11e650 0x7f6b3c1311c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43360/0 (socket says 172.21.15.170:43360) 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f6b3c078700 0x7f6b3c139620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48238/0 (socket says 172.21.15.170:48238) 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42317700 1 -- 172.21.15.170:0/3285518299 learned_addr learned my addr 172.21.15.170:0/3285518299 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382356413 0 0) 0x7f6b3c11ecb0 con 0x7f6b3c11e650 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b24003230 con 0x7f6b3c11e650 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075508098 0 0) 0x7f6b3c11ea80 con 0x7f6b3c078700 2020-01-26T15:35:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b3c11ecb0 con 0x7f6b3c078700 2020-01-26T15:35:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383172441 0 0) 0x7f6b3c024af0 con 0x7f6b3c1319c0 2020-01-26T15:35:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b3c11ea80 con 0x7f6b3c1319c0 2020-01-26T15:35:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3949470744 0 0) 0x7f6b3c11ecb0 con 0x7f6b3c078700 2020-01-26T15:35:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b3c024af0 con 0x7f6b3c078700 2020-01-26T15:35:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b380015d0 con 0x7f6b3c078700 2020-01-26T15:35:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2246510525 0 0) 0x7f6b24003230 con 0x7f6b3c11e650 2020-01-26T15:35:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b3c11ecb0 con 0x7f6b3c11e650 2020-01-26T15:35:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b34001bf0 con 0x7f6b3c11e650 2020-01-26T15:35:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2931233151 0 0) 0x7f6b3c11ea80 con 0x7f6b3c1319c0 2020-01-26T15:35:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b24003230 con 0x7f6b3c1319c0 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6b2c001510 con 0x7f6b3c1319c0 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 >> v1:172.21.15.170:6791/0 conn(0x7f6b3c11e650 legacy=0x7f6b3c1311c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 >> v1:172.21.15.170:6790/0 conn(0x7f6b3c078700 legacy=0x7f6b3c139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 >> v1:172.21.15.170:6789/0 conn(0x7f6b3c1319c0 legacy=0x7f6b3c077f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6b3c024af0 con 0x7f6b24003540 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6b3c11ea80 con 0x7f6b240087e0 2020-01-26T15:35:41.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24010de0 con 0x7f6b2400c430 2020-01-26T15:35:41.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:41.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258214528 0 0) 0x7f6b3c024af0 con 0x7f6b24003540 2020-01-26T15:35:41.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b2400edc0 con 0x7f6b24003540 2020-01-26T15:35:41.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 -- 172.21.15.170:0/3285518299 >> v1:172.21.15.170:6791/0 conn(0x7f6b240087e0 legacy=0x7f6b2400ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 -- 172.21.15.170:0/3285518299 >> v1:172.21.15.170:6790/0 conn(0x7f6b24003540 legacy=0x7f6b24003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 -- 172.21.15.170:0/3285518299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f6b3c0a5000 con 0x7f6b2400c430 2020-01-26T15:35:41.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c11eee0 con 0x7f6b2400c430 2020-01-26T15:35:41.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c11e650 con 0x7f6b2400c430 2020-01-26T15:35:41.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6b38011b30 con 0x7f6b2400c430 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.120+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b38011d30 con 0x7f6b2400c430 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.124+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.124+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18003360 con 0x7f6b2400c430 2020-01-26T15:35:41.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.124+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f6b3800cea0 con 0x7f6b2400c430 2020-01-26T15:35:41.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.124+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.124+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f6b3804d630 con 0x7f6b2400c430 2020-01-26T15:35:41.149 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.128+0000 7f6b43d7a700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.149 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.128+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f6b38033720 con 0x7f6b2400c430 2020-01-26T15:35:41.245 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.244+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 --> v1:172.21.15.170:6800/17396 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b180021c0 con 0x7f6b24048bf0 2020-01-26T15:35:41.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b32ffd700 1 -- 172.21.15.170:0/3285518299 <== mgr.64101 v1:172.21.15.170:6800/17396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63433 (unknown 2965378022 0 3250248512) 0x7f6b180021c0 con 0x7f6b24048bf0 2020-01-26T15:35:41.252 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:41.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 >> v1:172.21.15.170:6800/17396 conn(0x7f6b24048bf0 legacy=0x7f6b2404b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 msgr2=0x7f6b2400e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b42b18700 1 --2- 172.21.15.170:0/3285518299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b2400c430 0x7f6b2400e870 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f6b38000b80 tx=0x7f6b380114e0).stop 2020-01-26T15:35:41.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b43d7a700 1 -- 172.21.15.170:0/3285518299 reap_dead start 2020-01-26T15:35:41.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 shutdown_connections 2020-01-26T15:35:41.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.248+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 >> 172.21.15.170:0/3285518299 conn(0x7f6b3c05c0e0 msgr2=0x7f6b3c07e860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:41.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.252+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 shutdown_connections 2020-01-26T15:35:41.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.252+0000 7f6b42b18700 1 -- 172.21.15.170:0/3285518299 wait complete. 2020-01-26T15:35:41.255 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2020-01-26T15:35:41.266 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-01-26T15:35:40.754324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4199168,"kb_used_data":4800,"kb_used_omap":19,"kb_used_meta":4194284,"kb_avail":373288192,"statfs":{"total":386547056640,"available":382247108608,"internally_reserved":4294967296,"allocated":4915200,"data_stored":402260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20266,"internal_metadata":4294947030},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,5],"upper_bound":16384},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001656"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974902+0000","last_change":"2020-01-26T15:35:23.861238+0000","last_active":"2020-01-26T15:35:35.974902+0000","last_peered":"2020-01-26T15:35:35.974902+0000","last_clean":"2020-01-26T15:35:35.974902+0000","last_became_active":"2020-01-26T15:35:23.860868+0000","last_became_peered":"2020-01-26T15:35:23.860868+0000","last_unstale":"2020-01-26T15:35:35.974902+0000","last_undegraded":"2020-01-26T15:35:35.974902+0000","last_fullsized":"2020-01-26T15:35:35.974902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.885281+0000","last_change":"2020-01-26T15:35:24.862303+0000","last_active":"2020-01-26T15:35:35.885281+0000","last_peered":"2020-01-26T15:35:35.885281+0000","last_clean":"2020-01-26T15:35:35.885281+0000","last_became_active":"2020-01-26T15:35:24.861893+0000","last_became_peered":"2020-01-26T15:35:24.861893+0000","last_unstale":"2020-01-26T15:35:35.885281+0000","last_undegraded":"2020-01-26T15:35:35.885281+0000","last_fullsized":"2020-01-26T15:35:35.885281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'8","reported_seq":"46","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886262+0000","last_change":"2020-01-26T15:35:22.854086+0000","last_active":"2020-01-26T15:35:35.886262+0000","last_peered":"2020-01-26T15:35:35.886262+0000","last_clean":"2020-01-26T15:35:35.886262+0000","last_became_active":"2020-01-26T15:35:22.853648+0000","last_became_peered":"2020-01-26T15:35:22.853648+0000","last_unstale":"2020-01-26T15:35:35.886262+0000","last_undegraded":"2020-01-26T15:35:35.886262+0000","last_fullsized":"2020-01-26T15:35:35.886262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.834497+0000","last_change":"2020-01-26T15:35:36.834497+0000","last_active":"2020-01-26T15:35:36.834497+0000","last_peered":"2020-01-26T15:35:36.834497+0000","last_clean":"2020-01-26T15:35:36.834497+0000","last_became_active":"2020-01-26T15:35:22.852821+0000","last_became_peered":"2020-01-26T15:35:22.852821+0000","last_unstale":"2020-01-26T15:35:36.834497+0000","last_undegraded":"2020-01-26T15:35:36.834497+0000","last_fullsized":"2020-01-26T15:35:36.834497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974503+0000","last_change":"2020-01-26T15:35:23.865582+0000","last_active":"2020-01-26T15:35:35.974503+0000","last_peered":"2020-01-26T15:35:35.974503+0000","last_clean":"2020-01-26T15:35:35.974503+0000","last_became_active":"2020-01-26T15:35:23.864839+0000","last_became_peered":"2020-01-26T15:35:23.864839+0000","last_unstale":"2020-01-26T15:35:35.974503+0000","last_undegraded":"2020-01-26T15:35:35.974503+0000","last_fullsized":"2020-01-26T15:35:35.974503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"17'16","reported_seq":"49","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:35:35.975218+0000","last_change":"2020-01-26T15:35:31.477087+0000","last_active":"2020-01-26T15:35:35.975218+0000","last_peered":"2020-01-26T15:35:35.975218+0000","last_clean":"2020-01-26T15:35:35.975218+0000","last_became_active":"2020-01-26T15:35:23.864774+0000","last_became_peered":"2020-01-26T15:35:23.864774+0000","last_unstale":"2020-01-26T15:35:35.975218+0000","last_undegraded":"2020-01-26T15:35:35.975218+0000","last_fullsized":"2020-01-26T15:35:35.975218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":656,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.475917+0000","last_change":"2020-01-26T15:35:24.863226+0000","last_active":"2020-01-26T15:35:36.475917+0000","last_peered":"2020-01-26T15:35:36.475917+0000","last_clean":"2020-01-26T15:35:36.475917+0000","last_became_active":"2020-01-26T15:35:24.862810+0000","last_became_peered":"2020-01-26T15:35:24.862810+0000","last_unstale":"2020-01-26T15:35:36.475917+0000","last_undegraded":"2020-01-26T15:35:36.475917+0000","last_fullsized":"2020-01-26T15:35:36.475917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"33","reported_epoch":"33","state":"active+clean","last_fresh":"2020-01-26T15:35:36.905092+0000","last_change":"2020-01-26T15:35:38.971422+0000","last_active":"2020-01-26T15:35:36.905092+0000","last_peered":"2020-01-26T15:35:36.905092+0000","last_clean":"2020-01-26T15:35:36.905092+0000","last_became_active":"2020-01-26T15:35:24.861435+0000","last_became_peered":"2020-01-26T15:35:24.861435+0000","last_unstale":"2020-01-26T15:35:36.905092+0000","last_undegraded":"2020-01-26T15:35:36.905092+0000","last_fullsized":"2020-01-26T15:35:36.905092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'14","reported_seq":"49","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974450+0000","last_change":"2020-01-26T15:35:23.859918+0000","last_active":"2020-01-26T15:35:35.974450+0000","last_peered":"2020-01-26T15:35:35.974450+0000","last_clean":"2020-01-26T15:35:35.974450+0000","last_became_active":"2020-01-26T15:35:23.859493+0000","last_became_peered":"2020-01-26T15:35:23.859493+0000","last_unstale":"2020-01-26T15:35:35.974450+0000","last_undegraded":"2020-01-26T15:35:35.974450+0000","last_fullsized":"2020-01-26T15:35:35.974450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"33","reported_epoch":"33","state":"active+clean","last_fresh":"2020-01-26T15:35:36.904338+0000","last_change":"2020-01-26T15:35:38.971434+0000","last_active":"2020-01-26T15:35:36.904338+0000","last_peered":"2020-01-26T15:35:36.904338+0000","last_clean":"2020-01-26T15:35:36.904338+0000","last_became_active":"2020-01-26T15:35:24.861360+0000","last_became_peered":"2020-01-26T15:35:24.861360+0000","last_unstale":"2020-01-26T15:35:36.904338+0000","last_undegraded":"2020-01-26T15:35:36.904338+0000","last_fullsized":"2020-01-26T15:35:36.904338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"29","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.833885+0000","last_change":"2020-01-26T15:35:36.833885+0000","last_active":"2020-01-26T15:35:36.833885+0000","last_peered":"2020-01-26T15:35:36.833885+0000","last_clean":"2020-01-26T15:35:36.833885+0000","last_became_active":"2020-01-26T15:35:22.851150+0000","last_became_peered":"2020-01-26T15:35:22.851150+0000","last_unstale":"2020-01-26T15:35:36.833885+0000","last_undegraded":"2020-01-26T15:35:36.833885+0000","last_fullsized":"2020-01-26T15:35:36.833885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'4","reported_seq":"36","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.885728+0000","last_change":"2020-01-26T15:35:24.861366+0000","last_active":"2020-01-26T15:35:35.885728+0000","last_peered":"2020-01-26T15:35:35.885728+0000","last_clean":"2020-01-26T15:35:35.885728+0000","last_became_active":"2020-01-26T15:35:24.860634+0000","last_became_peered":"2020-01-26T15:35:24.860634+0000","last_unstale":"2020-01-26T15:35:35.885728+0000","last_undegraded":"2020-01-26T15:35:35.885728+0000","last_fullsized":"2020-01-26T15:35:35.885728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974692+0000","last_change":"2020-01-26T15:35:24.860954+0000","last_active":"2020-01-26T15:35:35.974692+0000","last_peered":"2020-01-26T15:35:35.974692+0000","last_clean":"2020-01-26T15:35:35.974692+0000","last_became_active":"2020-01-26T15:35:24.860508+0000","last_became_peered":"2020-01-26T15:35:24.860508+0000","last_unstale":"2020-01-26T15:35:35.974692+0000","last_undegraded":"2020-01-26T15:35:35.974692+0000","last_fullsized":"2020-01-26T15:35:35.974692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"33","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886156+0000","last_change":"2020-01-26T15:35:22.851880+0000","last_active":"2020-01-26T15:35:35.886156+0000","last_peered":"2020-01-26T15:35:35.886156+0000","last_clean":"2020-01-26T15:35:35.886156+0000","last_became_active":"2020-01-26T15:35:22.851512+0000","last_became_peered":"2020-01-26T15:35:22.851512+0000","last_unstale":"2020-01-26T15:35:35.886156+0000","last_undegraded":"2020-01-26T15:35:35.886156+0000","last_fullsized":"2020-01-26T15:35:35.886156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'21","reported_seq":"51","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:35:35.974555+0000","last_change":"2020-01-26T15:35:31.477065+0000","last_active":"2020-01-26T15:35:35.974555+0000","last_peered":"2020-01-26T15:35:35.974555+0000","last_clean":"2020-01-26T15:35:35.974555+0000","last_became_active":"2020-01-26T15:35:24.860517+0000","last_became_peered":"2020-01-26T15:35:24.860517+0000","last_unstale":"2020-01-26T15:35:35.974555+0000","last_undegraded":"2020-01-26T15:35:35.974555+0000","last_fullsized":"2020-01-26T15:35:35.974555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2240,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:36.475739+0000","last_change":"2020-01-26T15:35:24.861700+0000","last_active":"2020-01-26T15:35:36.475739+0000","last_peered":"2020-01-26T15:35:36.475739+0000","last_clean":"2020-01-26T15:35:36.475739+0000","last_became_active":"2020-01-26T15:35:24.861378+0000","last_became_peered":"2020-01-26T15:35:24.861378+0000","last_unstale":"2020-01-26T15:35:36.475739+0000","last_undegraded":"2020-01-26T15:35:36.475739+0000","last_fullsized":"2020-01-26T15:35:36.475739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974566+0000","last_change":"2020-01-26T15:35:23.865287+0000","last_active":"2020-01-26T15:35:35.974566+0000","last_peered":"2020-01-26T15:35:35.974566+0000","last_clean":"2020-01-26T15:35:35.974566+0000","last_became_active":"2020-01-26T15:35:23.864793+0000","last_became_peered":"2020-01-26T15:35:23.864793+0000","last_unstale":"2020-01-26T15:35:35.974566+0000","last_undegraded":"2020-01-26T15:35:35.974566+0000","last_fullsized":"2020-01-26T15:35:35.974566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'8","reported_seq":"43","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974820+0000","last_change":"2020-01-26T15:35:23.861347+0000","last_active":"2020-01-26T15:35:35.974820+0000","last_peered":"2020-01-26T15:35:35.974820+0000","last_clean":"2020-01-26T15:35:35.974820+0000","last_became_active":"2020-01-26T15:35:23.860869+0000","last_became_peered":"2020-01-26T15:35:23.860869+0000","last_unstale":"2020-01-26T15:35:35.974820+0000","last_undegraded":"2020-01-26T15:35:35.974820+0000","last_fullsized":"2020-01-26T15:35:35.974820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"33","reported_epoch":"33","state":"active+clean","last_fresh":"2020-01-26T15:35:36.905629+0000","last_change":"2020-01-26T15:35:38.971403+0000","last_active":"2020-01-26T15:35:36.905629+0000","last_peered":"2020-01-26T15:35:36.905629+0000","last_clean":"2020-01-26T15:35:36.905629+0000","last_became_active":"2020-01-26T15:35:24.861368+0000","last_became_peered":"2020-01-26T15:35:24.861368+0000","last_unstale":"2020-01-26T15:35:36.905629+0000","last_undegraded":"2020-01-26T15:35:36.905629+0000","last_fullsized":"2020-01-26T15:35:36.905629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.974722+0000","last_change":"2020-01-26T15:35:23.861700+0000","last_active":"2020-01-26T15:35:35.974722+0000","last_peered":"2020-01-26T15:35:35.974722+0000","last_clean":"2020-01-26T15:35:35.974722+0000","last_became_active":"2020-01-26T15:35:23.861304+0000","last_became_peered":"2020-01-26T15:35:23.861304+0000","last_unstale":"2020-01-26T15:35:35.974722+0000","last_undegraded":"2020-01-26T15:35:35.974722+0000","last_fullsized":"2020-01-26T15:35:35.974722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"16'8","reported_seq":"41","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:35:35.974797+0000","last_change":"2020-01-26T15:35:31.477294+0000","last_active":"2020-01-26T15:35:35.974797+0000","last_peered":"2020-01-26T15:35:35.974797+0000","last_clean":"2020-01-26T15:35:35.974797+0000","last_became_active":"2020-01-26T15:35:23.862105+0000","last_became_peered":"2020-01-26T15:35:23.862105+0000","last_unstale":"2020-01-26T15:35:35.974797+0000","last_undegraded":"2020-01-26T15:35:35.974797+0000","last_fullsized":"2020-01-26T15:35:35.974797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.885434+0000","last_change":"2020-01-26T15:35:24.860802+0000","last_active":"2020-01-26T15:35:35.885434+0000","last_peered":"2020-01-26T15:35:35.885434+0000","last_clean":"2020-01-26T15:35:35.885434+0000","last_became_active":"2020-01-26T15:35:24.860376+0000","last_became_peered":"2020-01-26T15:35:24.860376+0000","last_unstale":"2020-01-26T15:35:35.885434+0000","last_undegraded":"2020-01-26T15:35:35.885434+0000","last_fullsized":"2020-01-26T15:35:35.885434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:15.146049+0000","last_clean_scrub_stamp":"2020-01-26T15:32:15.146049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886273+0000","last_change":"2020-01-26T15:35:23.859961+0000","last_active":"2020-01-26T15:35:35.886273+0000","last_peered":"2020-01-26T15:35:35.886273+0000","last_clean":"2020-01-26T15:35:35.886273+0000","last_became_active":"2020-01-26T15:35:23.859529+0000","last_became_peered":"2020-01-26T15:35:23.859529+0000","last_unstale":"2020-01-26T15:35:35.886273+0000","last_undegraded":"2020-01-26T15:35:35.886273+0000","last_fullsized":"2020-01-26T15:35:35.886273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:12.123576+0000","last_clean_scrub_stamp":"2020-01-26T15:32:12.123576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"18'17","reported_seq":"53","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:35:35.886014+0000","last_change":"2020-01-26T15:35:22.852315+0000","last_active":"2020-01-26T15:35:35.886014+0000","last_peered":"2020-01-26T15:35:35.886014+0000","last_clean":"2020-01-26T15:35:35.886014+0000","last_became_active":"2020-01-26T15:35:22.851887+0000","last_became_peered":"2020-01-26T15:35:22.851887+0000","last_unstale":"2020-01-26T15:35:35.886014+0000","last_undegraded":"2020-01-26T15:35:35.886014+0000","last_fullsized":"2020-01-26T15:35:35.886014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:32:14.140184+0000","last_clean_scrub_stamp":"2020-01-26T15:32:14.140184+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4284,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":7996,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":112,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":15992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182405,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049856,"kb_used_data":1264,"kb_used_omap":11,"kb_used_meta":1048564,"kb_avail":93321984,"statfs":{"total":96636764160,"available":95561711616,"internally_reserved":1073741824,"allocated":1294336,"data_stored":100279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12016,"internal_metadata":1073729808},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,5],"upper_bound":16384},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":26,"seq":111669149701,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049744,"kb_used_data":1152,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":93322096,"statfs":{"total":96636764160,"available":95561826304,"internally_reserved":1073741824,"allocated":1179648,"data_stored":98897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8250,"internal_metadata":1073733574},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215109,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049840,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322000,"statfs":{"total":96636764160,"available":95561728000,"internally_reserved":1073741824,"allocated":1277952,"data_stored":102233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280518,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049728,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322112,"statfs":{"total":96636764160,"available":95561842688,"internally_reserved":1073741824,"allocated":1163264,"data_stored":100851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-26T15:35:41.268 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-26T15:35:41.269 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-26T15:35:41.269 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-26T15:35:41.269 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:41.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f0f00700 1 Processor -- start 2020-01-26T15:35:41.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f0f00700 1 -- start start 2020-01-26T15:35:41.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f0f00700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f44ec05edd0 0x7f44ec05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:41.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f0f00700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec098000 con 0x7f44ec0a6870 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f0f00700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec05e050 con 0x7f44ec149040 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f0f00700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0a6ca0 con 0x7f44ec05edd0 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44ebfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f44ec05edd0 0x7f44ec05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f2162700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f44ec149040 0x7f44ec14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48250/0 (socket says 172.21.15.170:48250) 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44ebfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f44ec05edd0 0x7f44ec05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eb7fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f44ec0a6870 0x7f44ec07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51376/0 (socket says 172.21.15.170:51376) 2020-01-26T15:35:41.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44f2162700 1 -- 172.21.15.170:0/1135526083 learned_addr learned my addr 172.21.15.170:0/1135526083 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560504446 0 0) 0x7f44ec098000 con 0x7f44ec0a6870 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d8003230 con 0x7f44ec0a6870 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603223098 0 0) 0x7f44ec05e050 con 0x7f44ec149040 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec098000 con 0x7f44ec149040 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2124749291 0 0) 0x7f44d8003230 con 0x7f44ec0a6870 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 >> v2:172.21.15.170:6790/0 conn(0x7f44ec05edd0 msgr2=0x7f44ec05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 --2- 172.21.15.170:0/1135526083 >> v2:172.21.15.170:6790/0 conn(0x7f44ec05edd0 0x7f44ec05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:41.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 >> v1:172.21.15.170:6790/0 conn(0x7f44ec149040 legacy=0x7f44ec14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.376+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec14ecb0 con 0x7f44ec0a6870 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f44d4001710 con 0x7f44ec0a6870 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 >> v1:172.21.15.170:6789/0 conn(0x7f44ec0a6870 legacy=0x7f44ec07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f44d8003230 con 0x7f44d800a7f0 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f44ec05e050 con 0x7f44d80045a0 2020-01-26T15:35:41.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0a6ca0 con 0x7f44d8003ac0 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645230785 0 0) 0x7f44ec05e050 con 0x7f44d80045a0 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d800e440 con 0x7f44d80045a0 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 -- 172.21.15.170:0/1135526083 >> v1:172.21.15.170:6791/0 conn(0x7f44d80045a0 legacy=0x7f44d80049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 -- 172.21.15.170:0/1135526083 >> v1:172.21.15.170:6790/0 conn(0x7f44d800a7f0 legacy=0x7f44d800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 -- 172.21.15.170:0/1135526083 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d8054530 con 0x7f44d8003ac0 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670369845 0 0) 0x7f44d8003230 con 0x7f44d800a7f0 2020-01-26T15:35:41.389 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).ready entity=mon.0 client_cookie=9d4ed2584e6e83fc server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f44dc010af0 con 0x7f44d8003ac0 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.390 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc010cf0 con 0x7f44d8003ac0 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44eaffd700 1 -- 172.21.15.170:0/1135526083 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f44dc011270 con 0x7f44d8003ac0 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f0f00700 1 -- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 msgr2=0x7f44d8003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f0f00700 1 --2- 172.21.15.170:0/1135526083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8003ac0 0x7f44d8003f10 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f44dc008c80 tx=0x7f44dc0101e0).stop 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f2162700 1 -- 172.21.15.170:0/1135526083 reap_dead start 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f0f00700 1 -- 172.21.15.170:0/1135526083 shutdown_connections 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f0f00700 1 -- 172.21.15.170:0/1135526083 >> 172.21.15.170:0/1135526083 conn(0x7f44ec098e70 msgr2=0x7f44ec0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f0f00700 1 -- 172.21.15.170:0/1135526083 shutdown_connections 2020-01-26T15:35:41.391 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.380+0000 7f44f0f00700 1 -- 172.21.15.170:0/1135526083 wait complete. 2020-01-26T15:35:41.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 Processor -- start 2020-01-26T15:35:41.392 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 -- start start 2020-01-26T15:35:41.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f44ec11e300 0x7f44ec131200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:41.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0a1b20 con 0x7f44ec131750 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0a0530 con 0x7f44ec121970 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec121ee0 con 0x7f44ec11e300 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44eb7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f44ec11e300 0x7f44ec131200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f44ec121970 0x7f44ec0a0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48260/0 (socket says 172.21.15.170:48260) 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 -- 172.21.15.170:0/1013610594 learned_addr learned my addr 172.21.15.170:0/1013610594 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44eb7fe700 1 --2- 172.21.15.170:0/1013610594 >> v2:172.21.15.170:6791/0 conn(0x7f44ec11e300 0x7f44ec131200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:41.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181531104 0 0) 0x7f44ec0a0530 con 0x7f44ec121970 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d0003230 con 0x7f44ec121970 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514608904 0 0) 0x7f44ec0a1b20 con 0x7f44ec131750 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec0a0530 con 0x7f44ec131750 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3115372256 0 0) 0x7f44d0003230 con 0x7f44ec121970 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f44ec0a1b20 con 0x7f44ec121970 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f44dc008a00 con 0x7f44ec121970 2020-01-26T15:35:41.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2680757003 0 0) 0x7f44ec0a0530 con 0x7f44ec131750 2020-01-26T15:35:41.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f44d0003230 con 0x7f44ec131750 2020-01-26T15:35:41.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f44e4001890 con 0x7f44ec131750 2020-01-26T15:35:41.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 >> v2:172.21.15.170:6791/0 conn(0x7f44ec11e300 msgr2=0x7f44ec131200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:41.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 --2- 172.21.15.170:0/1013610594 >> v2:172.21.15.170:6791/0 conn(0x7f44ec11e300 0x7f44ec131200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:41.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 >> v1:172.21.15.170:6790/0 conn(0x7f44ec121970 legacy=0x7f44ec0a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 >> v1:172.21.15.170:6789/0 conn(0x7f44ec131750 legacy=0x7f44ec138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f44ec0a1b20 con 0x7f44d0004f20 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f44ec0a0530 con 0x7f44d0004af0 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec121ee0 con 0x7f44d0003ec0 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575442021 0 0) 0x7f44ec0a1b20 con 0x7f44d0004f20 2020-01-26T15:35:41.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 -- 172.21.15.170:0/1013610594 >> v1:172.21.15.170:6791/0 conn(0x7f44d0004af0 legacy=0x7f44d00097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 -- 172.21.15.170:0/1013610594 >> v1:172.21.15.170:6790/0 conn(0x7f44d0004f20 legacy=0x7f44d000d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 -- 172.21.15.170:0/1013610594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f44ec0a1040 con 0x7f44d0003ec0 2020-01-26T15:35:41.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec11e730 con 0x7f44d0003ec0 2020-01-26T15:35:41.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec121b90 con 0x7f44d0003ec0 2020-01-26T15:35:41.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:41.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.384+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f44dc00f820 con 0x7f44d0003ec0 2020-01-26T15:35:41.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00fa20 con 0x7f44d0003ec0 2020-01-26T15:35:41.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c4003360 con 0x7f44d0003ec0 2020-01-26T15:35:41.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f44dc007160 con 0x7f44d0003ec0 2020-01-26T15:35:41.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.388+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f44dc04e220 con 0x7f44d0003ec0 2020-01-26T15:35:41.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.392+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.392+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f44dc0343d0 con 0x7f44d0003ec0 2020-01-26T15:35:41.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.548+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f44c4003790 con 0x7f44d0003ec0 2020-01-26T15:35:41.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.548+0000 7f44ebfff700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:41.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.548+0000 7f44e8ff9700 1 -- 172.21.15.170:0/1013610594 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f44dc034630 con 0x7f44d0003ec0 2020-01-26T15:35:41.553 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:41.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 >> v1:172.21.15.170:6800/17396 conn(0x7f44d00481a0 legacy=0x7f44d004a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 msgr2=0x7f44d00045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f44d4000fa0 tx=0x7f44dc00f410).stop 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f2162700 1 -- 172.21.15.170:0/1013610594 reap_dead start 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 shutdown_connections 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 --2- 172.21.15.170:0/1013610594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d0003ec0 0x7f44d00045a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 >> 172.21.15.170:0/1013610594 conn(0x7f44ec098e10 msgr2=0x7f44ec07def0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 shutdown_connections 2020-01-26T15:35:41.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:41.552+0000 7f44f0f00700 1 -- 172.21.15.170:0/1013610594 wait complete. 2020-01-26T15:35:41.566 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:35:44.568 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:44.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73ccb72700 1 Processor -- start 2020-01-26T15:35:44.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73ccb72700 1 -- start start 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73ccb72700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f73c814a880 0x7f73c814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73ccb72700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c80a5b80 con 0x7f73c8146c30 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73ccb72700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c8080440 con 0x7f73c80a5750 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73ccb72700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80a43f0 con 0x7f73c814a880 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c759e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f73c814a880 0x7f73c814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c659c700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f73c8146c30 0x7f73c8149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51398/0 (socket says 172.21.15.170:51398) 2020-01-26T15:35:44.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c659c700 1 -- 172.21.15.170:0/1645517010 learned_addr learned my addr 172.21.15.170:0/1645517010 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c6d9d700 1 --1- 172.21.15.170:0/1645517010 >> v1:172.21.15.170:6790/0 conn(0x7f73c80a5750 0x7f73c80a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48274/0 (socket says 172.21.15.170:48274) 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c759e700 1 --2- 172.21.15.170:0/1645517010 >> v2:172.21.15.170:6791/0 conn(0x7f73c814a880 0x7f73c814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962710323 0 0) 0x7f73c8080440 con 0x7f73c80a5750 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b4003230 con 0x7f73c80a5750 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886617918 0 0) 0x7f73c80a5b80 con 0x7f73c8146c30 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c8080440 con 0x7f73c8146c30 2020-01-26T15:35:44.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 910675457 0 0) 0x7f73b4003230 con 0x7f73c80a5750 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 >> v2:172.21.15.170:6791/0 conn(0x7f73c814a880 msgr2=0x7f73c814ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 --2- 172.21.15.170:0/1645517010 >> v2:172.21.15.170:6791/0 conn(0x7f73c814a880 0x7f73c814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 >> v1:172.21.15.170:6789/0 conn(0x7f73c8146c30 legacy=0x7f73c8149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80a4e00 con 0x7f73c80a5750 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.680+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f73b0001710 con 0x7f73c80a5750 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f73b00019e0 con 0x7f73c80a5750 2020-01-26T15:35:44.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- 172.21.15.170:0/1645517010 >> v1:172.21.15.170:6790/0 conn(0x7f73c80a5750 legacy=0x7f73c80a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73c5d9b700 1 -- 172.21.15.170:0/1645517010 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f73b00044f0 con 0x7f73c80a5750 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- 172.21.15.170:0/1645517010 shutdown_connections 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 --2- 172.21.15.170:0/1645517010 >> v2:172.21.15.170:6791/0 conn(0x7f73c814a880 0x7f73c814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- 172.21.15.170:0/1645517010 >> 172.21.15.170:0/1645517010 conn(0x7f73c805e050 msgr2=0x7f73c8098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- 172.21.15.170:0/1645517010 shutdown_connections 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- 172.21.15.170:0/1645517010 wait complete. 2020-01-26T15:35:44.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 Processor -- start 2020-01-26T15:35:44.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- start start 2020-01-26T15:35:44.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f73c8122d40 0x7f73c8094a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:44.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c81229d0 con 0x7f73c8094390 2020-01-26T15:35:44.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c80961d0 con 0x7f73c8093f60 2020-01-26T15:35:44.695 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73ccb72700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f73c811d980 con 0x7f73c8122d40 2020-01-26T15:35:44.696 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73c759e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f73c8094390 0x7f73c8133bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51402/0 (socket says 172.21.15.170:51402) 2020-01-26T15:35:44.696 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73c759e700 1 -- 172.21.15.170:0/2591581490 learned_addr learned my addr 172.21.15.170:0/2591581490 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:44.696 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73c6d9d700 -1 --2- 172.21.15.170:0/2591581490 >> v2:172.21.15.170:6791/0 conn(0x7f73c8122d40 0x7f73c8094a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:44.696 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.684+0000 7f73c6d9d700 1 --2- 172.21.15.170:0/2591581490 >> v2:172.21.15.170:6791/0 conn(0x7f73c8122d40 0x7f73c8094a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:44.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471204388 0 0) 0x7f73c81229d0 con 0x7f73c8094390 2020-01-26T15:35:44.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac003230 con 0x7f73c8094390 2020-01-26T15:35:44.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 700371542 0 0) 0x7f73ac003230 con 0x7f73c8094390 2020-01-26T15:35:44.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73c81229d0 con 0x7f73c8094390 2020-01-26T15:35:44.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f73c0002a70 con 0x7f73c8094390 2020-01-26T15:35:44.697 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 >> v2:172.21.15.170:6791/0 conn(0x7f73c8122d40 msgr2=0x7f73c8094a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:44.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 --2- 172.21.15.170:0/2591581490 >> v2:172.21.15.170:6791/0 conn(0x7f73c8122d40 0x7f73c8094a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:44.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 >> v1:172.21.15.170:6790/0 conn(0x7f73c8093f60 legacy=0x7f73c81333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 >> v1:172.21.15.170:6789/0 conn(0x7f73c8094390 legacy=0x7f73c8133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:44.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f73c80961d0 con 0x7f73ac003a20 2020-01-26T15:35:44.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f73ac003230 con 0x7f73ac00a7f0 2020-01-26T15:35:44.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c811d980 con 0x7f73ac003e70 2020-01-26T15:35:44.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:44.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585845371 0 0) 0x7f73ac003230 con 0x7f73ac00a7f0 2020-01-26T15:35:44.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac00f450 con 0x7f73ac00a7f0 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181409471 0 0) 0x7f73c80961d0 con 0x7f73ac003a20 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac003230 con 0x7f73ac003a20 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4257581509 0 0) 0x7f73ac00f450 con 0x7f73ac00a7f0 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73c80961d0 con 0x7f73ac00a7f0 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f73c0001620 con 0x7f73ac00a7f0 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 -- 172.21.15.170:0/2591581490 >> v1:172.21.15.170:6791/0 conn(0x7f73ac00a7f0 legacy=0x7f73ac00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 -- 172.21.15.170:0/2591581490 >> v1:172.21.15.170:6790/0 conn(0x7f73ac003a20 legacy=0x7f73ac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 -- 172.21.15.170:0/2591581490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c813db00 con 0x7f73ac003e70 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c8093f60 con 0x7f73ac003e70 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c81333b0 con 0x7f73ac003e70 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:44.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f73b800b4e0 con 0x7f73ac003e70 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800b6e0 con 0x7f73ac003e70 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f73b800bac0 con 0x7f73ac003e70 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f73b800a260 con 0x7f73ac003e70 2020-01-26T15:35:44.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.688+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.692+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0003360 con 0x7f73ac003e70 2020-01-26T15:35:44.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.692+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f73b804cfa0 con 0x7f73ac003e70 2020-01-26T15:35:44.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.696+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.696+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f73b80330f0 con 0x7f73ac003e70 2020-01-26T15:35:44.855 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.852+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f73a0003790 con 0x7f73ac003e70 2020-01-26T15:35:44.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.852+0000 7f73c659c700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:44.856 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.852+0000 7f73bf7fe700 1 -- 172.21.15.170:0/2591581490 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f73b8033350 con 0x7f73ac003e70 2020-01-26T15:35:44.856 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:44.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 >> v1:172.21.15.170:6800/17396 conn(0x7f73ac0482c0 legacy=0x7f73ac04a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 msgr2=0x7f73ac004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:44.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f73b8000e50 tx=0x7f73b80108c0).stop 2020-01-26T15:35:44.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73c759e700 1 -- 172.21.15.170:0/2591581490 reap_dead start 2020-01-26T15:35:44.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 shutdown_connections 2020-01-26T15:35:44.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 --2- 172.21.15.170:0/2591581490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ac003e70 0x7f73ac004da0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:44.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 >> 172.21.15.170:0/2591581490 conn(0x7f73c80979c0 msgr2=0x7f73c8123fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:44.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 shutdown_connections 2020-01-26T15:35:44.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:44.856+0000 7f73ccb72700 1 -- 172.21.15.170:0/2591581490 wait complete. 2020-01-26T15:35:44.869 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:35:47.871 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:47.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5882e700 1 Processor -- start 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5882e700 1 -- start start 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5882e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fad540a6870 0x7fad5414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5882e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5405ea20 con 0x7fad5405e5f0 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5882e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad54098000 con 0x7fad5405edd0 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5882e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fad5405e050 con 0x7fad540a6870 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5359e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fad5405edd0 0x7fad5407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43418/0 (socket says 172.21.15.170:43418) 2020-01-26T15:35:47.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5359e700 1 -- 172.21.15.170:0/243737293 learned_addr learned my addr 172.21.15.170:0/243737293 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad4ad9d700 1 --1- 172.21.15.170:0/243737293 >> v1:172.21.15.170:6790/0 conn(0x7fad5405e5f0 0x7fad54149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48294/0 (socket says 172.21.15.170:48294) 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5902f700 -1 --2- 172.21.15.170:0/243737293 >> v2:172.21.15.170:6791/0 conn(0x7fad540a6870 0x7fad5414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad5902f700 1 --2- 172.21.15.170:0/243737293 >> v2:172.21.15.170:6791/0 conn(0x7fad540a6870 0x7fad5414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986141411 0 0) 0x7fad54098000 con 0x7fad5405edd0 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad40003230 con 0x7fad5405edd0 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207250906 0 0) 0x7fad5405ea20 con 0x7fad5405e5f0 2020-01-26T15:35:47.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad54098000 con 0x7fad5405e5f0 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3334063787 0 0) 0x7fad40003230 con 0x7fad5405edd0 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 >> v2:172.21.15.170:6791/0 conn(0x7fad540a6870 msgr2=0x7fad5414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 --2- 172.21.15.170:0/243737293 >> v2:172.21.15.170:6791/0 conn(0x7fad540a6870 0x7fad5414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 >> v1:172.21.15.170:6790/0 conn(0x7fad5405e5f0 legacy=0x7fad54149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540a6ca0 con 0x7fad5405edd0 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.984+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad44001710 con 0x7fad5405edd0 2020-01-26T15:35:47.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fad44001910 con 0x7fad5405edd0 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad52d9d700 1 -- 172.21.15.170:0/243737293 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad440045b0 con 0x7fad5405edd0 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- 172.21.15.170:0/243737293 >> v1:172.21.15.170:6791/0 conn(0x7fad5405edd0 legacy=0x7fad5407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- 172.21.15.170:0/243737293 shutdown_connections 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 --2- 172.21.15.170:0/243737293 >> v2:172.21.15.170:6791/0 conn(0x7fad540a6870 0x7fad5414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- 172.21.15.170:0/243737293 >> 172.21.15.170:0/243737293 conn(0x7fad54098e70 msgr2=0x7fad540a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- 172.21.15.170:0/243737293 shutdown_connections 2020-01-26T15:35:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- 172.21.15.170:0/243737293 wait complete. 2020-01-26T15:35:47.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 Processor -- start 2020-01-26T15:35:47.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- start start 2020-01-26T15:35:47.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fad5409f150 0x7fad541217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:47.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fad54121d00 0x7fad5412e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad54123640 con 0x7fad5412e9a0 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fad541222f0 con 0x7fad54121d00 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5882e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fad5411f660 con 0x7fad5409f150 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5359e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fad5409f150 0x7fad541217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5902f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fad5412e9a0 0x7fad5411e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48300/0 (socket says 172.21.15.170:48300) 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad4ad9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fad54121d00 0x7fad5412e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5902f700 1 -- 172.21.15.170:0/493353682 learned_addr learned my addr 172.21.15.170:0/493353682 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:47.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad4ad9d700 1 --2- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6790/0 conn(0x7fad54121d00 0x7fad5412e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad5359e700 1 --2- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6791/0 conn(0x7fad5409f150 0x7fad541217b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461583215 0 0) 0x7fad54123640 con 0x7fad5412e9a0 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.988+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad38003230 con 0x7fad5412e9a0 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3246907702 0 0) 0x7fad38003230 con 0x7fad5412e9a0 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad54123640 con 0x7fad5412e9a0 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad4c002a50 con 0x7fad5412e9a0 2020-01-26T15:35:47.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2092107377 0 0) 0x7fad54123640 con 0x7fad5412e9a0 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6791/0 conn(0x7fad5409f150 msgr2=0x7fad541217b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 --2- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6791/0 conn(0x7fad5409f150 0x7fad541217b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6790/0 conn(0x7fad54121d00 msgr2=0x7fad5412e450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 --2- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6790/0 conn(0x7fad54121d00 0x7fad5412e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5407a3d0 con 0x7fad5412e9a0 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5412edd0 con 0x7fad5412e9a0 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5407d1c0 con 0x7fad5412e9a0 2020-01-26T15:35:48.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fad4c001210 con 0x7fad5412e9a0 2020-01-26T15:35:48.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad4c0015f0 con 0x7fad5412e9a0 2020-01-26T15:35:48.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c003360 con 0x7fad5412e9a0 2020-01-26T15:35:48.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fad4c0017f0 con 0x7fad5412e9a0 2020-01-26T15:35:48.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.992+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 4267201614 0 0) 0x7fad4c04be70 con 0x7fad5412e9a0 2020-01-26T15:35:48.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:47.996+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fad5407d1c0 con 0x7fad5412e9a0 2020-01-26T15:35:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.148+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad2c0037d0 con 0x7fad5412e9a0 2020-01-26T15:35:48.152 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.148+0000 7fad50d99700 1 -- 172.21.15.170:0/493353682 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fad4c0313f0 con 0x7fad5412e9a0 2020-01-26T15:35:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 >> v1:172.21.15.170:6800/17396 conn(0x7fad3803e0a0 legacy=0x7fad380405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 >> v1:172.21.15.170:6790/0 conn(0x7fad5412e9a0 legacy=0x7fad5411e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 shutdown_connections 2020-01-26T15:35:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 --2- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6791/0 conn(0x7fad5409f150 0x7fad541217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 --2- 172.21.15.170:0/493353682 >> v2:172.21.15.170:6790/0 conn(0x7fad54121d00 0x7fad5412e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 >> 172.21.15.170:0/493353682 conn(0x7fad540a67d0 msgr2=0x7fad5407f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 shutdown_connections 2020-01-26T15:35:48.155 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:48.152+0000 7fad5882e700 1 -- 172.21.15.170:0/493353682 wait complete. 2020-01-26T15:35:48.170 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:35:51.170 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:51.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe3fff700 1 Processor -- start 2020-01-26T15:35:51.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe3fff700 1 -- start start 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe3fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7effe405edd0 0x7effe405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe3fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe4098000 con 0x7effe40a6870 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe3fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe405e050 con 0x7effe4149040 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe3fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7effe40a6ca0 con 0x7effe405edd0 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe37fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7effe405edd0 0x7effe405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe9a20700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7effe4149040 0x7effe414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43434/0 (socket says 172.21.15.170:43434) 2020-01-26T15:35:51.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe9a20700 1 -- 172.21.15.170:0/2404742256 learned_addr learned my addr 172.21.15.170:0/2404742256 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> v2:172.21.15.170:6790/0 conn(0x7effe405edd0 0x7effe405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151642041 0 0) 0x7effe4098000 con 0x7effe40a6870 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd0003230 con 0x7effe40a6870 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327599646 0 0) 0x7effe405e050 con 0x7effe4149040 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.284+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4098000 con 0x7effe4149040 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1798249612 0 0) 0x7effd0003230 con 0x7effe40a6870 2020-01-26T15:35:51.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 >> v2:172.21.15.170:6790/0 conn(0x7effe405edd0 msgr2=0x7effe405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 --2- 172.21.15.170:0/2404742256 >> v2:172.21.15.170:6790/0 conn(0x7effe405edd0 0x7effe405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 >> v1:172.21.15.170:6791/0 conn(0x7effe4149040 legacy=0x7effe414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe414ecb0 con 0x7effe40a6870 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7effcc001710 con 0x7effe40a6870 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 >> v1:172.21.15.170:6789/0 conn(0x7effe40a6870 legacy=0x7effe407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7effd0003230 con 0x7effd00045a0 2020-01-26T15:35:51.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7effe405e050 con 0x7effd000a7f0 2020-01-26T15:35:51.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe40a6ca0 con 0x7effd0003ac0 2020-01-26T15:35:51.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:51.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491484027 0 0) 0x7effd0003230 con 0x7effd00045a0 2020-01-26T15:35:51.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd000e440 con 0x7effd00045a0 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 -- 172.21.15.170:0/2404742256 >> v1:172.21.15.170:6791/0 conn(0x7effd000a7f0 legacy=0x7effd000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695808238 0 0) 0x7effe405e050 con 0x7effd000a7f0 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 -- 172.21.15.170:0/2404742256 >> v1:172.21.15.170:6790/0 conn(0x7effd00045a0 legacy=0x7effd00049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 -- 172.21.15.170:0/2404742256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0054530 con 0x7effd0003ac0 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7effd4008c80 tx=0x7effd40101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7effd4008c80 tx=0x7effd40101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7effd4008c80 tx=0x7effd40101e0).ready entity=mon.0 client_cookie=bca4160dfeba58bc server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7effd4008c80 tx=0x7effd40101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7effd4008c80 tx=0x7effd40101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7effd4010af0 con 0x7effd0003ac0 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe37fe700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7effd4008c80 tx=0x7effd40101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4010cf0 con 0x7effd0003ac0 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe27fc700 1 -- 172.21.15.170:0/2404742256 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7effd4011270 con 0x7effd0003ac0 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe3fff700 1 -- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 msgr2=0x7effd0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe3fff700 1 --2- 172.21.15.170:0/2404742256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effd0003ac0 0x7effd0003f10 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7effd4008c80 tx=0x7effd40101e0).stop 2020-01-26T15:35:51.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe9a20700 1 -- 172.21.15.170:0/2404742256 reap_dead start 2020-01-26T15:35:51.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe3fff700 1 -- 172.21.15.170:0/2404742256 shutdown_connections 2020-01-26T15:35:51.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe3fff700 1 -- 172.21.15.170:0/2404742256 >> 172.21.15.170:0/2404742256 conn(0x7effe4098e70 msgr2=0x7effe40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:51.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe3fff700 1 -- 172.21.15.170:0/2404742256 shutdown_connections 2020-01-26T15:35:51.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.288+0000 7effe3fff700 1 -- 172.21.15.170:0/2404742256 wait complete. 2020-01-26T15:35:51.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe3fff700 1 Processor -- start 2020-01-26T15:35:51.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe3fff700 1 -- start start 2020-01-26T15:35:51.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe3fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7effe40a0da0 0x7effe409f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:51.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe3fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe40a36b0 con 0x7effe409a230 2020-01-26T15:35:51.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe3fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe4130840 con 0x7effe4130410 2020-01-26T15:35:51.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe3fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7effe40a11d0 con 0x7effe40a0da0 2020-01-26T15:35:51.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe2ffd700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7effe4130410 0x7effe4099a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43446/0 (socket says 172.21.15.170:43446) 2020-01-26T15:35:51.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe2ffd700 1 -- 172.21.15.170:0/3880097599 learned_addr learned my addr 172.21.15.170:0/3880097599 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:51.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe37fe700 -1 --2- 172.21.15.170:0/3880097599 >> v2:172.21.15.170:6791/0 conn(0x7effe40a0da0 0x7effe409f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:51.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effe37fe700 1 --2- 172.21.15.170:0/3880097599 >> v2:172.21.15.170:6791/0 conn(0x7effe40a0da0 0x7effe409f9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:51.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751327449 0 0) 0x7effe4130840 con 0x7effe4130410 2020-01-26T15:35:51.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc8003230 con 0x7effe4130410 2020-01-26T15:35:51.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437666328 0 0) 0x7effe40a36b0 con 0x7effe409a230 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.292+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4130840 con 0x7effe409a230 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3439889124 0 0) 0x7effe4130840 con 0x7effe409a230 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7effe40a36b0 con 0x7effe409a230 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7effdc001890 con 0x7effe409a230 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 >> v2:172.21.15.170:6791/0 conn(0x7effe40a0da0 msgr2=0x7effe409f9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 --2- 172.21.15.170:0/3880097599 >> v2:172.21.15.170:6791/0 conn(0x7effe40a0da0 0x7effe409f9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:51.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 >> v1:172.21.15.170:6791/0 conn(0x7effe4130410 legacy=0x7effe4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 >> v1:172.21.15.170:6789/0 conn(0x7effe409a230 legacy=0x7effe4137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7effc8003230 con 0x7effc8004c20 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7effe4130840 con 0x7effc80050e0 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc8012620 con 0x7effc800b800 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971600263 0 0) 0x7effc8003230 con 0x7effc8004c20 2020-01-26T15:35:51.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc800e310 con 0x7effc8004c20 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591189283 0 0) 0x7effe4130840 con 0x7effc80050e0 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 -- 172.21.15.170:0/3880097599 >> v1:172.21.15.170:6791/0 conn(0x7effc80050e0 legacy=0x7effc8003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 -- 172.21.15.170:0/3880097599 >> v1:172.21.15.170:6790/0 conn(0x7effc8004c20 legacy=0x7effc8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 -- 172.21.15.170:0/3880097599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4130a70 con 0x7effc800b800 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe4130d40 con 0x7effc800b800 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe4130410 con 0x7effc800b800 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7effdc011830 con 0x7effc800b800 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.311 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc011a30 con 0x7effc800b800 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7effdc00c630 con 0x7effc800b800 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7effdc00c830 con 0x7effc800b800 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7effdc04d3c0 con 0x7effc800b800 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.296+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc003360 con 0x7effc800b800 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.304+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.312 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.304+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7effdc033570 con 0x7effc800b800 2020-01-26T15:35:51.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.456+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7effbc003790 con 0x7effc800b800 2020-01-26T15:35:51.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.456+0000 7effe9a20700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:51.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.456+0000 7effdbfff700 1 -- 172.21.15.170:0/3880097599 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7effdc0337d0 con 0x7effc800b800 2020-01-26T15:35:51.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 >> v1:172.21.15.170:6800/17396 conn(0x7effc804a460 legacy=0x7effc804c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.464 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 msgr2=0x7effc800dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 --2- 172.21.15.170:0/3880097599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effc800b800 0x7effc800dcf0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7effdc000e50 tx=0x7effdc011070).stop 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe9a20700 1 -- 172.21.15.170:0/3880097599 reap_dead start 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe9a20700 1 -- 172.21.15.170:0/3880097599 reap_dead start 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 shutdown_connections 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 >> 172.21.15.170:0/3880097599 conn(0x7effe4123020 msgr2=0x7effe407f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 shutdown_connections 2020-01-26T15:35:51.465 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:51.460+0000 7effe3fff700 1 -- 172.21.15.170:0/3880097599 wait complete. 2020-01-26T15:35:51.466 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:51.473 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:35:54.475 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:54.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa584fb6700 1 Processor -- start 2020-01-26T15:35:54.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa584fb6700 1 -- start start 2020-01-26T15:35:54.595 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa584fb6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa58005e5f0 0x7fa5800a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:54.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa584fb6700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800a6dc0 con 0x7fa58005edd0 2020-01-26T15:35:54.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa584fb6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58005ea20 con 0x7fa580149040 2020-01-26T15:35:54.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa584fb6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa580098000 con 0x7fa58005e5f0 2020-01-26T15:35:54.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57f7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa58005e5f0 0x7fa5800a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:54.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa586218700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fa580149040 0x7fa58014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48332/0 (socket says 172.21.15.170:48332) 2020-01-26T15:35:54.596 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57ffff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa58005edd0 0x7fa58007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51454/0 (socket says 172.21.15.170:51454) 2020-01-26T15:35:54.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa586218700 1 -- 172.21.15.170:0/423158183 learned_addr learned my addr 172.21.15.170:0/423158183 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:54.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57f7fe700 1 --2- 172.21.15.170:0/423158183 >> v2:172.21.15.170:6791/0 conn(0x7fa58005e5f0 0x7fa5800a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:54.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812184329 0 0) 0x7fa58005ea20 con 0x7fa580149040 2020-01-26T15:35:54.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa560003230 con 0x7fa580149040 2020-01-26T15:35:54.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184357325 0 0) 0x7fa5800a6dc0 con 0x7fa58005edd0 2020-01-26T15:35:54.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa58005ea20 con 0x7fa58005edd0 2020-01-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3333590855 0 0) 0x7fa560003230 con 0x7fa580149040 2020-01-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 >> v2:172.21.15.170:6791/0 conn(0x7fa58005e5f0 msgr2=0x7fa5800a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 --2- 172.21.15.170:0/423158183 >> v2:172.21.15.170:6791/0 conn(0x7fa58005e5f0 0x7fa5800a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 >> v1:172.21.15.170:6789/0 conn(0x7fa58005edd0 legacy=0x7fa58007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58005e050 con 0x7fa580149040 2020-01-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.588+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa578001710 con 0x7fa580149040 2020-01-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa578001910 con 0x7fa580149040 2020-01-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa57effd700 1 -- 172.21.15.170:0/423158183 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa5780045b0 con 0x7fa580149040 2020-01-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- 172.21.15.170:0/423158183 >> v1:172.21.15.170:6790/0 conn(0x7fa580149040 legacy=0x7fa58014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- 172.21.15.170:0/423158183 shutdown_connections 2020-01-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 --2- 172.21.15.170:0/423158183 >> v2:172.21.15.170:6791/0 conn(0x7fa58005e5f0 0x7fa5800a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- 172.21.15.170:0/423158183 >> 172.21.15.170:0/423158183 conn(0x7fa580098e70 msgr2=0x7fa5800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:54.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- 172.21.15.170:0/423158183 shutdown_connections 2020-01-26T15:35:54.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- 172.21.15.170:0/423158183 wait complete. 2020-01-26T15:35:54.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 Processor -- start 2020-01-26T15:35:54.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- start start 2020-01-26T15:35:54.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa58009eee0 0x7fa58009fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800a02e0 con 0x7fa58011ef50 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580098ea0 con 0x7fa580024fb0 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.592+0000 7fa584fb6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa58009df90 con 0x7fa58009eee0 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa586218700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fa580024fb0 0x7fa58013aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48338/0 (socket says 172.21.15.170:48338) 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa58011ef50 0x7fa5800247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51458/0 (socket says 172.21.15.170:51458) 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57f7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa58009eee0 0x7fa58009fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:54.605 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa586218700 1 -- 172.21.15.170:0/1393988794 learned_addr learned my addr 172.21.15.170:0/1393988794 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:54.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57f7fe700 1 --2- 172.21.15.170:0/1393988794 >> v2:172.21.15.170:6791/0 conn(0x7fa58009eee0 0x7fa58009fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:54.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861278872 0 0) 0x7fa5800a02e0 con 0x7fa58011ef50 2020-01-26T15:35:54.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa558003230 con 0x7fa58011ef50 2020-01-26T15:35:54.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328052848 0 0) 0x7fa580098ea0 con 0x7fa580024fb0 2020-01-26T15:35:54.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5800a02e0 con 0x7fa580024fb0 2020-01-26T15:35:54.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1920336820 0 0) 0x7fa558003230 con 0x7fa58011ef50 2020-01-26T15:35:54.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa580098ea0 con 0x7fa58011ef50 2020-01-26T15:35:54.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3684104915 0 0) 0x7fa5800a02e0 con 0x7fa580024fb0 2020-01-26T15:35:54.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa558003230 con 0x7fa580024fb0 2020-01-26T15:35:54.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa568001780 con 0x7fa58011ef50 2020-01-26T15:35:54.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 >> v2:172.21.15.170:6791/0 conn(0x7fa58009eee0 msgr2=0x7fa58009fd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 --2- 172.21.15.170:0/1393988794 >> v2:172.21.15.170:6791/0 conn(0x7fa58009eee0 0x7fa58009fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 >> v1:172.21.15.170:6790/0 conn(0x7fa580024fb0 legacy=0x7fa58013aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 >> v1:172.21.15.170:6789/0 conn(0x7fa58011ef50 legacy=0x7fa5800247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fa5800a02e0 con 0x7fa558003a90 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fa558004320 con 0x7fa558003ec0 2020-01-26T15:35:54.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58009df90 con 0x7fa558004fb0 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837827235 0 0) 0x7fa558004320 con 0x7fa558003ec0 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa55800e810 con 0x7fa558003ec0 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992459990 0 0) 0x7fa5800a02e0 con 0x7fa558003a90 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa558004320 con 0x7fa558003a90 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 -- 172.21.15.170:0/1393988794 >> v1:172.21.15.170:6791/0 conn(0x7fa558003ec0 legacy=0x7fa55800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 -- 172.21.15.170:0/1393988794 >> v1:172.21.15.170:6790/0 conn(0x7fa558003a90 legacy=0x7fa5580097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.609 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 -- 172.21.15.170:0/1393988794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580122f40 con 0x7fa558004fb0 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5800a37c0 con 0x7fa558004fb0 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa580024fb0 con 0x7fa558004fb0 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.610 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fa56800ede0 con 0x7fa558004fb0 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568011940 con 0x7fa558004fb0 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fa568011ce0 con 0x7fa558004fb0 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c003360 con 0x7fa558004fb0 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.596+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.600+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fa568005520 con 0x7fa558004fb0 2020-01-26T15:35:54.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.600+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.600+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7fa56804d670 con 0x7fa558004fb0 2020-01-26T15:35:54.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.604+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.604+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fa568033820 con 0x7fa558004fb0 2020-01-26T15:35:54.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa55c003790 con 0x7fa558004fb0 2020-01-26T15:35:54.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa57ffff700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:54.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa57cff9700 1 -- 172.21.15.170:0/1393988794 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa568033a80 con 0x7fa558004fb0 2020-01-26T15:35:54.763 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:54.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 >> v1:172.21.15.170:6800/17396 conn(0x7fa558048620 legacy=0x7fa55804ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa586218700 1 -- 172.21.15.170:0/1393988794 reap_dead start 2020-01-26T15:35:54.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 msgr2=0x7fa558003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:54.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fa56800c5d0 tx=0x7fa568011370).stop 2020-01-26T15:35:54.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 shutdown_connections 2020-01-26T15:35:54.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 --2- 172.21.15.170:0/1393988794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa558004fb0 0x7fa558003540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:54.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 >> 172.21.15.170:0/1393988794 conn(0x7fa580122460 msgr2=0x7fa58007f260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:54.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 shutdown_connections 2020-01-26T15:35:54.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:54.760+0000 7fa584fb6700 1 -- 172.21.15.170:0/1393988794 wait complete. 2020-01-26T15:35:54.775 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:35:56.793 INFO:tasks.ceph.mds.b.smithi170.stderr:terminate called after throwing an instance of 'ceph::buffer::v14_2_0::end_of_buffer' 2020-01-26T15:35:56.793 INFO:tasks.ceph.mds.b.smithi170.stderr: what(): buffer::end_of_buffer 2020-01-26T15:35:56.794 INFO:tasks.ceph.mds.b.smithi170.stderr:*** Caught signal (Aborted) ** 2020-01-26T15:35:56.794 INFO:tasks.ceph.mds.b.smithi170.stderr: in thread 7f93b51f3700 thread_name:MR_Finisher 2020-01-26T15:35:56.794 INFO:tasks.ceph.mds.b.smithi170.stderr:2020-01-26T15:35:56.792+0000 7f93b51f3700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:35:56.794 INFO:tasks.ceph.mds.b.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 1: (()+0x12890) [0x7f93c23f1890] 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f93c14e9e97] 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 3: (abort()+0x141) [0x7f93c14eb801] 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 4: (()+0x8c957) [0x7f93c1ede957] 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 5: (()+0x92ab6) [0x7f93c1ee4ab6] 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 6: (()+0x92af1) [0x7f93c1ee4af1] 2020-01-26T15:35:56.795 INFO:tasks.ceph.mds.b.smithi170.stderr: 7: (()+0x92d24) [0x7f93c1ee4d24] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 8: (()+0x26a540) [0x7f93c2ad8540] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 9: (()+0x57ff67) [0x7f93c2dedf67] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55bbd9ab645d] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55bbd9ab6df6] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55bbd9ab428c] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55bbd9abcd42] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55bbd9abd021] 2020-01-26T15:35:56.796 INFO:tasks.ceph.mds.b.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f93c2b2c175] 2020-01-26T15:35:56.797 INFO:tasks.ceph.mds.b.smithi170.stderr: 16: (()+0x76db) [0x7f93c23e66db] 2020-01-26T15:35:56.797 INFO:tasks.ceph.mds.b.smithi170.stderr: 17: (clone()+0x3f) [0x7f93c15cc88f] 2020-01-26T15:35:56.797 INFO:tasks.ceph.mds.b.smithi170.stderr:2020-01-26T15:35:56.792+0000 7f93b51f3700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:35:56.797 INFO:tasks.ceph.mds.b.smithi170.stderr: in thread 7f93b51f3700 thread_name:MR_Finisher 2020-01-26T15:35:56.797 INFO:tasks.ceph.mds.b.smithi170.stderr: 2020-01-26T15:35:56.797 INFO:tasks.ceph.mds.b.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:56.798 INFO:tasks.ceph.mds.b.smithi170.stderr: 1: (()+0x12890) [0x7f93c23f1890] 2020-01-26T15:35:56.798 INFO:tasks.ceph.mds.b.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f93c14e9e97] 2020-01-26T15:35:56.798 INFO:tasks.ceph.mds.b.smithi170.stderr: 3: (abort()+0x141) [0x7f93c14eb801] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 4: (()+0x8c957) [0x7f93c1ede957] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 5: (()+0x92ab6) [0x7f93c1ee4ab6] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 6: (()+0x92af1) [0x7f93c1ee4af1] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 7: (()+0x92d24) [0x7f93c1ee4d24] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 8: (()+0x26a540) [0x7f93c2ad8540] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 9: (()+0x57ff67) [0x7f93c2dedf67] 2020-01-26T15:35:56.799 INFO:tasks.ceph.mds.b.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55bbd9ab645d] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55bbd9ab6df6] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55bbd9ab428c] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55bbd9abcd42] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55bbd9abd021] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f93c2b2c175] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 16: (()+0x76db) [0x7f93c23e66db] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: 17: (clone()+0x3f) [0x7f93c15cc88f] 2020-01-26T15:35:56.800 INFO:tasks.ceph.mds.b.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:35:56.801 INFO:tasks.ceph.mds.b.smithi170.stderr: 2020-01-26T15:35:56.802 INFO:tasks.ceph.mds.b.smithi170.stderr: -421> 2020-01-26T15:35:31.220+0000 7f93bea06700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55bbdb581680 0x55bbdc1f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:56.802 INFO:tasks.ceph.mds.b.smithi170.stderr: -283> 2020-01-26T15:35:31.228+0000 7f93bda04700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:56.802 INFO:tasks.ceph.mds.b.smithi170.stderr: -7> 2020-01-26T15:35:56.792+0000 7f93b51f3700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:35:56.802 INFO:tasks.ceph.mds.b.smithi170.stderr: 0> 2020-01-26T15:35:56.792+0000 7f93b51f3700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:35:56.802 INFO:tasks.ceph.mds.b.smithi170.stderr: in thread 7f93b51f3700 thread_name:MR_Finisher 2020-01-26T15:35:56.802 INFO:tasks.ceph.mds.b.smithi170.stderr: 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 1: (()+0x12890) [0x7f93c23f1890] 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f93c14e9e97] 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 3: (abort()+0x141) [0x7f93c14eb801] 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 4: (()+0x8c957) [0x7f93c1ede957] 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 5: (()+0x92ab6) [0x7f93c1ee4ab6] 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 6: (()+0x92af1) [0x7f93c1ee4af1] 2020-01-26T15:35:56.803 INFO:tasks.ceph.mds.b.smithi170.stderr: 7: (()+0x92d24) [0x7f93c1ee4d24] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 8: (()+0x26a540) [0x7f93c2ad8540] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 9: (()+0x57ff67) [0x7f93c2dedf67] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55bbd9ab645d] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55bbd9ab6df6] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55bbd9ab428c] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55bbd9abcd42] 2020-01-26T15:35:56.804 INFO:tasks.ceph.mds.b.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55bbd9abd021] 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f93c2b2c175] 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: 16: (()+0x76db) [0x7f93c23e66db] 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: 17: (clone()+0x3f) [0x7f93c15cc88f] 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: -425> 2020-01-26T15:35:31.220+0000 7f93bea06700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x55bbdb581680 0x55bbdc1f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:56.805 INFO:tasks.ceph.mds.b.smithi170.stderr: -287> 2020-01-26T15:35:31.228+0000 7f93bda04700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: -11> 2020-01-26T15:35:56.792+0000 7f93b51f3700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: -4> 2020-01-26T15:35:56.792+0000 7f93b51f3700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: in thread 7f93b51f3700 thread_name:MR_Finisher 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: 1: (()+0x12890) [0x7f93c23f1890] 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f93c14e9e97] 2020-01-26T15:35:56.806 INFO:tasks.ceph.mds.b.smithi170.stderr: 3: (abort()+0x141) [0x7f93c14eb801] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 4: (()+0x8c957) [0x7f93c1ede957] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 5: (()+0x92ab6) [0x7f93c1ee4ab6] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 6: (()+0x92af1) [0x7f93c1ee4af1] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 7: (()+0x92d24) [0x7f93c1ee4d24] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 8: (()+0x26a540) [0x7f93c2ad8540] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 9: (()+0x57ff67) [0x7f93c2dedf67] 2020-01-26T15:35:56.807 INFO:tasks.ceph.mds.b.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x55bbd9ab645d] 2020-01-26T15:35:56.808 INFO:tasks.ceph.mds.b.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x55bbd9ab6df6] 2020-01-26T15:35:56.808 INFO:tasks.ceph.mds.b.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x55bbd9ab428c] 2020-01-26T15:35:56.808 INFO:tasks.ceph.mds.b.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x55bbd9abcd42] 2020-01-26T15:35:56.808 INFO:tasks.ceph.mds.b.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x55bbd9abd021] 2020-01-26T15:35:56.808 INFO:tasks.ceph.mds.b.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f93c2b2c175] 2020-01-26T15:35:56.809 INFO:tasks.ceph.mds.b.smithi170.stderr: 16: (()+0x76db) [0x7f93c23e66db] 2020-01-26T15:35:56.809 INFO:tasks.ceph.mds.b.smithi170.stderr: 17: (clone()+0x3f) [0x7f93c15cc88f] 2020-01-26T15:35:56.809 INFO:tasks.ceph.mds.b.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:35:56.809 INFO:tasks.ceph.mds.b.smithi170.stderr: 2020-01-26T15:35:56.842 INFO:tasks.ceph.mds.b.smithi170.stderr:daemon-helper: command crashed with signal 6 2020-01-26T15:35:57.777 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:35:57.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 Processor -- start 2020-01-26T15:35:57.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 -- start start 2020-01-26T15:35:57.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f397405e5f0 0x7f39740a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:57.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3974149040 0x7f397414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:35:57.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39740a6dc0 con 0x7f397405edd0 2020-01-26T15:35:57.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f397405ea20 con 0x7f3974149040 2020-01-26T15:35:57.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3973fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3974098000 con 0x7f397405e5f0 2020-01-26T15:35:57.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f39737fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f397405edd0 0x7f397407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43480/0 (socket says 172.21.15.170:43480) 2020-01-26T15:35:57.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f39737fe700 1 -- 172.21.15.170:0/1594462650 learned_addr learned my addr 172.21.15.170:0/1594462650 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3972ffd700 -1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6791/0 conn(0x7f397405e5f0 0x7f39740a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3972ffd700 1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6791/0 conn(0x7f397405e5f0 0x7f39740a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3979479700 -1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6790/0 conn(0x7f3974149040 0x7f397414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f3979479700 1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6790/0 conn(0x7f3974149040 0x7f397414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.888+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871693696 0 0) 0x7f39740a6dc0 con 0x7f397405edd0 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3960003230 con 0x7f397405edd0 2020-01-26T15:35:57.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1199503293 0 0) 0x7f3960003230 con 0x7f397405edd0 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6791/0 conn(0x7f397405e5f0 msgr2=0x7f39740a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6791/0 conn(0x7f397405e5f0 0x7f39740a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6790/0 conn(0x7f3974149040 msgr2=0x7f397414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6790/0 conn(0x7f3974149040 0x7f397414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397405e050 con 0x7f397405edd0 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3964001710 con 0x7f397405edd0 2020-01-26T15:35:57.899 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3964001aa0 con 0x7f397405edd0 2020-01-26T15:35:57.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f39727fc700 1 -- 172.21.15.170:0/1594462650 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3964004760 con 0x7f397405edd0 2020-01-26T15:35:57.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 -- 172.21.15.170:0/1594462650 >> v1:172.21.15.170:6791/0 conn(0x7f397405edd0 legacy=0x7f397407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:57.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 -- 172.21.15.170:0/1594462650 shutdown_connections 2020-01-26T15:35:57.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6790/0 conn(0x7f3974149040 0x7f397414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:57.900 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 --2- 172.21.15.170:0/1594462650 >> v2:172.21.15.170:6791/0 conn(0x7f397405e5f0 0x7f39740a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:35:57.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 -- 172.21.15.170:0/1594462650 >> 172.21.15.170:0/1594462650 conn(0x7f3974098e70 msgr2=0x7f39740a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:57.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 -- 172.21.15.170:0/1594462650 shutdown_connections 2020-01-26T15:35:57.901 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.892+0000 7f3973fff700 1 -- 172.21.15.170:0/1594462650 wait complete. 2020-01-26T15:35:57.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3973fff700 1 Processor -- start 2020-01-26T15:35:57.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3973fff700 1 -- start start 2020-01-26T15:35:57.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3973fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f3974120fd0 0x7f397409ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:57.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3973fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3974121480 con 0x7f3974099cd0 2020-01-26T15:35:57.905 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3973fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39741216b0 con 0x7f39740a4510 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3973fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3974122ec0 con 0x7f3974120fd0 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f39737fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f39740a4510 0x7f39741207d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43486/0 (socket says 172.21.15.170:43486) 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f39737fe700 1 -- 172.21.15.170:0/3919465342 learned_addr learned my addr 172.21.15.170:0/3919465342 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3972ffd700 -1 --2- 172.21.15.170:0/3919465342 >> v2:172.21.15.170:6791/0 conn(0x7f3974120fd0 0x7f397409ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3972ffd700 1 --2- 172.21.15.170:0/3919465342 >> v2:172.21.15.170:6791/0 conn(0x7f3974120fd0 0x7f397409ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308089759 0 0) 0x7f39741216b0 con 0x7f39740a4510 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3958003230 con 0x7f39740a4510 2020-01-26T15:35:57.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803273613 0 0) 0x7f3974121480 con 0x7f3974099cd0 2020-01-26T15:35:57.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39741216b0 con 0x7f3974099cd0 2020-01-26T15:35:57.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1471277483 0 0) 0x7f3958003230 con 0x7f39740a4510 2020-01-26T15:35:57.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3974121480 con 0x7f39740a4510 2020-01-26T15:35:57.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f39640047e0 con 0x7f39740a4510 2020-01-26T15:35:57.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 754577728 0 0) 0x7f39741216b0 con 0x7f3974099cd0 2020-01-26T15:35:57.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3958003230 con 0x7f3974099cd0 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f396c002980 con 0x7f3974099cd0 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 >> v2:172.21.15.170:6791/0 conn(0x7f3974120fd0 msgr2=0x7f397409ded0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 --2- 172.21.15.170:0/3919465342 >> v2:172.21.15.170:6791/0 conn(0x7f3974120fd0 0x7f397409ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 >> v1:172.21.15.170:6791/0 conn(0x7f39740a4510 legacy=0x7f39741207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 >> v1:172.21.15.170:6789/0 conn(0x7f3974099cd0 legacy=0x7f397407b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:35:57.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3974121480 con 0x7f3958004da0 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f39741216b0 con 0x7f3958003ec0 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974122ec0 con 0x7f395800c000 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.896+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722786281 0 0) 0x7f3974121480 con 0x7f3958004da0 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f395800e990 con 0x7f3958004da0 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 -- 172.21.15.170:0/3919465342 >> v1:172.21.15.170:6791/0 conn(0x7f3958003ec0 legacy=0x7f39580045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:57.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 -- 172.21.15.170:0/3919465342 >> v1:172.21.15.170:6790/0 conn(0x7f3958004da0 legacy=0x7f395800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:57.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 -- 172.21.15.170:0/3919465342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f397407c1d0 con 0x7f395800c000 2020-01-26T15:35:57.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39740a4510 con 0x7f395800c000 2020-01-26T15:35:57.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397407c4a0 con 0x7f395800c000 2020-01-26T15:35:57.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:35:57.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f396c012e00 con 0x7f395800c000 2020-01-26T15:35:57.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c005cb0 con 0x7f395800c000 2020-01-26T15:35:57.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f396c00e160 con 0x7f395800c000 2020-01-26T15:35:57.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c003360 con 0x7f395800c000 2020-01-26T15:35:57.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.900+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (secure 0 0 0) 0x7f396c04da90 con 0x7f395800c000 2020-01-26T15:35:57.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.908+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:57.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:57.908+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f396c033be0 con 0x7f395800c000 2020-01-26T15:35:58.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.064+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f394c003790 con 0x7f395800c000 2020-01-26T15:35:58.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.064+0000 7f3979479700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:35:58.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.064+0000 7f396bfff700 1 -- 172.21.15.170:0/3919465342 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f396c033e40 con 0x7f395800c000 2020-01-26T15:35:58.068 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:35:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 >> v1:172.21.15.170:6800/17396 conn(0x7f39580485e0 legacy=0x7f395804aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3979479700 1 -- 172.21.15.170:0/3919465342 reap_dead start 2020-01-26T15:35:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 msgr2=0x7f395800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:35:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f396c002280 tx=0x7f396c0117a0).stop 2020-01-26T15:35:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 shutdown_connections 2020-01-26T15:35:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 --2- 172.21.15.170:0/3919465342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395800c000 0x7f395800e440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:35:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 >> 172.21.15.170:0/3919465342 conn(0x7f397405c110 msgr2=0x7f3974097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:35:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 shutdown_connections 2020-01-26T15:35:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:35:58.068+0000 7f3973fff700 1 -- 172.21.15.170:0/3919465342 wait complete. 2020-01-26T15:35:58.081 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:01.082 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 Processor -- start 2020-01-26T15:36:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 -- start start 2020-01-26T15:36:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a6870 0x7fe10c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c05ea20 con 0x7fe10c05edd0 2020-01-26T15:36:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c098000 con 0x7fe10c05e5f0 2020-01-26T15:36:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c05e050 con 0x7fe10c0a6870 2020-01-26T15:36:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe112059700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a6870 0x7fe10c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10b7fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fe10c05e5f0 0x7fe10c149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43502/0 (socket says 172.21.15.170:43502) 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10bfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe10c05edd0 0x7fe10c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51498/0 (socket says 172.21.15.170:51498) 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10b7fe700 1 -- 172.21.15.170:0/863238855 learned_addr learned my addr 172.21.15.170:0/863238855 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe112059700 1 --2- 172.21.15.170:0/863238855 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a6870 0x7fe10c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476334450 0 0) 0x7fe10c098000 con 0x7fe10c05e5f0 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f4003230 con 0x7fe10c05e5f0 2020-01-26T15:36:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385768055 0 0) 0x7fe10c05ea20 con 0x7fe10c05edd0 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10c098000 con 0x7fe10c05edd0 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1976873851 0 0) 0x7fe0f4003230 con 0x7fe10c05e5f0 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a6870 msgr2=0x7fe10c14c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 --2- 172.21.15.170:0/863238855 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a6870 0x7fe10c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 >> v1:172.21.15.170:6789/0 conn(0x7fe10c05edd0 legacy=0x7fe10c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0a6ca0 con 0x7fe10c05e5f0 2020-01-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe100001710 con 0x7fe10c05e5f0 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe1000019e0 con 0x7fe10c05e5f0 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe10affd700 1 -- 172.21.15.170:0/863238855 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe1000045b0 con 0x7fe10c05e5f0 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.200+0000 7fe110df7700 1 -- 172.21.15.170:0/863238855 >> v1:172.21.15.170:6791/0 conn(0x7fe10c05e5f0 legacy=0x7fe10c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 -- 172.21.15.170:0/863238855 shutdown_connections 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 --2- 172.21.15.170:0/863238855 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a6870 0x7fe10c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 -- 172.21.15.170:0/863238855 >> 172.21.15.170:0/863238855 conn(0x7fe10c098e70 msgr2=0x7fe10c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 -- 172.21.15.170:0/863238855 shutdown_connections 2020-01-26T15:36:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 -- 172.21.15.170:0/863238855 wait complete. 2020-01-26T15:36:01.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 Processor -- start 2020-01-26T15:36:01.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.204+0000 7fe110df7700 1 -- start start 2020-01-26T15:36:01.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a0820 0x7fe10c0799b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:01.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c0a01a0 con 0x7fe10c0a0c50 2020-01-26T15:36:01.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c07a700 con 0x7fe10c130410 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c0a4b70 con 0x7fe10c0a0820 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe10b7fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a0820 0x7fe10c0799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe10b7fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a0820 0x7fe10c0799b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe10bfff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fe10c130410 0x7fe10c0a11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43506/0 (socket says 172.21.15.170:43506) 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe10bfff700 1 -- 172.21.15.170:0/1304582040 learned_addr learned my addr 172.21.15.170:0/1304582040 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232954042 0 0) 0x7fe10c07a700 con 0x7fe10c130410 2020-01-26T15:36:01.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ec003230 con 0x7fe10c130410 2020-01-26T15:36:01.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489925802 0 0) 0x7fe104001210 con 0x7fe10c0a0c50 2020-01-26T15:36:01.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10c07a700 con 0x7fe10c0a0c50 2020-01-26T15:36:01.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 701871570 0 0) 0x7fe0ec003230 con 0x7fe10c130410 2020-01-26T15:36:01.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe104001210 con 0x7fe10c130410 2020-01-26T15:36:01.216 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe0fc0018f0 con 0x7fe10c130410 2020-01-26T15:36:01.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 221602817 0 0) 0x7fe10c07a700 con 0x7fe10c0a0c50 2020-01-26T15:36:01.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0ec003230 con 0x7fe10c0a0c50 2020-01-26T15:36:01.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe104001b80 con 0x7fe10c0a0c50 2020-01-26T15:36:01.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 416777627 0 0) 0x7fe104001210 con 0x7fe10c130410 2020-01-26T15:36:01.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a0820 msgr2=0x7fe10c0799b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:01.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 --2- 172.21.15.170:0/1304582040 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a0820 0x7fe10c0799b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 >> v1:172.21.15.170:6790/0 conn(0x7fe10c0a0c50 legacy=0x7fe10c079f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0a4690 con 0x7fe10c130410 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c0247b0 con 0x7fe10c130410 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c024cb0 con 0x7fe10c130410 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe0fc0048a0 con 0x7fe10c130410 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe0fc004cc0 con 0x7fe10c130410 2020-01-26T15:36:01.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.208+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e4003360 con 0x7fe10c130410 2020-01-26T15:36:01.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.212+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fe0fc004ec0 con 0x7fe10c130410 2020-01-26T15:36:01.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.212+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (unknown 1549382524 0 0) 0x7fe0fc04ba00 con 0x7fe10c130410 2020-01-26T15:36:01.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.216+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fe0fc030fb0 con 0x7fe10c130410 2020-01-26T15:36:01.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.376+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe0e40037d0 con 0x7fe10c130410 2020-01-26T15:36:01.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.376+0000 7fe108ff9700 1 -- 172.21.15.170:0/1304582040 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fe0fc04a6a0 con 0x7fe10c130410 2020-01-26T15:36:01.379 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:01.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.376+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 >> v1:172.21.15.170:6800/17396 conn(0x7fe0ec0407a0 legacy=0x7fe0ec042cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:01.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.376+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 >> v1:172.21.15.170:6791/0 conn(0x7fe10c130410 legacy=0x7fe10c0a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:01.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.376+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 shutdown_connections 2020-01-26T15:36:01.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.376+0000 7fe110df7700 1 --2- 172.21.15.170:0/1304582040 >> v2:172.21.15.170:6790/0 conn(0x7fe10c0a0820 0x7fe10c0799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:01.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.380+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 >> 172.21.15.170:0/1304582040 conn(0x7fe10c123100 msgr2=0x7fe10c0a3600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:01.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.380+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 shutdown_connections 2020-01-26T15:36:01.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:01.380+0000 7fe110df7700 1 -- 172.21.15.170:0/1304582040 wait complete. 2020-01-26T15:36:01.392 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:04.393 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.508+0000 7fbb6e876700 1 Processor -- start 2020-01-26T15:36:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.508+0000 7fbb6e876700 1 -- start start 2020-01-26T15:36:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fbb680a5750 0x7fbb680a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680a5b80 con 0x7fbb6805f250 2020-01-26T15:36:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb68080440 con 0x7fbb680a4b50 2020-01-26T15:36:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbb680a43f0 con 0x7fbb680a5750 2020-01-26T15:36:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6d614700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fbb6805f250 0x7fbb6814bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48392/0 (socket says 172.21.15.170:48392) 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6d614700 1 -- 172.21.15.170:0/2717023351 learned_addr learned my addr 172.21.15.170:0/2717023351 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6ce13700 -1 --2- 172.21.15.170:0/2717023351 >> v2:172.21.15.170:6790/0 conn(0x7fbb680a5750 0x7fbb680a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6ce13700 1 --2- 172.21.15.170:0/2717023351 >> v2:172.21.15.170:6790/0 conn(0x7fbb680a5750 0x7fbb680a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091948305 0 0) 0x7fbb680a5b80 con 0x7fbb6805f250 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb50003230 con 0x7fbb6805f250 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411076849 0 0) 0x7fbb68080440 con 0x7fbb680a4b50 2020-01-26T15:36:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb680a5b80 con 0x7fbb680a4b50 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3056086402 0 0) 0x7fbb50003230 con 0x7fbb6805f250 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 >> v2:172.21.15.170:6790/0 conn(0x7fbb680a5750 msgr2=0x7fbb680a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 --2- 172.21.15.170:0/2717023351 >> v2:172.21.15.170:6790/0 conn(0x7fbb680a5750 0x7fbb680a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 >> v1:172.21.15.170:6791/0 conn(0x7fbb680a4b50 legacy=0x7fbb6805ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680a3210 con 0x7fbb6805f250 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbb60001710 con 0x7fbb6805f250 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbb60001910 con 0x7fbb6805f250 2020-01-26T15:36:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb677fe700 1 -- 172.21.15.170:0/2717023351 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbb600045b0 con 0x7fbb6805f250 2020-01-26T15:36:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- 172.21.15.170:0/2717023351 >> v1:172.21.15.170:6790/0 conn(0x7fbb6805f250 legacy=0x7fbb6814bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- 172.21.15.170:0/2717023351 shutdown_connections 2020-01-26T15:36:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 --2- 172.21.15.170:0/2717023351 >> v2:172.21.15.170:6790/0 conn(0x7fbb680a5750 0x7fbb680a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- 172.21.15.170:0/2717023351 >> 172.21.15.170:0/2717023351 conn(0x7fbb6805e050 msgr2=0x7fbb68098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- 172.21.15.170:0/2717023351 shutdown_connections 2020-01-26T15:36:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.512+0000 7fbb6e876700 1 -- 172.21.15.170:0/2717023351 wait complete. 2020-01-26T15:36:04.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6e876700 1 Processor -- start 2020-01-26T15:36:04.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6e876700 1 -- start start 2020-01-26T15:36:04.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6e876700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fbb6811d010 0x7fbb6811d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:04.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6e876700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6811d990 con 0x7fbb6811e8c0 2020-01-26T15:36:04.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6e876700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6812da10 con 0x7fbb6812cde0 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6e876700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6811ecf0 con 0x7fbb6811d010 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6d614700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fbb6812cde0 0x7fbb6812d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43522/0 (socket says 172.21.15.170:43522) 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb6d614700 1 -- 172.21.15.170:0/792318850 learned_addr learned my addr 172.21.15.170:0/792318850 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 -1 --2- 172.21.15.170:0/792318850 >> v2:172.21.15.170:6790/0 conn(0x7fbb6811d010 0x7fbb6811d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> v2:172.21.15.170:6790/0 conn(0x7fbb6811d010 0x7fbb6811d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425911574 0 0) 0x7fbb6812da10 con 0x7fbb6812cde0 2020-01-26T15:36:04.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb48003230 con 0x7fbb6812cde0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483932765 0 0) 0x7fbb58001260 con 0x7fbb6811e8c0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb6812da10 con 0x7fbb6811e8c0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3313311727 0 0) 0x7fbb48003230 con 0x7fbb6812cde0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb58001260 con 0x7fbb6812cde0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbb60001ae0 con 0x7fbb6812cde0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 595283227 0 0) 0x7fbb6812da10 con 0x7fbb6811e8c0 2020-01-26T15:36:04.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb48003230 con 0x7fbb6811e8c0 2020-01-26T15:36:04.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbb58001c50 con 0x7fbb6811e8c0 2020-01-26T15:36:04.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 >> v2:172.21.15.170:6790/0 conn(0x7fbb6811d010 msgr2=0x7fbb6811d440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:04.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 --2- 172.21.15.170:0/792318850 >> v2:172.21.15.170:6790/0 conn(0x7fbb6811d010 0x7fbb6811d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:04.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 >> v1:172.21.15.170:6791/0 conn(0x7fbb6812cde0 legacy=0x7fbb6812d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 >> v1:172.21.15.170:6789/0 conn(0x7fbb6811e8c0 legacy=0x7fbb6807ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbb6812da10 con 0x7fbb4800ad40 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbb48004270 con 0x7fbb48004f20 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6811ecf0 con 0x7fbb48003d40 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543099025 0 0) 0x7fbb48004270 con 0x7fbb48004f20 2020-01-26T15:36:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb4800e990 con 0x7fbb48004f20 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855853667 0 0) 0x7fbb6812da10 con 0x7fbb4800ad40 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb48004270 con 0x7fbb4800ad40 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 -- 172.21.15.170:0/792318850 >> v1:172.21.15.170:6791/0 conn(0x7fbb48004f20 legacy=0x7fbb48003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 -- 172.21.15.170:0/792318850 >> v1:172.21.15.170:6790/0 conn(0x7fbb4800ad40 legacy=0x7fbb4800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 -- 172.21.15.170:0/792318850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fbb6812dc40 con 0x7fbb48003d40 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.516+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6812cde0 con 0x7fbb48003d40 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6812d110 con 0x7fbb48003d40 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbb5c006c30 con 0x7fbb48003d40 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c00a310 con 0x7fbb48003d40 2020-01-26T15:36:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb40003360 con 0x7fbb48003d40 2020-01-26T15:36:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fbb5c00a500 con 0x7fbb48003d40 2020-01-26T15:36:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.520+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (secure 0 0 0) 0x7fbb5c04cf60 con 0x7fbb48003d40 2020-01-26T15:36:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.524+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.524+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fbb5c0330b0 con 0x7fbb48003d40 2020-01-26T15:36:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.684+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb40003790 con 0x7fbb48003d40 2020-01-26T15:36:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.684+0000 7fbb67fff700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.684+0000 7fbb657fa700 1 -- 172.21.15.170:0/792318850 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fbb5c033310 con 0x7fbb48003d40 2020-01-26T15:36:04.688 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 >> v1:172.21.15.170:6800/17396 conn(0x7fbb480487e0 legacy=0x7fbb4804acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 msgr2=0x7fbb4800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6d614700 1 -- 172.21.15.170:0/792318850 reap_dead start 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fbb5c000f10 tx=0x7fbb5c010900).stop 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 shutdown_connections 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 --2- 172.21.15.170:0/792318850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb48003d40 0x7fbb4800a7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 >> 172.21.15.170:0/792318850 conn(0x7fbb680a5750 msgr2=0x7fbb6805ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 shutdown_connections 2020-01-26T15:36:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:04.688+0000 7fbb6e876700 1 -- 172.21.15.170:0/792318850 wait complete. 2020-01-26T15:36:04.701 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:07.702 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:07.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.816+0000 7f4c586e2700 1 Processor -- start 2020-01-26T15:36:07.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.816+0000 7f4c586e2700 1 -- start start 2020-01-26T15:36:07.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4c50146c30 0x7f4c50149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:07.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500a5b80 con 0x7f4c501495c0 2020-01-26T15:36:07.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c50080440 con 0x7f4c500a5750 2020-01-26T15:36:07.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500a43f0 con 0x7f4c50146c30 2020-01-26T15:36:07.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c56c7f700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f4c500a5750 0x7f4c500a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43534/0 (socket says 172.21.15.170:43534) 2020-01-26T15:36:07.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c56c7f700 1 -- 172.21.15.170:0/2130301831 learned_addr learned my addr 172.21.15.170:0/2130301831 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:07.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c5647e700 -1 --2- 172.21.15.170:0/2130301831 >> v2:172.21.15.170:6790/0 conn(0x7f4c50146c30 0x7f4c50149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:07.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c5647e700 1 --2- 172.21.15.170:0/2130301831 >> v2:172.21.15.170:6790/0 conn(0x7f4c50146c30 0x7f4c50149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:07.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800032441 0 0) 0x7f4c50080440 con 0x7f4c500a5750 2020-01-26T15:36:07.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c003230 con 0x7f4c500a5750 2020-01-26T15:36:07.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074790495 0 0) 0x7f4c500a5b80 con 0x7f4c501495c0 2020-01-26T15:36:07.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c50080440 con 0x7f4c501495c0 2020-01-26T15:36:07.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2564270155 0 0) 0x7f4c50080440 con 0x7f4c501495c0 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 >> v2:172.21.15.170:6790/0 conn(0x7f4c50146c30 msgr2=0x7f4c50149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 --2- 172.21.15.170:0/2130301831 >> v2:172.21.15.170:6790/0 conn(0x7f4c50146c30 0x7f4c50149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 >> v1:172.21.15.170:6791/0 conn(0x7f4c500a5750 legacy=0x7f4c500a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500a4e00 con 0x7f4c501495c0 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4c48001a70 con 0x7f4c501495c0 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4c48001d40 con 0x7f4c501495c0 2020-01-26T15:36:07.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c55c7d700 1 -- 172.21.15.170:0/2130301831 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4c48002160 con 0x7f4c501495c0 2020-01-26T15:36:07.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- 172.21.15.170:0/2130301831 >> v1:172.21.15.170:6790/0 conn(0x7f4c501495c0 legacy=0x7f4c5014ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:07.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- 172.21.15.170:0/2130301831 shutdown_connections 2020-01-26T15:36:07.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 --2- 172.21.15.170:0/2130301831 >> v2:172.21.15.170:6790/0 conn(0x7f4c50146c30 0x7f4c50149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:07.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- 172.21.15.170:0/2130301831 >> 172.21.15.170:0/2130301831 conn(0x7f4c5005e050 msgr2=0x7f4c50098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:07.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- 172.21.15.170:0/2130301831 shutdown_connections 2020-01-26T15:36:07.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- 172.21.15.170:0/2130301831 wait complete. 2020-01-26T15:36:07.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 Processor -- start 2020-01-26T15:36:07.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.820+0000 7f4c586e2700 1 -- start start 2020-01-26T15:36:07.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f4c5007c9e0 0x7f4c5007ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:07.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f4c5007d360 0x7f4c501375e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5007d790 con 0x7f4c50065f20 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5005e050 con 0x7f4c5007d360 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5005f740 con 0x7f4c5007c9e0 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c56c7f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f4c50065f20 0x7f4c500615f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48414/0 (socket says 172.21.15.170:48414) 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c56c7f700 1 -- 172.21.15.170:0/3717508461 learned_addr learned my addr 172.21.15.170:0/3717508461 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c5647e700 -1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6791/0 conn(0x7f4c5007c9e0 0x7f4c5007ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:07.832 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c5647e700 1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6791/0 conn(0x7f4c5007c9e0 0x7f4c5007ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c57480700 -1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6790/0 conn(0x7f4c5007d360 0x7f4c501375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c57480700 1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6790/0 conn(0x7f4c5007d360 0x7f4c501375e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465432723 0 0) 0x7f4c5007d790 con 0x7f4c50065f20 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c38003230 con 0x7f4c50065f20 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 280561835 0 0) 0x7f4c38003230 con 0x7f4c50065f20 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4c5007d790 con 0x7f4c50065f20 2020-01-26T15:36:07.833 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4c4c001910 con 0x7f4c50065f20 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3121135507 0 0) 0x7f4c5007d790 con 0x7f4c50065f20 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6791/0 conn(0x7f4c5007c9e0 msgr2=0x7f4c5007ce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6791/0 conn(0x7f4c5007c9e0 0x7f4c5007ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6790/0 conn(0x7f4c5007d360 msgr2=0x7f4c501375e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6790/0 conn(0x7f4c5007d360 0x7f4c501375e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c50061df0 con 0x7f4c50065f20 2020-01-26T15:36:07.834 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5011fb10 con 0x7f4c50065f20 2020-01-26T15:36:07.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50065af0 con 0x7f4c50065f20 2020-01-26T15:36:07.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4c4c0047a0 con 0x7f4c50065f20 2020-01-26T15:36:07.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4c4c004990 con 0x7f4c50065f20 2020-01-26T15:36:07.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50056600 con 0x7f4c50065f20 2020-01-26T15:36:07.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.824+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f4c4c010450 con 0x7f4c50065f20 2020-01-26T15:36:07.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.828+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (unknown 1549382524 0 0) 0x7f4c4c04bab0 con 0x7f4c50065f20 2020-01-26T15:36:07.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.832+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f4c4c030fa0 con 0x7f4c50065f20 2020-01-26T15:36:07.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c5005cc60 con 0x7f4c50065f20 2020-01-26T15:36:07.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c477fe700 1 -- 172.21.15.170:0/3717508461 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f4c4c04a750 con 0x7f4c50065f20 2020-01-26T15:36:07.990 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:07.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 >> v1:172.21.15.170:6800/17396 conn(0x7f4c3803e170 legacy=0x7f4c38040680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:07.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 >> v1:172.21.15.170:6790/0 conn(0x7f4c50065f20 legacy=0x7f4c500615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:07.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 shutdown_connections 2020-01-26T15:36:07.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6790/0 conn(0x7f4c5007d360 0x7f4c501375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:07.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 --2- 172.21.15.170:0/3717508461 >> v2:172.21.15.170:6791/0 conn(0x7f4c5007c9e0 0x7f4c5007ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:07.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 >> 172.21.15.170:0/3717508461 conn(0x7f4c5005e260 msgr2=0x7f4c5007e120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:07.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 shutdown_connections 2020-01-26T15:36:07.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:07.988+0000 7f4c586e2700 1 -- 172.21.15.170:0/3717508461 wait complete. 2020-01-26T15:36:08.003 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:11.004 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:11.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.116+0000 7f5e17bf2700 1 Processor -- start 2020-01-26T15:36:11.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.116+0000 7f5e17bf2700 1 -- start start 2020-01-26T15:36:11.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f5e100a5750 0x7f5e100a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:11.124 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f5e100a4b50 0x7f5e1005ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:11.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e100a5b80 con 0x7f5e1005efa0 2020-01-26T15:36:11.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100a43f0 con 0x7f5e100a5750 2020-01-26T15:36:11.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100a4f80 con 0x7f5e100a4b50 2020-01-26T15:36:11.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e16990700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f5e1005efa0 0x7f5e1014ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43552/0 (socket says 172.21.15.170:43552) 2020-01-26T15:36:11.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1618f700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f5e100a5750 0x7f5e100a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:11.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1598e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f5e100a4b50 0x7f5e1005ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:11.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e16990700 1 -- 172.21.15.170:0/879076199 learned_addr learned my addr 172.21.15.170:0/879076199 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:11.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1598e700 1 --2- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6791/0 conn(0x7f5e100a4b50 0x7f5e1005ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:11.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1618f700 1 --2- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6790/0 conn(0x7f5e100a5750 0x7f5e100a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:11.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943617245 0 0) 0x7f5e100a5b80 con 0x7f5e1005efa0 2020-01-26T15:36:11.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df8003230 con 0x7f5e1005efa0 2020-01-26T15:36:11.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3727542389 0 0) 0x7f5df8003230 con 0x7f5e1005efa0 2020-01-26T15:36:11.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6791/0 conn(0x7f5e100a4b50 msgr2=0x7f5e1005ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:11.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 --2- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6791/0 conn(0x7f5e100a4b50 0x7f5e1005ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:11.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6790/0 conn(0x7f5e100a5750 msgr2=0x7f5e100a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:11.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 --2- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6790/0 conn(0x7f5e100a5750 0x7f5e100a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:11.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10080440 con 0x7f5e1005efa0 2020-01-26T15:36:11.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f5e08001a90 con 0x7f5e1005efa0 2020-01-26T15:36:11.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5e08001c90 con 0x7f5e1005efa0 2020-01-26T15:36:11.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e1518d700 1 -- 172.21.15.170:0/879076199 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f5e08004930 con 0x7f5e1005efa0 2020-01-26T15:36:11.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- 172.21.15.170:0/879076199 >> v1:172.21.15.170:6791/0 conn(0x7f5e1005efa0 legacy=0x7f5e1014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:11.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- 172.21.15.170:0/879076199 shutdown_connections 2020-01-26T15:36:11.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 --2- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6790/0 conn(0x7f5e100a5750 0x7f5e100a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:11.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 --2- 172.21.15.170:0/879076199 >> v2:172.21.15.170:6791/0 conn(0x7f5e100a4b50 0x7f5e1005ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:11.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- 172.21.15.170:0/879076199 >> 172.21.15.170:0/879076199 conn(0x7f5e1005e050 msgr2=0x7f5e10098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:11.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- 172.21.15.170:0/879076199 shutdown_connections 2020-01-26T15:36:11.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.120+0000 7f5e17bf2700 1 -- 172.21.15.170:0/879076199 wait complete. 2020-01-26T15:36:11.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 Processor -- start 2020-01-26T15:36:11.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 -- start start 2020-01-26T15:36:11.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f5e10133890 0x7f5e1013b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:11.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e100a2090 con 0x7f5e100a1c60 2020-01-26T15:36:11.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e100a23e0 con 0x7f5e10094f10 2020-01-26T15:36:11.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f5e10121ac0 con 0x7f5e10133890 2020-01-26T15:36:11.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e1618f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f5e100a1c60 0x7f5e10094710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48428/0 (socket says 172.21.15.170:48428) 2020-01-26T15:36:11.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e1598e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f5e10094f10 0x7f5e10133090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43554/0 (socket says 172.21.15.170:43554) 2020-01-26T15:36:11.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e16990700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f5e10133890 0x7f5e1013b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e1618f700 1 -- 172.21.15.170:0/2293876553 learned_addr learned my addr 172.21.15.170:0/2293876553 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e16990700 1 --2- 172.21.15.170:0/2293876553 >> v2:172.21.15.170:6790/0 conn(0x7f5e10133890 0x7f5e1013b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672915035 0 0) 0x7f5e100a2090 con 0x7f5e100a1c60 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df0003230 con 0x7f5e100a1c60 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120930953 0 0) 0x7f5e100a23e0 con 0x7f5e10094f10 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e100a2090 con 0x7f5e10094f10 2020-01-26T15:36:11.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1481831671 0 0) 0x7f5df0003230 con 0x7f5e100a1c60 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e100a23e0 con 0x7f5e100a1c60 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f5e00002740 con 0x7f5e100a1c60 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 333094118 0 0) 0x7f5e100a2090 con 0x7f5e10094f10 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5df0003230 con 0x7f5e10094f10 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f5e040016a0 con 0x7f5e10094f10 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2922424918 0 0) 0x7f5e100a23e0 con 0x7f5e100a1c60 2020-01-26T15:36:11.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 >> v2:172.21.15.170:6790/0 conn(0x7f5e10133890 msgr2=0x7f5e1013b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:11.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 --2- 172.21.15.170:0/2293876553 >> v2:172.21.15.170:6790/0 conn(0x7f5e10133890 0x7f5e1013b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:11.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 >> v1:172.21.15.170:6791/0 conn(0x7f5e10094f10 legacy=0x7f5e10133090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:11.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1011f960 con 0x7f5e100a1c60 2020-01-26T15:36:11.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e10133cc0 con 0x7f5e100a1c60 2020-01-26T15:36:11.136 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1013be10 con 0x7f5e100a1c60 2020-01-26T15:36:11.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5e00000e90 con 0x7f5e100a1c60 2020-01-26T15:36:11.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.124+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f5e00001270 con 0x7f5e100a1c60 2020-01-26T15:36:11.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.128+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec003360 con 0x7f5e100a1c60 2020-01-26T15:36:11.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.128+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f5e00001470 con 0x7f5e100a1c60 2020-01-26T15:36:11.137 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.128+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (unknown 1549382524 0 0) 0x7f5e0004b970 con 0x7f5e100a1c60 2020-01-26T15:36:11.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.132+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f5e00030ee0 con 0x7f5e100a1c60 2020-01-26T15:36:11.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.292+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5dec0037d0 con 0x7f5e100a1c60 2020-01-26T15:36:11.295 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.292+0000 7f5e0effd700 1 -- 172.21.15.170:0/2293876553 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f5e0004a610 con 0x7f5e100a1c60 2020-01-26T15:36:11.295 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:11.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 >> v1:172.21.15.170:6800/17396 conn(0x7f5df003e4c0 legacy=0x7f5df00409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:11.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 >> v1:172.21.15.170:6790/0 conn(0x7f5e100a1c60 legacy=0x7f5e10094710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:11.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 shutdown_connections 2020-01-26T15:36:11.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 --2- 172.21.15.170:0/2293876553 >> v2:172.21.15.170:6790/0 conn(0x7f5e10133890 0x7f5e1013b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:11.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 >> 172.21.15.170:0/2293876553 conn(0x7f5e100a4110 msgr2=0x7f5e100a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:11.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 shutdown_connections 2020-01-26T15:36:11.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:11.296+0000 7f5e17bf2700 1 -- 172.21.15.170:0/2293876553 wait complete. 2020-01-26T15:36:11.315 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:11.800 INFO:tasks.ceph.mds.c.smithi170.stderr:2020-01-26T15:36:11.800+0000 7f7d1a83e700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:36:11.804 INFO:tasks.ceph.mds.c.smithi170.stderr:terminate called after throwing an instance of 'ceph::buffer::v14_2_0::end_of_buffer' 2020-01-26T15:36:11.804 INFO:tasks.ceph.mds.c.smithi170.stderr: what(): buffer::end_of_buffer 2020-01-26T15:36:11.805 INFO:tasks.ceph.mds.c.smithi170.stderr:*** Caught signal (Aborted) ** 2020-01-26T15:36:11.805 INFO:tasks.ceph.mds.c.smithi170.stderr: in thread 7f7d1a83e700 thread_name:MR_Finisher 2020-01-26T15:36:11.805 INFO:tasks.ceph.mds.c.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 1: (()+0x12890) [0x7f7d27a3c890] 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f7d26b34e97] 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 3: (abort()+0x141) [0x7f7d26b36801] 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 4: (()+0x8c957) [0x7f7d27529957] 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 5: (()+0x92ab6) [0x7f7d2752fab6] 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 6: (()+0x92af1) [0x7f7d2752faf1] 2020-01-26T15:36:11.806 INFO:tasks.ceph.mds.c.smithi170.stderr: 7: (()+0x92d24) [0x7f7d2752fd24] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 8: (()+0x26a540) [0x7f7d28123540] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 9: (()+0x57ff67) [0x7f7d28438f67] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5558b685c45d] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5558b685cdf6] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5558b685a28c] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x5558b6862d42] 2020-01-26T15:36:11.807 INFO:tasks.ceph.mds.c.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5558b6863021] 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f7d28177175] 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr: 16: (()+0x76db) [0x7f7d27a316db] 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr: 17: (clone()+0x3f) [0x7f7d26c1788f] 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr:2020-01-26T15:36:11.804+0000 7f7d1a83e700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr: in thread 7f7d1a83e700 thread_name:MR_Finisher 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr: 2020-01-26T15:36:11.808 INFO:tasks.ceph.mds.c.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 1: (()+0x12890) [0x7f7d27a3c890] 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f7d26b34e97] 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 3: (abort()+0x141) [0x7f7d26b36801] 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 4: (()+0x8c957) [0x7f7d27529957] 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 5: (()+0x92ab6) [0x7f7d2752fab6] 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 6: (()+0x92af1) [0x7f7d2752faf1] 2020-01-26T15:36:11.809 INFO:tasks.ceph.mds.c.smithi170.stderr: 7: (()+0x92d24) [0x7f7d2752fd24] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 8: (()+0x26a540) [0x7f7d28123540] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 9: (()+0x57ff67) [0x7f7d28438f67] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5558b685c45d] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5558b685cdf6] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5558b685a28c] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x5558b6862d42] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5558b6863021] 2020-01-26T15:36:11.810 INFO:tasks.ceph.mds.c.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f7d28177175] 2020-01-26T15:36:11.811 INFO:tasks.ceph.mds.c.smithi170.stderr: 16: (()+0x76db) [0x7f7d27a316db] 2020-01-26T15:36:11.811 INFO:tasks.ceph.mds.c.smithi170.stderr: 17: (clone()+0x3f) [0x7f7d26c1788f] 2020-01-26T15:36:11.811 INFO:tasks.ceph.mds.c.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:36:11.811 INFO:tasks.ceph.mds.c.smithi170.stderr: 2020-01-26T15:36:11.812 INFO:tasks.ceph.mds.c.smithi170.stderr: -446> 2020-01-26T15:35:31.224+0000 7f7d24051700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x5558b8fb1680 0x5558b9c34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: -442> 2020-01-26T15:35:31.228+0000 7f7d2304f700 -1 --2- 172.21.15.170:0/2286806513 >> v2:172.21.15.170:6791/0 conn(0x5558b8fb1200 0x5558b9c34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: -308> 2020-01-26T15:35:31.232+0000 7f7d23850700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: -45> 2020-01-26T15:36:11.800+0000 7f7d1a83e700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: 0> 2020-01-26T15:36:11.804+0000 7f7d1a83e700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: in thread 7f7d1a83e700 thread_name:MR_Finisher 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: 2020-01-26T15:36:11.813 INFO:tasks.ceph.mds.c.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 1: (()+0x12890) [0x7f7d27a3c890] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f7d26b34e97] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 3: (abort()+0x141) [0x7f7d26b36801] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 4: (()+0x8c957) [0x7f7d27529957] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 5: (()+0x92ab6) [0x7f7d2752fab6] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 6: (()+0x92af1) [0x7f7d2752faf1] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 7: (()+0x92d24) [0x7f7d2752fd24] 2020-01-26T15:36:11.814 INFO:tasks.ceph.mds.c.smithi170.stderr: 8: (()+0x26a540) [0x7f7d28123540] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 9: (()+0x57ff67) [0x7f7d28438f67] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5558b685c45d] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5558b685cdf6] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5558b685a28c] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x5558b6862d42] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5558b6863021] 2020-01-26T15:36:11.815 INFO:tasks.ceph.mds.c.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f7d28177175] 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: 16: (()+0x76db) [0x7f7d27a316db] 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: 17: (clone()+0x3f) [0x7f7d26c1788f] 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: -446> 2020-01-26T15:35:31.224+0000 7f7d24051700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x5558b8fb1680 0x5558b9c34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: -442> 2020-01-26T15:35:31.228+0000 7f7d2304f700 -1 --2- 172.21.15.170:0/2286806513 >> v2:172.21.15.170:6791/0 conn(0x5558b8fb1200 0x5558b9c34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: -308> 2020-01-26T15:35:31.232+0000 7f7d23850700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: -45> 2020-01-26T15:36:11.800+0000 7f7d1a83e700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:36:11.816 INFO:tasks.ceph.mds.c.smithi170.stderr: 0> 2020-01-26T15:36:11.804+0000 7f7d1a83e700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: in thread 7f7d1a83e700 thread_name:MR_Finisher 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: 1: (()+0x12890) [0x7f7d27a3c890] 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: 2: (gsignal()+0xc7) [0x7f7d26b34e97] 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: 3: (abort()+0x141) [0x7f7d26b36801] 2020-01-26T15:36:11.817 INFO:tasks.ceph.mds.c.smithi170.stderr: 4: (()+0x8c957) [0x7f7d27529957] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 5: (()+0x92ab6) [0x7f7d2752fab6] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 6: (()+0x92af1) [0x7f7d2752faf1] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 7: (()+0x92d24) [0x7f7d2752fd24] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 8: (()+0x26a540) [0x7f7d28123540] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 9: (()+0x57ff67) [0x7f7d28438f67] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5558b685c45d] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5558b685cdf6] 2020-01-26T15:36:11.818 INFO:tasks.ceph.mds.c.smithi170.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5558b685a28c] 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: 13: (MDSContext::complete(int)+0x52) [0x5558b6862d42] 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5558b6863021] 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f7d28177175] 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: 16: (()+0x76db) [0x7f7d27a316db] 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: 17: (clone()+0x3f) [0x7f7d26c1788f] 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:36:11.819 INFO:tasks.ceph.mds.c.smithi170.stderr: 2020-01-26T15:36:11.867 INFO:tasks.ceph.mds.c.smithi170.stderr:daemon-helper: command crashed with signal 6 2020-01-26T15:36:14.316 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:14.436 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 Processor -- start 2020-01-26T15:36:14.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- start start 2020-01-26T15:36:14.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe59c14a880 0x7fe59c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:14.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0a5b80 con 0x7fe59c0a5750 2020-01-26T15:36:14.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c080440 con 0x7fe59c146c30 2020-01-26T15:36:14.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0a43f0 con 0x7fe59c14a880 2020-01-26T15:36:14.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59bfff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fe59c146c30 0x7fe59c149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43568/0 (socket says 172.21.15.170:43568) 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59bfff700 1 -- 172.21.15.170:0/3007205961 learned_addr learned my addr 172.21.15.170:0/3007205961 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a1456700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe59c14a880 0x7fe59c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a0c55700 1 --1- 172.21.15.170:0/3007205961 >> v1:172.21.15.170:6790/0 conn(0x7fe59c0a5750 0x7fe59c0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48444/0 (socket says 172.21.15.170:48444) 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a1456700 1 --2- 172.21.15.170:0/3007205961 >> v2:172.21.15.170:6791/0 conn(0x7fe59c14a880 0x7fe59c14ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094671152 0 0) 0x7fe59c080440 con 0x7fe59c146c30 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe584003230 con 0x7fe59c146c30 2020-01-26T15:36:14.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721330969 0 0) 0x7fe59c0a5b80 con 0x7fe59c0a5750 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c080440 con 0x7fe59c0a5750 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3468116634 0 0) 0x7fe584003230 con 0x7fe59c146c30 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 >> v2:172.21.15.170:6791/0 conn(0x7fe59c14a880 msgr2=0x7fe59c14ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 --2- 172.21.15.170:0/3007205961 >> v2:172.21.15.170:6791/0 conn(0x7fe59c14a880 0x7fe59c14ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 >> v1:172.21.15.170:6790/0 conn(0x7fe59c0a5750 legacy=0x7fe59c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0a4e00 con 0x7fe59c146c30 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe590001a90 con 0x7fe59c146c30 2020-01-26T15:36:14.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe590001d60 con 0x7fe59c146c30 2020-01-26T15:36:14.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe59b7fe700 1 -- 172.21.15.170:0/3007205961 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe590004930 con 0x7fe59c146c30 2020-01-26T15:36:14.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- 172.21.15.170:0/3007205961 >> v1:172.21.15.170:6791/0 conn(0x7fe59c146c30 legacy=0x7fe59c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:14.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- 172.21.15.170:0/3007205961 shutdown_connections 2020-01-26T15:36:14.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 --2- 172.21.15.170:0/3007205961 >> v2:172.21.15.170:6791/0 conn(0x7fe59c14a880 0x7fe59c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:14.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- 172.21.15.170:0/3007205961 >> 172.21.15.170:0/3007205961 conn(0x7fe59c05e050 msgr2=0x7fe59c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:14.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- 172.21.15.170:0/3007205961 shutdown_connections 2020-01-26T15:36:14.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.432+0000 7fe5a26b8700 1 -- 172.21.15.170:0/3007205961 wait complete. 2020-01-26T15:36:14.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 Processor -- start 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 -- start start 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe59c12cc80 0x7fe59c060a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe59c12d9c0 0x7fe59c137690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c060fa0 con 0x7fe59c061dd0 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c121980 con 0x7fe59c12d9c0 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a26b8700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0607b0 con 0x7fe59c12cc80 2020-01-26T15:36:14.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.436+0000 7fe5a0c55700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe59c12cc80 0x7fe59c060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5a1456700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe59c12d9c0 0x7fe59c137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe59bfff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe59c061dd0 0x7fe59c12d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48450/0 (socket says 172.21.15.170:48450) 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5a0c55700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe59c12cc80 0x7fe59c060a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe59bfff700 1 -- 172.21.15.170:0/1196188945 learned_addr learned my addr 172.21.15.170:0/1196188945 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5a1456700 1 --2- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6790/0 conn(0x7fe59c12d9c0 0x7fe59c137690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897105188 0 0) 0x7fe59c060fa0 con 0x7fe59c061dd0 2020-01-26T15:36:14.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c003230 con 0x7fe59c061dd0 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1383279458 0 0) 0x7fe57c003230 con 0x7fe59c061dd0 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe59c060fa0 con 0x7fe59c061dd0 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe5900017a0 con 0x7fe59c061dd0 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1141175200 0 0) 0x7fe59c060fa0 con 0x7fe59c061dd0 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6791/0 conn(0x7fe59c12cc80 msgr2=0x7fe59c060a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 --2- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6791/0 conn(0x7fe59c12cc80 0x7fe59c060a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:14.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6790/0 conn(0x7fe59c12d9c0 msgr2=0x7fe59c137690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 --2- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6790/0 conn(0x7fe59c12d9c0 0x7fe59c137690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c1207f0 con 0x7fe59c061dd0 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c062200 con 0x7fe59c061dd0 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c137be0 con 0x7fe59c061dd0 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe590004eb0 con 0x7fe59c061dd0 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe5900050a0 con 0x7fe59c061dd0 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fe590010ae0 con 0x7fe59c061dd0 2020-01-26T15:36:14.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.440+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c056600 con 0x7fe59c061dd0 2020-01-26T15:36:14.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.444+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7fe59004be70 con 0x7fe59c061dd0 2020-01-26T15:36:14.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.448+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fe5900313f0 con 0x7fe59c061dd0 2020-01-26T15:36:14.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.600+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe59c0a45e0 con 0x7fe59c061dd0 2020-01-26T15:36:14.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5997fa700 1 -- 172.21.15.170:0/1196188945 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fe590031fa0 con 0x7fe59c061dd0 2020-01-26T15:36:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 >> v1:172.21.15.170:6800/17396 conn(0x7fe57c03e050 legacy=0x7fe57c040560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 >> v1:172.21.15.170:6790/0 conn(0x7fe59c061dd0 legacy=0x7fe59c12d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 shutdown_connections 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 --2- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6790/0 conn(0x7fe59c12d9c0 0x7fe59c137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 --2- 172.21.15.170:0/1196188945 >> v2:172.21.15.170:6791/0 conn(0x7fe59c12cc80 0x7fe59c060a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 >> 172.21.15.170:0/1196188945 conn(0x7fe59c0979c0 msgr2=0x7fe59c123d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:14.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 shutdown_connections 2020-01-26T15:36:14.608 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:14.604+0000 7fe5a26b8700 1 -- 172.21.15.170:0/1196188945 wait complete. 2020-01-26T15:36:14.624 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:17.625 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:17.753 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 Processor -- start 2020-01-26T15:36:17.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 -- start start 2020-01-26T15:36:17.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b7c0a5750 0x7f8b7c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:17.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b7c05f250 0x7f8b7c14bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:17.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c0a5b80 con 0x7f8b7c0a4b50 2020-01-26T15:36:17.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c0a43f0 con 0x7f8b7c0a5750 2020-01-26T15:36:17.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b80d25700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c0a4f80 con 0x7f8b7c05f250 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b7b59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b7c05f250 0x7f8b7c14bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b7b59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b7c05f250 0x7f8b7c14bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b7ad9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b7c0a5750 0x7f8b7c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b7a59c700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8b7c0a4b50 0x7f8b7c05ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51584/0 (socket says 172.21.15.170:51584) 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b7a59c700 1 -- 172.21.15.170:0/4124640148 learned_addr learned my addr 172.21.15.170:0/4124640148 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b7ad9d700 1 --2- 172.21.15.170:0/4124640148 >> v2:172.21.15.170:6790/0 conn(0x7f8b7c0a5750 0x7f8b7c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:17.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555669749 0 0) 0x7f8b7c0a5b80 con 0x7f8b7c0a4b50 2020-01-26T15:36:17.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.740+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b64003230 con 0x7f8b7c0a4b50 2020-01-26T15:36:17.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2423193856 0 0) 0x7f8b64003230 con 0x7f8b7c0a4b50 2020-01-26T15:36:17.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 >> v2:172.21.15.170:6791/0 conn(0x7f8b7c05f250 msgr2=0x7f8b7c14bc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:17.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 --2- 172.21.15.170:0/4124640148 >> v2:172.21.15.170:6791/0 conn(0x7f8b7c05f250 0x7f8b7c14bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:17.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 >> v2:172.21.15.170:6790/0 conn(0x7f8b7c0a5750 msgr2=0x7f8b7c0a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:17.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 --2- 172.21.15.170:0/4124640148 >> v2:172.21.15.170:6790/0 conn(0x7f8b7c0a5750 0x7f8b7c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:17.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c080440 con 0x7f8b7c0a4b50 2020-01-26T15:36:17.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8b70001710 con 0x7f8b7c0a4b50 2020-01-26T15:36:17.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 >> v1:172.21.15.170:6789/0 conn(0x7f8b7c0a4b50 legacy=0x7f8b7c05ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b64003230 con 0x7f8b64003860 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b7c0a5b80 con 0x7f8b6400a310 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0a43f0 con 0x7f8b640077d0 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 -- 172.21.15.170:0/4124640148 >> v1:172.21.15.170:6791/0 conn(0x7f8b6400a310 legacy=0x7f8b6400c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 -- 172.21.15.170:0/4124640148 >> v1:172.21.15.170:6790/0 conn(0x7f8b64003860 legacy=0x7f8b64003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 -- 172.21.15.170:0/4124640148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64054470 con 0x7f8b640077d0 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7b59e700 1 -- 172.21.15.170:0/4124640148 reap_dead start 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).ready entity=mon.0 client_cookie=bd46a924defda309 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b70005790 con 0x7f8b640077d0 2020-01-26T15:36:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70005990 con 0x7f8b640077d0 2020-01-26T15:36:17.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b79d9b700 1 -- 172.21.15.170:0/4124640148 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b70005d70 con 0x7f8b640077d0 2020-01-26T15:36:17.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 -- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 msgr2=0x7f8b64009c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f8b70000fc0 tx=0x7f8b7000c240).stop 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 -- 172.21.15.170:0/4124640148 shutdown_connections 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 --2- 172.21.15.170:0/4124640148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b640077d0 0x7f8b64009c90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 -- 172.21.15.170:0/4124640148 >> 172.21.15.170:0/4124640148 conn(0x7f8b7c05e050 msgr2=0x7f8b7c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 -- 172.21.15.170:0/4124640148 shutdown_connections 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.744+0000 7f8b80d25700 1 -- 172.21.15.170:0/4124640148 wait complete. 2020-01-26T15:36:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b80d25700 1 Processor -- start 2020-01-26T15:36:17.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b80d25700 1 -- start start 2020-01-26T15:36:17.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b80d25700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b7c11d720 0x7f8b7c11eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:17.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b80d25700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c11db50 con 0x7f8b7c11e6a0 2020-01-26T15:36:17.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b80d25700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c12df20 con 0x7f8b7c12daf0 2020-01-26T15:36:17.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b80d25700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c0651d0 con 0x7f8b7c11d720 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b7ad9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b7c11d720 0x7f8b7c11eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b7ad9d700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b7c11d720 0x7f8b7c11eeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b7b59e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8b7c11e6a0 0x7f8b7c138420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51594/0 (socket says 172.21.15.170:51594) 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b7b59e700 1 -- 172.21.15.170:0/3605350774 learned_addr learned my addr 172.21.15.170:0/3605350774 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018809390 0 0) 0x7f8b7c11db50 con 0x7f8b7c11e6a0 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b60003230 con 0x7f8b7c11e6a0 2020-01-26T15:36:17.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415333626 0 0) 0x7f8b7c12df20 con 0x7f8b7c12daf0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c11db50 con 0x7f8b7c12daf0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1519274786 0 0) 0x7f8b7c11db50 con 0x7f8b7c12daf0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b7c12df20 con 0x7f8b7c12daf0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 136957785 0 0) 0x7f8b60003230 con 0x7f8b7c11e6a0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b7c11db50 con 0x7f8b7c11e6a0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8b70010160 con 0x7f8b7c12daf0 2020-01-26T15:36:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8b74001860 con 0x7f8b7c11e6a0 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 >> v2:172.21.15.170:6790/0 conn(0x7f8b7c11d720 msgr2=0x7f8b7c11eeb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 --2- 172.21.15.170:0/3605350774 >> v2:172.21.15.170:6790/0 conn(0x7f8b7c11d720 0x7f8b7c11eeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 >> v1:172.21.15.170:6791/0 conn(0x7f8b7c12daf0 legacy=0x7f8b7c12e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 >> v1:172.21.15.170:6789/0 conn(0x7f8b7c11e6a0 legacy=0x7f8b7c138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b60003230 con 0x7f8b6000ad40 2020-01-26T15:36:17.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b60004330 con 0x7f8b60004fd0 2020-01-26T15:36:17.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0651d0 con 0x7f8b60003d40 2020-01-26T15:36:17.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:17.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.748+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327349304 0 0) 0x7f8b64003230 con 0x7f8b60004fd0 2020-01-26T15:36:17.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b6000e990 con 0x7f8b60004fd0 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917838244 0 0) 0x7f8b60003230 con 0x7f8b6000ad40 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b64003230 con 0x7f8b6000ad40 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 -- 172.21.15.170:0/3605350774 >> v1:172.21.15.170:6791/0 conn(0x7f8b60004fd0 legacy=0x7f8b60003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 -- 172.21.15.170:0/3605350774 >> v1:172.21.15.170:6790/0 conn(0x7f8b6000ad40 legacy=0x7f8b6000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 -- 172.21.15.170:0/3605350774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f8b7c11ead0 con 0x7f8b60003d40 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c1228c0 con 0x7f8b60003d40 2020-01-26T15:36:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c12daf0 con 0x7f8b60003d40 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b70005be0 con 0x7f8b60003d40 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70005de0 con 0x7f8b60003d40 2020-01-26T15:36:17.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b54003360 con 0x7f8b60003d40 2020-01-26T15:36:17.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8b7000d0b0 con 0x7f8b60003d40 2020-01-26T15:36:17.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.752+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f8b7004dfc0 con 0x7f8b60003d40 2020-01-26T15:36:17.770 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.760+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.771 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.760+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8b70034170 con 0x7f8b60003d40 2020-01-26T15:36:17.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.908+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8b54003790 con 0x7f8b60003d40 2020-01-26T15:36:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.908+0000 7f8b7a59c700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.908+0000 7f8b6b7fe700 1 -- 172.21.15.170:0/3605350774 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8b700343d0 con 0x7f8b60003d40 2020-01-26T15:36:17.912 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:17.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 >> v1:172.21.15.170:6800/17396 conn(0x7f8b60048840 legacy=0x7f8b6004ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 msgr2=0x7f8b6000a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:17.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b7b59e700 1 -- 172.21.15.170:0/3605350774 reap_dead start 2020-01-26T15:36:17.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f8b7c096ac0 tx=0x7f8b70005830).stop 2020-01-26T15:36:17.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 shutdown_connections 2020-01-26T15:36:17.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 --2- 172.21.15.170:0/3605350774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b60003d40 0x7f8b6000a7f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:17.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 >> 172.21.15.170:0/3605350774 conn(0x7f8b7c0a56b0 msgr2=0x7f8b7c124e30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:17.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 shutdown_connections 2020-01-26T15:36:17.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:17.912+0000 7f8b80d25700 1 -- 172.21.15.170:0/3605350774 wait complete. 2020-01-26T15:36:17.924 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:20.925 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:21.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 Processor -- start 2020-01-26T15:36:21.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 -- start start 2020-01-26T15:36:21.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f09c805edd0 0x7f09c805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:21.043 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f09c8149040 0x7f09c814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c8098000 con 0x7f09c80a6870 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f09c805e050 con 0x7f09c8149040 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.036+0000 7f09ccdfd700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f09c80a6ca0 con 0x7f09c805edd0 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c7fff700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f09c805edd0 0x7f09c805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c7fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f09c805edd0 0x7f09c805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c77fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f09c80a6870 0x7f09c807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43608/0 (socket says 172.21.15.170:43608) 2020-01-26T15:36:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c77fe700 1 -- 172.21.15.170:0/1525874523 learned_addr learned my addr 172.21.15.170:0/1525874523 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ce05f700 -1 --2- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6790/0 conn(0x7f09c8149040 0x7f09c814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ce05f700 1 --2- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6790/0 conn(0x7f09c8149040 0x7f09c814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060543190 0 0) 0x7f09c8098000 con 0x7f09c80a6870 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b4003230 con 0x7f09c80a6870 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2403423371 0 0) 0x7f09b4003230 con 0x7f09c80a6870 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6791/0 conn(0x7f09c805edd0 msgr2=0x7f09c805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:21.045 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 --2- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6791/0 conn(0x7f09c805edd0 0x7f09c805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6790/0 conn(0x7f09c8149040 msgr2=0x7f09c814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 --2- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6790/0 conn(0x7f09c8149040 0x7f09c814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c814c9e0 con 0x7f09c80a6870 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f09b8001710 con 0x7f09c80a6870 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f09b8001aa0 con 0x7f09c80a6870 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09c6ffd700 1 -- 172.21.15.170:0/1525874523 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f09b8004760 con 0x7f09c80a6870 2020-01-26T15:36:21.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 -- 172.21.15.170:0/1525874523 >> v1:172.21.15.170:6791/0 conn(0x7f09c80a6870 legacy=0x7f09c807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:21.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 -- 172.21.15.170:0/1525874523 shutdown_connections 2020-01-26T15:36:21.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 --2- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6790/0 conn(0x7f09c8149040 0x7f09c814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:21.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 --2- 172.21.15.170:0/1525874523 >> v2:172.21.15.170:6791/0 conn(0x7f09c805edd0 0x7f09c805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:21.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 -- 172.21.15.170:0/1525874523 >> 172.21.15.170:0/1525874523 conn(0x7f09c8098e70 msgr2=0x7f09c80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:21.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 -- 172.21.15.170:0/1525874523 shutdown_connections 2020-01-26T15:36:21.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.040+0000 7f09ccdfd700 1 -- 172.21.15.170:0/1525874523 wait complete. 2020-01-26T15:36:21.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 Processor -- start 2020-01-26T15:36:21.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 -- start start 2020-01-26T15:36:21.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f09c8121120 0x7f09c8099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:21.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f09c811e7c0 0x7f09c81373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:21.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c811f6c0 con 0x7f09c8099ff0 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f09c811f1e0 con 0x7f09c811e7c0 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f09c8121550 con 0x7f09c8121120 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c77fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f09c8099ff0 0x7f09c811dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51612/0 (socket says 172.21.15.170:51612) 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c77fe700 1 -- 172.21.15.170:0/2152064515 learned_addr learned my addr 172.21.15.170:0/2152064515 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c7fff700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f09c8121120 0x7f09c8099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c7fff700 1 --2- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6791/0 conn(0x7f09c8121120 0x7f09c8099aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:21.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 -1 --2- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6790/0 conn(0x7f09c811e7c0 0x7f09c81373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6790/0 conn(0x7f09c811e7c0 0x7f09c81373b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982086654 0 0) 0x7f09c811f6c0 con 0x7f09c8099ff0 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac003230 con 0x7f09c8099ff0 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4126456797 0 0) 0x7f09ac003230 con 0x7f09c8099ff0 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f09c811f6c0 con 0x7f09c8099ff0 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f09b8001420 con 0x7f09c8099ff0 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6791/0 conn(0x7f09c8121120 msgr2=0x7f09c8099aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:21.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 --2- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6791/0 conn(0x7f09c8121120 0x7f09c8099aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6790/0 conn(0x7f09c811e7c0 msgr2=0x7f09c81373b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 --2- 172.21.15.170:0/2152064515 >> v2:172.21.15.170:6790/0 conn(0x7f09c811e7c0 0x7f09c81373b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 >> v1:172.21.15.170:6789/0 conn(0x7f09c8099ff0 legacy=0x7f09c811dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f09ac003230 con 0x7f09ac003b20 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f09ac00f3a0 con 0x7f09ac003fd0 2020-01-26T15:36:21.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c811f1e0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:21.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382669824 0 0) 0x7f09ac003230 con 0x7f09ac003b20 2020-01-26T15:36:21.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac00f5d0 con 0x7f09ac003b20 2020-01-26T15:36:21.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161867481 0 0) 0x7f09ac00f3a0 con 0x7f09ac003fd0 2020-01-26T15:36:21.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac003230 con 0x7f09ac003fd0 2020-01-26T15:36:21.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 -- 172.21.15.170:0/2152064515 >> v1:172.21.15.170:6791/0 conn(0x7f09ac003fd0 legacy=0x7f09ac004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 -- 172.21.15.170:0/2152064515 >> v1:172.21.15.170:6790/0 conn(0x7f09ac003b20 legacy=0x7f09ac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 -- 172.21.15.170:0/2152064515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c811fcc0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c8120cf0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c80a4c80 con 0x7f09ac00b7a0 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 -- 172.21.15.170:0/2152064515 reap_dead start 2020-01-26T15:36:21.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f09c000e9a0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000eba0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.059 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.044+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f09c0009170 con 0x7f09ac00b7a0 2020-01-26T15:36:21.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.048+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.048+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a0003360 con 0x7f09ac00b7a0 2020-01-26T15:36:21.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.048+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f09c0009440 con 0x7f09ac00b7a0 2020-01-26T15:36:21.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.048+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.048+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f09c004ddb0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.052+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.052+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f09c80a4c80 con 0x7f09ac00b7a0 2020-01-26T15:36:21.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.208+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f09a0003790 con 0x7f09ac00b7a0 2020-01-26T15:36:21.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.208+0000 7f09ce05f700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:21.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.208+0000 7f09c4ff9700 1 -- 172.21.15.170:0/2152064515 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f09c0033ee0 con 0x7f09ac00b7a0 2020-01-26T15:36:21.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 >> v1:172.21.15.170:6800/17396 conn(0x7f09ac040cb0 legacy=0x7f09ac0431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:21.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 msgr2=0x7f09ac00dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:21.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f09c00032b0 tx=0x7f09c0010cc0).stop 2020-01-26T15:36:21.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 shutdown_connections 2020-01-26T15:36:21.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 --2- 172.21.15.170:0/2152064515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09ac00b7a0 0x7f09ac00dc90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:21.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 >> 172.21.15.170:0/2152064515 conn(0x7f09c8122880 msgr2=0x7f09c807f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:21.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 shutdown_connections 2020-01-26T15:36:21.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:21.212+0000 7f09ccdfd700 1 -- 172.21.15.170:0/2152064515 wait complete. 2020-01-26T15:36:21.216 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:21.224 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:24.225 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:24.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 Processor -- start 2020-01-26T15:36:24.349 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 -- start start 2020-01-26T15:36:24.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2d640a5750 0x7f2d640a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:24.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d640a5b80 con 0x7f2d6405f250 2020-01-26T15:36:24.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d64080440 con 0x7f2d640a4b50 2020-01-26T15:36:24.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640a43f0 con 0x7f2d640a5750 2020-01-26T15:36:24.350 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6ad7d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2d640a5750 0x7f2d640a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6ad7d700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2d640a5750 0x7f2d640a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6b57e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2d6405f250 0x7f2d6414bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51632/0 (socket says 172.21.15.170:51632) 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6b57e700 1 -- 172.21.15.170:0/3236406803 learned_addr learned my addr 172.21.15.170:0/3236406803 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503811286 0 0) 0x7f2d640a5b80 con 0x7f2d6405f250 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d50003230 con 0x7f2d6405f250 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228994219 0 0) 0x7f2d64080440 con 0x7f2d640a4b50 2020-01-26T15:36:24.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d640a5b80 con 0x7f2d640a4b50 2020-01-26T15:36:24.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1617813550 0 0) 0x7f2d640a5b80 con 0x7f2d640a4b50 2020-01-26T15:36:24.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 >> v2:172.21.15.170:6791/0 conn(0x7f2d640a5750 msgr2=0x7f2d640a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:24.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 --2- 172.21.15.170:0/3236406803 >> v2:172.21.15.170:6791/0 conn(0x7f2d640a5750 0x7f2d640a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:24.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 >> v1:172.21.15.170:6789/0 conn(0x7f2d6405f250 legacy=0x7f2d6414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:24.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640a3210 con 0x7f2d640a4b50 2020-01-26T15:36:24.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2d54001a70 con 0x7f2d640a4b50 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2d54001d40 con 0x7f2d640a4b50 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d69d7b700 1 -- 172.21.15.170:0/3236406803 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2d540021a0 con 0x7f2d640a4b50 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.340+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/3236406803 >> v1:172.21.15.170:6791/0 conn(0x7f2d640a4b50 legacy=0x7f2d6405ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/3236406803 shutdown_connections 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 --2- 172.21.15.170:0/3236406803 >> v2:172.21.15.170:6791/0 conn(0x7f2d640a5750 0x7f2d640a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/3236406803 >> 172.21.15.170:0/3236406803 conn(0x7f2d6405e050 msgr2=0x7f2d64098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:24.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/3236406803 shutdown_connections 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/3236406803 wait complete. 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 Processor -- start 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- start start 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2d6411cc40 0x7f2d64120890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6407ade0 con 0x7f2d640a2670 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d64120de0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6c7e0700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6411d970 con 0x7f2d6411cc40 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6b57e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f2d6407a2f0 0x7f2d64138bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43638/0 (socket says 172.21.15.170:43638) 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6b57e700 1 -- 172.21.15.170:0/1719989668 learned_addr learned my addr 172.21.15.170:0/1719989668 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6a57c700 -1 --2- 172.21.15.170:0/1719989668 >> v2:172.21.15.170:6790/0 conn(0x7f2d6411cc40 0x7f2d64120890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d6a57c700 1 --2- 172.21.15.170:0/1719989668 >> v2:172.21.15.170:6790/0 conn(0x7f2d6411cc40 0x7f2d64120890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776825942 0 0) 0x7f2d64120de0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d48003230 con 0x7f2d6407a2f0 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321089274 0 0) 0x7f2d6407ade0 con 0x7f2d640a2670 2020-01-26T15:36:24.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.344+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d64120de0 con 0x7f2d640a2670 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1796342407 0 0) 0x7f2d64120de0 con 0x7f2d640a2670 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d6407ade0 con 0x7f2d640a2670 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2d5c0015d0 con 0x7f2d640a2670 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1400902369 0 0) 0x7f2d48003230 con 0x7f2d6407a2f0 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d64120de0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2d4c001810 con 0x7f2d6407a2f0 2020-01-26T15:36:24.356 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2709998095 0 0) 0x7f2d64120de0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 >> v2:172.21.15.170:6790/0 conn(0x7f2d6411cc40 msgr2=0x7f2d64120890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:24.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 --2- 172.21.15.170:0/1719989668 >> v2:172.21.15.170:6790/0 conn(0x7f2d6411cc40 0x7f2d64120890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:24.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 >> v1:172.21.15.170:6790/0 conn(0x7f2d640a2670 legacy=0x7f2d64079af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:24.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6411d070 con 0x7f2d6407a2f0 2020-01-26T15:36:24.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d640a0cb0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.357 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6411e3a0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2d4c0044f0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2d4c004890 con 0x7f2d6407a2f0 2020-01-26T15:36:24.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c003360 con 0x7f2d6407a2f0 2020-01-26T15:36:24.358 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.348+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f2d4c0102d0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.352+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f2d4c04b890 con 0x7f2d6407a2f0 2020-01-26T15:36:24.359 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.356+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f2d6411e3a0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.512+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2d3c0037d0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.515 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.512+0000 7f2d637fe700 1 -- 172.21.15.170:0/1719989668 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f2d4c030db0 con 0x7f2d6407a2f0 2020-01-26T15:36:24.515 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 >> v1:172.21.15.170:6800/17396 conn(0x7f2d4803e720 legacy=0x7f2d48040c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 >> v1:172.21.15.170:6791/0 conn(0x7f2d6407a2f0 legacy=0x7f2d64138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 shutdown_connections 2020-01-26T15:36:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 --2- 172.21.15.170:0/1719989668 >> v2:172.21.15.170:6790/0 conn(0x7f2d6411cc40 0x7f2d64120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 >> 172.21.15.170:0/1719989668 conn(0x7f2d640a5670 msgr2=0x7f2d6407e760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 shutdown_connections 2020-01-26T15:36:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:24.516+0000 7f2d6c7e0700 1 -- 172.21.15.170:0/1719989668 wait complete. 2020-01-26T15:36:24.534 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:27.535 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:27.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 Processor -- start 2020-01-26T15:36:27.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 -- start start 2020-01-26T15:36:27.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b6805edd0 0x7f8b6805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:27.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b68149040 0x7f8b6814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:27.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b68098000 con 0x7f8b680a6870 2020-01-26T15:36:27.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6805e050 con 0x7f8b68149040 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6d028700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8b680a6ca0 con 0x7f8b6805edd0 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6c827700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b6805edd0 0x7f8b6805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6e28a700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8b68149040 0x7f8b6814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b67fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8b680a6870 0x7f8b6807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51646/0 (socket says 172.21.15.170:51646) 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b67fff700 1 -- 172.21.15.170:0/3164451818 learned_addr learned my addr 172.21.15.170:0/3164451818 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3164451818 >> v2:172.21.15.170:6790/0 conn(0x7f8b68149040 0x7f8b6814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:27.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.648+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> v2:172.21.15.170:6791/0 conn(0x7f8b6805edd0 0x7f8b6805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:27.659 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014651324 0 0) 0x7f8b68098000 con 0x7f8b680a6870 2020-01-26T15:36:27.659 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b50003230 con 0x7f8b680a6870 2020-01-26T15:36:27.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 166289308 0 0) 0x7f8b50003230 con 0x7f8b680a6870 2020-01-26T15:36:27.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 >> v2:172.21.15.170:6791/0 conn(0x7f8b6805edd0 msgr2=0x7f8b6805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:27.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 --2- 172.21.15.170:0/3164451818 >> v2:172.21.15.170:6791/0 conn(0x7f8b6805edd0 0x7f8b6805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:27.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 >> v2:172.21.15.170:6790/0 conn(0x7f8b68149040 msgr2=0x7f8b6814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:27.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 --2- 172.21.15.170:0/3164451818 >> v2:172.21.15.170:6790/0 conn(0x7f8b68149040 0x7f8b6814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:27.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6814c9e0 con 0x7f8b680a6870 2020-01-26T15:36:27.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8b5c001710 con 0x7f8b680a6870 2020-01-26T15:36:27.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 >> v1:172.21.15.170:6789/0 conn(0x7f8b680a6870 legacy=0x7f8b6807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.662 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b50003230 con 0x7f8b500045a0 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b68098000 con 0x7f8b5000a7f0 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6805e050 con 0x7f8b50003860 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603338905 0 0) 0x7f8b50003230 con 0x7f8b500045a0 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b5000e520 con 0x7f8b500045a0 2020-01-26T15:36:27.663 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684376042 0 0) 0x7f8b68098000 con 0x7f8b5000a7f0 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b50003230 con 0x7f8b5000a7f0 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1831631712 0 0) 0x7f8b5000e520 con 0x7f8b500045a0 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 -- 172.21.15.170:0/3164451818 >> v1:172.21.15.170:6791/0 conn(0x7f8b5000a7f0 legacy=0x7f8b5000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 -- 172.21.15.170:0/3164451818 >> v1:172.21.15.170:6790/0 conn(0x7f8b500045a0 legacy=0x7f8b500049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6e28a700 1 -- 172.21.15.170:0/3164451818 reap_dead start 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 -- 172.21.15.170:0/3164451818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50054470 con 0x7f8b50003860 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b58008c80 tx=0x7f8b5c004960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.664 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b58008c80 tx=0x7f8b5c004960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8b58008c80 tx=0x7f8b5c004960).ready entity=mon.0 client_cookie=b4ea6b0cc08d5f86 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:27.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8b58008c80 tx=0x7f8b5c004960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b5c004760 con 0x7f8b50003860 2020-01-26T15:36:27.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8b58008c80 tx=0x7f8b5c004960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6c827700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8b58008c80 tx=0x7f8b5c004960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.665 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b58007160 con 0x7f8b50003860 2020-01-26T15:36:27.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b677fe700 1 -- 172.21.15.170:0/3164451818 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b58007540 con 0x7f8b50003860 2020-01-26T15:36:27.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 -- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 msgr2=0x7f8b50003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8b58008c80 tx=0x7f8b5c004960).stop 2020-01-26T15:36:27.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 -- 172.21.15.170:0/3164451818 shutdown_connections 2020-01-26T15:36:27.666 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 --2- 172.21.15.170:0/3164451818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b50003860 0x7f8b50003cd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 -- 172.21.15.170:0/3164451818 >> 172.21.15.170:0/3164451818 conn(0x7f8b68098e70 msgr2=0x7f8b680a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 -- 172.21.15.170:0/3164451818 shutdown_connections 2020-01-26T15:36:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.652+0000 7f8b6d028700 1 -- 172.21.15.170:0/3164451818 wait complete. 2020-01-26T15:36:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6d028700 1 Processor -- start 2020-01-26T15:36:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6d028700 1 -- start start 2020-01-26T15:36:27.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6d028700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b68137450 0x7f8b68139890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:27.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6d028700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6807a1b0 con 0x7f8b6811f630 2020-01-26T15:36:27.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6d028700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6811ebd0 con 0x7f8b681235d0 2020-01-26T15:36:27.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6d028700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8b68131000 con 0x7f8b68137450 2020-01-26T15:36:27.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6e28a700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8b68137450 0x7f8b68139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:27.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b67fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8b6811f630 0x7f8b6811fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51656/0 (socket says 172.21.15.170:51656) 2020-01-26T15:36:27.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b67fff700 1 -- 172.21.15.170:0/3051281126 learned_addr learned my addr 172.21.15.170:0/3051281126 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:27.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6c827700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f8b681235d0 0x7f8b680799b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43656/0 (socket says 172.21.15.170:43656) 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> v2:172.21.15.170:6791/0 conn(0x7f8b68137450 0x7f8b68139890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277485836 0 0) 0x7f8b6807a1b0 con 0x7f8b6811f630 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b48003230 con 0x7f8b6811f630 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339487659 0 0) 0x7f8b6811ebd0 con 0x7f8b681235d0 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b6807a1b0 con 0x7f8b681235d0 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3877077040 0 0) 0x7f8b48003230 con 0x7f8b6811f630 2020-01-26T15:36:27.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b6811ebd0 con 0x7f8b6811f630 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8b5c001b30 con 0x7f8b6811f630 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 >> v2:172.21.15.170:6791/0 conn(0x7f8b68137450 msgr2=0x7f8b68139890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 --2- 172.21.15.170:0/3051281126 >> v2:172.21.15.170:6791/0 conn(0x7f8b68137450 0x7f8b68139890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 >> v1:172.21.15.170:6791/0 conn(0x7f8b681235d0 legacy=0x7f8b680799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 >> v1:172.21.15.170:6789/0 conn(0x7f8b6811f630 legacy=0x7f8b6811fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:27.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b48003230 con 0x7f8b48003ff0 2020-01-26T15:36:27.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8b4800f330 con 0x7f8b48003bc0 2020-01-26T15:36:27.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68131000 con 0x7f8b4800b800 2020-01-26T15:36:27.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:27.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.656+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012823704 0 0) 0x7f8b48003230 con 0x7f8b48003ff0 2020-01-26T15:36:27.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4800f560 con 0x7f8b48003ff0 2020-01-26T15:36:27.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480300428 0 0) 0x7f8b4800f330 con 0x7f8b48003bc0 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b48003230 con 0x7f8b48003bc0 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 -- 172.21.15.170:0/3051281126 >> v1:172.21.15.170:6791/0 conn(0x7f8b48003bc0 legacy=0x7f8b480045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 -- 172.21.15.170:0/3051281126 >> v1:172.21.15.170:6790/0 conn(0x7f8b48003ff0 legacy=0x7f8b48004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 -- 172.21.15.170:0/3051281126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b68124090 con 0x7f8b4800b800 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6811e7f0 con 0x7f8b4800b800 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b68120b70 con 0x7f8b4800b800 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b60005880 con 0x7f8b4800b800 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b60005a80 con 0x7f8b4800b800 2020-01-26T15:36:27.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8b6000a240 con 0x7f8b4800b800 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8b6000a490 con 0x7f8b4800b800 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b40003360 con 0x7f8b4800b800 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.660+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f8b6004ca80 con 0x7f8b4800b800 2020-01-26T15:36:27.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.668+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.668+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8b60032bd0 con 0x7f8b4800b800 2020-01-26T15:36:27.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8b40003790 con 0x7f8b4800b800 2020-01-26T15:36:27.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6e28a700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:27.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b657fa700 1 -- 172.21.15.170:0/3051281126 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8b60032e30 con 0x7f8b4800b800 2020-01-26T15:36:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:27.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 >> v1:172.21.15.170:6800/17396 conn(0x7f8b48048490 legacy=0x7f8b4804a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 msgr2=0x7f8b4800dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:27.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f8b68097950 tx=0x7f8b600105d0).stop 2020-01-26T15:36:27.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6e28a700 1 -- 172.21.15.170:0/3051281126 reap_dead start 2020-01-26T15:36:27.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 shutdown_connections 2020-01-26T15:36:27.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 --2- 172.21.15.170:0/3051281126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b4800b800 0x7f8b4800dcc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:27.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 >> 172.21.15.170:0/3051281126 conn(0x7f8b680a5520 msgr2=0x7f8b680a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:27.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 shutdown_connections 2020-01-26T15:36:27.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:27.824+0000 7f8b6d028700 1 -- 172.21.15.170:0/3051281126 wait complete. 2020-01-26T15:36:27.838 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:30.839 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:30.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9530f1700 1 Processor -- start 2020-01-26T15:36:30.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9530f1700 1 -- start start 2020-01-26T15:36:30.964 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9530f1700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff94c05e5f0 0x7ff94c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9530f1700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c0a6dc0 con 0x7ff94c149040 2020-01-26T15:36:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9530f1700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c05ea20 con 0x7ff94c05edd0 2020-01-26T15:36:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9530f1700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c098000 con 0x7ff94c05e5f0 2020-01-26T15:36:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9520ef700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff94c05e5f0 0x7ff94c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9528f0700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff94c05edd0 0x7ff94c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43672/0 (socket says 172.21.15.170:43672) 2020-01-26T15:36:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9528f0700 1 -- 172.21.15.170:0/913731315 learned_addr learned my addr 172.21.15.170:0/913731315 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:30.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9520ef700 1 --2- 172.21.15.170:0/913731315 >> v2:172.21.15.170:6791/0 conn(0x7ff94c05e5f0 0x7ff94c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:30.966 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520349821 0 0) 0x7ff94c0a6dc0 con 0x7ff94c149040 2020-01-26T15:36:30.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff938003230 con 0x7ff94c149040 2020-01-26T15:36:30.967 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599025035 0 0) 0x7ff94c05ea20 con 0x7ff94c05edd0 2020-01-26T15:36:30.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.948+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c0a6dc0 con 0x7ff94c05edd0 2020-01-26T15:36:30.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4013597944 0 0) 0x7ff938003230 con 0x7ff94c149040 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 >> v2:172.21.15.170:6791/0 conn(0x7ff94c05e5f0 msgr2=0x7ff94c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 --2- 172.21.15.170:0/913731315 >> v2:172.21.15.170:6791/0 conn(0x7ff94c05e5f0 0x7ff94c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 >> v1:172.21.15.170:6791/0 conn(0x7ff94c05edd0 legacy=0x7ff94c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c05e050 con 0x7ff94c149040 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff93c001710 con 0x7ff94c149040 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 >> v1:172.21.15.170:6789/0 conn(0x7ff94c149040 legacy=0x7ff94c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:30.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff938003230 con 0x7ff938004f70 2020-01-26T15:36:30.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff94c05ea20 con 0x7ff938004b20 2020-01-26T15:36:30.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c098000 con 0x7ff93800b800 2020-01-26T15:36:30.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:30.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 -- 172.21.15.170:0/913731315 >> v1:172.21.15.170:6791/0 conn(0x7ff938004b20 legacy=0x7ff938003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 -- 172.21.15.170:0/913731315 >> v1:172.21.15.170:6790/0 conn(0x7ff938004f70 legacy=0x7ff938003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 -- 172.21.15.170:0/913731315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380545d0 con 0x7ff93800b800 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780836305 0 0) 0x7ff938003230 con 0x7ff938004f70 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff93c001520 tx=0x7ff93c00c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff93c001520 tx=0x7ff93c00c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7ff93c001520 tx=0x7ff93c00c010).ready entity=mon.0 client_cookie=4caf36fcd3cab164 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7ff93c001520 tx=0x7ff93c00c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff93c011240 con 0x7ff93800b800 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7ff93c001520 tx=0x7ff93c00c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7ff93c001520 tx=0x7ff93c00c010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c011440 con 0x7ff93800b800 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9518ee700 1 -- 172.21.15.170:0/913731315 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff93c0117e0 con 0x7ff93800b800 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9530f1700 1 -- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 msgr2=0x7ff93800dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9530f1700 1 --2- 172.21.15.170:0/913731315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93800b800 0x7ff93800dc60 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7ff93c001520 tx=0x7ff93c00c010).stop 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff954353700 1 -- 172.21.15.170:0/913731315 reap_dead start 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9530f1700 1 -- 172.21.15.170:0/913731315 shutdown_connections 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9530f1700 1 -- 172.21.15.170:0/913731315 >> 172.21.15.170:0/913731315 conn(0x7ff94c098e70 msgr2=0x7ff94c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9530f1700 1 -- 172.21.15.170:0/913731315 shutdown_connections 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.952+0000 7ff9530f1700 1 -- 172.21.15.170:0/913731315 wait complete. 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9530f1700 1 Processor -- start 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9530f1700 1 -- start start 2020-01-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9530f1700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff94c060420 0x7ff94c07d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9530f1700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c07dcd0 con 0x7ff94c061720 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9530f1700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c060850 con 0x7ff94c07dfe0 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9530f1700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c09e320 con 0x7ff94c060420 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff954353700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff94c060420 0x7ff94c07d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9528f0700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff94c061720 0x7ff94c0a3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51682/0 (socket says 172.21.15.170:51682) 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9520ef700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff94c07dfe0 0x7ff94c07c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43688/0 (socket says 172.21.15.170:43688) 2020-01-26T15:36:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff9528f0700 1 -- 172.21.15.170:0/1867921000 learned_addr learned my addr 172.21.15.170:0/1867921000 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.956+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> v2:172.21.15.170:6791/0 conn(0x7ff94c060420 0x7ff94c07d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162287562 0 0) 0x7ff94c07dcd0 con 0x7ff94c061720 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff934003230 con 0x7ff94c061720 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777158110 0 0) 0x7ff94c060850 con 0x7ff94c07dfe0 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c07dcd0 con 0x7ff94c07dfe0 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2455029179 0 0) 0x7ff934003230 con 0x7ff94c061720 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff94c060850 con 0x7ff94c061720 2020-01-26T15:36:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff944001d20 con 0x7ff94c061720 2020-01-26T15:36:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 >> v2:172.21.15.170:6791/0 conn(0x7ff94c060420 msgr2=0x7ff94c07d1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 --2- 172.21.15.170:0/1867921000 >> v2:172.21.15.170:6791/0 conn(0x7ff94c060420 0x7ff94c07d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 >> v1:172.21.15.170:6791/0 conn(0x7ff94c07dfe0 legacy=0x7ff94c07c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 >> v1:172.21.15.170:6789/0 conn(0x7ff94c061720 legacy=0x7ff94c0a3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff94c07dcd0 con 0x7ff9340050c0 2020-01-26T15:36:30.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:30.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff934003230 con 0x7ff934004c90 2020-01-26T15:36:30.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09e320 con 0x7ff93400b830 2020-01-26T15:36:30.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206150989 0 0) 0x7ff94c07dcd0 con 0x7ff9340050c0 2020-01-26T15:36:30.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93400e4b0 con 0x7ff9340050c0 2020-01-26T15:36:30.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778949615 0 0) 0x7ff934003230 con 0x7ff934004c90 2020-01-26T15:36:30.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c07dcd0 con 0x7ff934004c90 2020-01-26T15:36:30.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 -- 172.21.15.170:0/1867921000 >> v1:172.21.15.170:6791/0 conn(0x7ff934004c90 legacy=0x7ff934003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.979 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 -- 172.21.15.170:0/1867921000 >> v1:172.21.15.170:6790/0 conn(0x7ff9340050c0 legacy=0x7ff934003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 -- 172.21.15.170:0/1867921000 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09ddf0 con 0x7ff93400b830 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c07d730 con 0x7ff93400b830 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c07dfe0 con 0x7ff93400b830 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff93c0114d0 con 0x7ff93400b830 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c0116d0 con 0x7ff93400b830 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff93c00d250 con 0x7ff93400b830 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.960+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff928003360 con 0x7ff93400b830 2020-01-26T15:36:30.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.964+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ff93c00c640 con 0x7ff93400b830 2020-01-26T15:36:30.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.964+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.964+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ff93c04d2e0 con 0x7ff93400b830 2020-01-26T15:36:30.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.968+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:30.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:30.968+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ff93c0336f0 con 0x7ff93400b830 2020-01-26T15:36:31.125 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff928003790 con 0x7ff93400b830 2020-01-26T15:36:31.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff954353700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:31.126 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9437fe700 1 -- 172.21.15.170:0/1867921000 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff93c00d450 con 0x7ff93400b830 2020-01-26T15:36:31.126 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:31.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 >> v1:172.21.15.170:6800/17396 conn(0x7ff934048230 legacy=0x7ff93404a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:31.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 msgr2=0x7ff93400dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:31.127 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 --2- 172.21.15.170:0/1867921000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93400b830 0x7ff93400dd40 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7ff94c07fbe0 tx=0x7ff93c002880).stop 2020-01-26T15:36:31.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff954353700 1 -- 172.21.15.170:0/1867921000 reap_dead start 2020-01-26T15:36:31.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff954353700 1 -- 172.21.15.170:0/1867921000 reap_dead start 2020-01-26T15:36:31.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 shutdown_connections 2020-01-26T15:36:31.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 >> 172.21.15.170:0/1867921000 conn(0x7ff94c098e10 msgr2=0x7ff94c0247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:31.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.124+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 shutdown_connections 2020-01-26T15:36:31.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:31.128+0000 7ff9530f1700 1 -- 172.21.15.170:0/1867921000 wait complete. 2020-01-26T15:36:31.139 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:34.140 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 Processor -- start 2020-01-26T15:36:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- start start 2020-01-26T15:36:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fec5005edd0 0x7fec5005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec50098000 con 0x7fec50149040 2020-01-26T15:36:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5005e050 con 0x7fec500a6870 2020-01-26T15:36:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fec500a6ca0 con 0x7fec5005edd0 2020-01-26T15:36:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec55e96700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fec5005edd0 0x7fec5005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec55695700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fec500a6870 0x7fec5007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43702/0 (socket says 172.21.15.170:43702) 2020-01-26T15:36:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec55e96700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fec5005edd0 0x7fec5005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec55695700 1 -- 172.21.15.170:0/2325070536 learned_addr learned my addr 172.21.15.170:0/2325070536 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303413538 0 0) 0x7fec5005e050 con 0x7fec500a6870 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec3c003230 con 0x7fec500a6870 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415232803 0 0) 0x7fec50098000 con 0x7fec50149040 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec5005e050 con 0x7fec50149040 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2119950932 0 0) 0x7fec3c003230 con 0x7fec500a6870 2020-01-26T15:36:34.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 >> v2:172.21.15.170:6791/0 conn(0x7fec5005edd0 msgr2=0x7fec5005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 --2- 172.21.15.170:0/2325070536 >> v2:172.21.15.170:6791/0 conn(0x7fec5005edd0 0x7fec5005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 >> v1:172.21.15.170:6790/0 conn(0x7fec50149040 legacy=0x7fec5014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5014ecb0 con 0x7fec500a6870 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fec44001710 con 0x7fec500a6870 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fec440019e0 con 0x7fec500a6870 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec54e94700 1 -- 172.21.15.170:0/2325070536 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fec440045b0 con 0x7fec500a6870 2020-01-26T15:36:34.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- 172.21.15.170:0/2325070536 >> v1:172.21.15.170:6791/0 conn(0x7fec500a6870 legacy=0x7fec5007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- 172.21.15.170:0/2325070536 shutdown_connections 2020-01-26T15:36:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 --2- 172.21.15.170:0/2325070536 >> v2:172.21.15.170:6791/0 conn(0x7fec5005edd0 0x7fec5005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- 172.21.15.170:0/2325070536 >> 172.21.15.170:0/2325070536 conn(0x7fec50098e70 msgr2=0x7fec500a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- 172.21.15.170:0/2325070536 shutdown_connections 2020-01-26T15:36:34.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.256+0000 7fec56697700 1 -- 172.21.15.170:0/2325070536 wait complete. 2020-01-26T15:36:34.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 Processor -- start 2020-01-26T15:36:34.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 -- start start 2020-01-26T15:36:34.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fec500a18a0 0x7fec50130160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:34.268 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fec501306b0 0x7fec50121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec50130ae0 con 0x7fec500a1160 2020-01-26T15:36:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fec501221d0 con 0x7fec501306b0 2020-01-26T15:36:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec56697700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fec500a1db0 con 0x7fec500a18a0 2020-01-26T15:36:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec55e96700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fec500a18a0 0x7fec50130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec55e96700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fec500a18a0 0x7fec50130160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec578f9700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fec501306b0 0x7fec50121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec55695700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fec500a1160 0x7fec50121040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51706/0 (socket says 172.21.15.170:51706) 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec55695700 1 -- 172.21.15.170:0/4180778438 learned_addr learned my addr 172.21.15.170:0/4180778438 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.260+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> v2:172.21.15.170:6790/0 conn(0x7fec501306b0 0x7fec50121840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349557240 0 0) 0x7fec50130ae0 con 0x7fec500a1160 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec38003230 con 0x7fec500a1160 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2130746302 0 0) 0x7fec38003230 con 0x7fec500a1160 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fec50130ae0 con 0x7fec500a1160 2020-01-26T15:36:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fec44001420 con 0x7fec500a1160 2020-01-26T15:36:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 >> v2:172.21.15.170:6791/0 conn(0x7fec500a18a0 msgr2=0x7fec50130160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 --2- 172.21.15.170:0/4180778438 >> v2:172.21.15.170:6791/0 conn(0x7fec500a18a0 0x7fec50130160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 >> v2:172.21.15.170:6790/0 conn(0x7fec501306b0 msgr2=0x7fec50121840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 --2- 172.21.15.170:0/4180778438 >> v2:172.21.15.170:6790/0 conn(0x7fec501306b0 0x7fec50121840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 >> v1:172.21.15.170:6789/0 conn(0x7fec500a1160 legacy=0x7fec50121040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fec38003230 con 0x7fec38003ed0 2020-01-26T15:36:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fec3800f250 con 0x7fec38003a20 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec501221d0 con 0x7fec3800b800 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446825101 0 0) 0x7fec38003230 con 0x7fec38003ed0 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec3800f480 con 0x7fec38003ed0 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262713398 0 0) 0x7fec3800f250 con 0x7fec38003a20 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec38003230 con 0x7fec38003a20 2020-01-26T15:36:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 -- 172.21.15.170:0/4180778438 >> v1:172.21.15.170:6791/0 conn(0x7fec38003a20 legacy=0x7fec380045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 -- 172.21.15.170:0/4180778438 >> v1:172.21.15.170:6790/0 conn(0x7fec38003ed0 legacy=0x7fec38004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 -- 172.21.15.170:0/4180778438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50121d90 con 0x7fec3800b800 2020-01-26T15:36:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec50122cb0 con 0x7fec3800b800 2020-01-26T15:36:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec500a3ad0 con 0x7fec3800b800 2020-01-26T15:36:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 -- 172.21.15.170:0/4180778438 reap_dead start 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec50056600 con 0x7fec3800b800 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fec4c001db0 con 0x7fec3800b800 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.275 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00c3b0 con 0x7fec3800b800 2020-01-26T15:36:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.264+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fec4c00c750 con 0x7fec3800b800 2020-01-26T15:36:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.268+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.268+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fec4c00c950 con 0x7fec3800b800 2020-01-26T15:36:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.268+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.268+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fec4c04d1b0 con 0x7fec3800b800 2020-01-26T15:36:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.272+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.272+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fec500a3ad0 con 0x7fec3800b800 2020-01-26T15:36:34.435 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.432+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fec500a8680 con 0x7fec3800b800 2020-01-26T15:36:34.435 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec578f9700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:34.436 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec427fc700 1 -- 172.21.15.170:0/4180778438 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fec4c033360 con 0x7fec3800b800 2020-01-26T15:36:34.436 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:34.437 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 >> v1:172.21.15.170:6800/17396 conn(0x7fec38040bd0 legacy=0x7fec380430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 msgr2=0x7fec3800dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fec4c000b80 tx=0x7fec4c010890).stop 2020-01-26T15:36:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 shutdown_connections 2020-01-26T15:36:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 --2- 172.21.15.170:0/4180778438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec3800b800 0x7fec3800dc40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 >> 172.21.15.170:0/4180778438 conn(0x7fec5007a580 msgr2=0x7fec500790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:34.438 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 shutdown_connections 2020-01-26T15:36:34.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:34.436+0000 7fec56697700 1 -- 172.21.15.170:0/4180778438 wait complete. 2020-01-26T15:36:34.448 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:37.449 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 Processor -- start 2020-01-26T15:36:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 -- start start 2020-01-26T15:36:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f178405edd0 0x7f178405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f17840a6870 0x7f178407ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1784098000 con 0x7f17840804d0 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f178405e050 con 0x7f178405edd0 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178359e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f17840a6ca0 con 0x7f17840a6870 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178259c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f17840a6870 0x7f178407ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f17889ba700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f17840804d0 0x7f17840247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43724/0 (socket says 172.21.15.170:43724) 2020-01-26T15:36:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f178259c700 1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6791/0 conn(0x7f17840a6870 0x7f178407ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f17889ba700 1 -- 172.21.15.170:0/2089940695 learned_addr learned my addr 172.21.15.170:0/2089940695 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f1782d9d700 -1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6790/0 conn(0x7f178405edd0 0x7f178405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f1782d9d700 1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6790/0 conn(0x7f178405edd0 0x7f178405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.564+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364294946 0 0) 0x7f1784098000 con 0x7f17840804d0 2020-01-26T15:36:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f176c003230 con 0x7f17840804d0 2020-01-26T15:36:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3527327125 0 0) 0x7f176c003230 con 0x7f17840804d0 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6791/0 conn(0x7f17840a6870 msgr2=0x7f178407ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6791/0 conn(0x7f17840a6870 0x7f178407ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6790/0 conn(0x7f178405edd0 msgr2=0x7f178405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6790/0 conn(0x7f178405edd0 0x7f178405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784024fb0 con 0x7f17840804d0 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f177c001a90 con 0x7f17840804d0 2020-01-26T15:36:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f177c001c90 con 0x7f17840804d0 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f1781d9b700 1 -- 172.21.15.170:0/2089940695 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f177c004930 con 0x7f17840804d0 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 -- 172.21.15.170:0/2089940695 >> v1:172.21.15.170:6791/0 conn(0x7f17840804d0 legacy=0x7f17840247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 -- 172.21.15.170:0/2089940695 shutdown_connections 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6790/0 conn(0x7f178405edd0 0x7f178405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 --2- 172.21.15.170:0/2089940695 >> v2:172.21.15.170:6791/0 conn(0x7f17840a6870 0x7f178407ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 -- 172.21.15.170:0/2089940695 >> 172.21.15.170:0/2089940695 conn(0x7f1784098e70 msgr2=0x7f17840a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 -- 172.21.15.170:0/2089940695 shutdown_connections 2020-01-26T15:36:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.568+0000 7f178359e700 1 -- 172.21.15.170:0/2089940695 wait complete. 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 Processor -- start 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 -- start start 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f17840a32c0 0x7f17840a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17840a2360 con 0x7f17840a2b40 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178409de10 con 0x7f178409fe10 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f17840a4720 con 0x7f17840a32c0 2020-01-26T15:36:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f1782d9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f17840a32c0 0x7f17840a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17889ba700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f178409fe10 0x7f178413aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43728/0 (socket says 172.21.15.170:43728) 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17889ba700 1 -- 172.21.15.170:0/1985884245 learned_addr learned my addr 172.21.15.170:0/1985884245 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f1782d9d700 1 --2- 172.21.15.170:0/1985884245 >> v2:172.21.15.170:6790/0 conn(0x7f17840a32c0 0x7f17840a3ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687461805 0 0) 0x7f178409de10 con 0x7f178409fe10 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1768003230 con 0x7f178409fe10 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940830910 0 0) 0x7f17840a2360 con 0x7f17840a2b40 2020-01-26T15:36:37.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178409de10 con 0x7f17840a2b40 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 948856175 0 0) 0x7f1768003230 con 0x7f178409fe10 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17840a2360 con 0x7f178409fe10 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f177c001bb0 con 0x7f178409fe10 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3544060259 0 0) 0x7f178409de10 con 0x7f17840a2b40 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1768003230 con 0x7f17840a2b40 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1778001650 con 0x7f17840a2b40 2020-01-26T15:36:37.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 590159903 0 0) 0x7f17840a2360 con 0x7f178409fe10 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 >> v2:172.21.15.170:6790/0 conn(0x7f17840a32c0 msgr2=0x7f17840a3ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 --2- 172.21.15.170:0/1985884245 >> v2:172.21.15.170:6790/0 conn(0x7f17840a32c0 0x7f17840a3ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 >> v1:172.21.15.170:6790/0 conn(0x7f17840a2b40 legacy=0x7f178409f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840a2f70 con 0x7f178409fe10 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17840a4ef0 con 0x7f178409fe10 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784123030 con 0x7f178409fe10 2020-01-26T15:36:37.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.572+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f177c004c00 con 0x7f178409fe10 2020-01-26T15:36:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.576+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f177c004fa0 con 0x7f178409fe10 2020-01-26T15:36:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.576+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c003360 con 0x7f178409fe10 2020-01-26T15:36:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.576+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f177c0109e0 con 0x7f178409fe10 2020-01-26T15:36:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.576+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f177c04bca0 con 0x7f178409fe10 2020-01-26T15:36:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.580+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f177c001570 con 0x7f178409fe10 2020-01-26T15:36:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.736+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f175c0037d0 con 0x7f178409fe10 2020-01-26T15:36:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.736+0000 7f17737fe700 1 -- 172.21.15.170:0/1985884245 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f177c031220 con 0x7f178409fe10 2020-01-26T15:36:37.738 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:37.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.736+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 >> v1:172.21.15.170:6800/17396 conn(0x7f176803e4c0 legacy=0x7f17680409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:37.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.736+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 >> v1:172.21.15.170:6791/0 conn(0x7f178409fe10 legacy=0x7f178413aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:37.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.740+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 shutdown_connections 2020-01-26T15:36:37.744 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.740+0000 7f178359e700 1 --2- 172.21.15.170:0/1985884245 >> v2:172.21.15.170:6790/0 conn(0x7f17840a32c0 0x7f17840a3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:37.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.740+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 >> 172.21.15.170:0/1985884245 conn(0x7f17840a5520 msgr2=0x7f1784097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:37.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.740+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 shutdown_connections 2020-01-26T15:36:37.745 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:37.740+0000 7f178359e700 1 -- 172.21.15.170:0/1985884245 wait complete. 2020-01-26T15:36:37.756 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:40.757 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:40.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.864+0000 7fad1672c700 1 Processor -- start 2020-01-26T15:36:40.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.864+0000 7fad1672c700 1 -- start start 2020-01-26T15:36:40.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fad1005edd0 0x7fad1005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:40.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fad10149040 0x7fad1014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:40.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad10098000 con 0x7fad100a6870 2020-01-26T15:36:40.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fad1005e050 con 0x7fad1005edd0 2020-01-26T15:36:40.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fad100a6ca0 con 0x7fad10149040 2020-01-26T15:36:40.872 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad15f2b700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fad1005edd0 0x7fad1005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1798e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fad10149040 0x7fad1014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad15f2b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fad1005edd0 0x7fad1005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1572a700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fad100a6870 0x7fad1007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43736/0 (socket says 172.21.15.170:43736) 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1572a700 1 -- 172.21.15.170:0/3945173437 learned_addr learned my addr 172.21.15.170:0/3945173437 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1798e700 1 --2- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6791/0 conn(0x7fad10149040 0x7fad1014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613371516 0 0) 0x7fad10098000 con 0x7fad100a6870 2020-01-26T15:36:40.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf8003230 con 0x7fad100a6870 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3543864234 0 0) 0x7facf8003230 con 0x7fad100a6870 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6791/0 conn(0x7fad10149040 msgr2=0x7fad1014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 --2- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6791/0 conn(0x7fad10149040 0x7fad1014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6790/0 conn(0x7fad1005edd0 msgr2=0x7fad1005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 --2- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6790/0 conn(0x7fad1005edd0 0x7fad1005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1014c9e0 con 0x7fad100a6870 2020-01-26T15:36:40.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad0c001710 con 0x7fad100a6870 2020-01-26T15:36:40.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fad0c001aa0 con 0x7fad100a6870 2020-01-26T15:36:40.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad14f29700 1 -- 172.21.15.170:0/3945173437 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad0c004760 con 0x7fad100a6870 2020-01-26T15:36:40.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- 172.21.15.170:0/3945173437 >> v1:172.21.15.170:6791/0 conn(0x7fad100a6870 legacy=0x7fad1007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:40.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- 172.21.15.170:0/3945173437 shutdown_connections 2020-01-26T15:36:40.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 --2- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6791/0 conn(0x7fad10149040 0x7fad1014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:40.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 --2- 172.21.15.170:0/3945173437 >> v2:172.21.15.170:6790/0 conn(0x7fad1005edd0 0x7fad1005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:40.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- 172.21.15.170:0/3945173437 >> 172.21.15.170:0/3945173437 conn(0x7fad10098e70 msgr2=0x7fad100a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:40.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- 172.21.15.170:0/3945173437 shutdown_connections 2020-01-26T15:36:40.876 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.868+0000 7fad1672c700 1 -- 172.21.15.170:0/3945173437 wait complete. 2020-01-26T15:36:40.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1672c700 1 Processor -- start 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1672c700 1 -- start start 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1672c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fad101363b0 0x7fad101387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1672c700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1011f6c0 con 0x7fad10121120 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1672c700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad10121da0 con 0x7fad1007c9e0 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1672c700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fad1011f1e0 con 0x7fad101363b0 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad15f2b700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fad10121120 0x7fad10099aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51738/0 (socket says 172.21.15.170:51738) 2020-01-26T15:36:40.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1572a700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fad1007c9e0 0x7fad1007ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43742/0 (socket says 172.21.15.170:43742) 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad15f2b700 1 -- 172.21.15.170:0/2171736647 learned_addr learned my addr 172.21.15.170:0/2171736647 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1798e700 -1 --2- 172.21.15.170:0/2171736647 >> v2:172.21.15.170:6791/0 conn(0x7fad101363b0 0x7fad101387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> v2:172.21.15.170:6791/0 conn(0x7fad101363b0 0x7fad101387f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785759620 0 0) 0x7fad1011f6c0 con 0x7fad10121120 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf0003230 con 0x7fad10121120 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722056648 0 0) 0x7fad10121da0 con 0x7fad1007c9e0 2020-01-26T15:36:40.882 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.872+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad1011f6c0 con 0x7fad1007c9e0 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2251059995 0 0) 0x7facf0003230 con 0x7fad10121120 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad10121da0 con 0x7fad10121120 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fad00002780 con 0x7fad10121120 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 >> v2:172.21.15.170:6791/0 conn(0x7fad101363b0 msgr2=0x7fad101387f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 --2- 172.21.15.170:0/2171736647 >> v2:172.21.15.170:6791/0 conn(0x7fad101363b0 0x7fad101387f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 >> v1:172.21.15.170:6791/0 conn(0x7fad1007c9e0 legacy=0x7fad1007ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 >> v1:172.21.15.170:6789/0 conn(0x7fad10121120 legacy=0x7fad10099aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:40.883 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7facf0003230 con 0x7facf0005110 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7facf000f570 con 0x7facf0004c90 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1011f1e0 con 0x7facf0003e50 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083526097 0 0) 0x7facf000f570 con 0x7facf0004c90 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 -- 172.21.15.170:0/2171736647 >> v1:172.21.15.170:6791/0 conn(0x7facf0004c90 legacy=0x7facf0003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:40.884 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 -- 172.21.15.170:0/2171736647 >> v1:172.21.15.170:6790/0 conn(0x7facf0005110 legacy=0x7facf000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:40.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 -- 172.21.15.170:0/2171736647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1011fcc0 con 0x7facf0003e50 2020-01-26T15:36:40.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad10120cf0 con 0x7facf0003e50 2020-01-26T15:36:40.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad100a4ae0 con 0x7facf0003e50 2020-01-26T15:36:40.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:40.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fad0800e9a0 con 0x7facf0003e50 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800eba0 con 0x7facf0003e50 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fad08009170 con 0x7facf0003e50 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fad080093c0 con 0x7facf0003e50 2020-01-26T15:36:40.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec003360 con 0x7facf0003e50 2020-01-26T15:36:40.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.876+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fad0804de10 con 0x7facf0003e50 2020-01-26T15:36:40.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.880+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:40.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:40.880+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fad08034050 con 0x7facf0003e50 2020-01-26T15:36:41.041 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7facec003790 con 0x7facf0003e50 2020-01-26T15:36:41.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1798e700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:41.042 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad067fc700 1 -- 172.21.15.170:0/2171736647 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fad080342b0 con 0x7facf0003e50 2020-01-26T15:36:41.043 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:41.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 >> v1:172.21.15.170:6800/17396 conn(0x7facf0048230 legacy=0x7facf004a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:41.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 msgr2=0x7facf000e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:41.046 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1798e700 1 -- 172.21.15.170:0/2171736647 reap_dead start 2020-01-26T15:36:41.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fad080032b0 tx=0x7fad08010cc0).stop 2020-01-26T15:36:41.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 shutdown_connections 2020-01-26T15:36:41.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 --2- 172.21.15.170:0/2171736647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facf0003e50 0x7facf000e010 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:41.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 >> 172.21.15.170:0/2171736647 conn(0x7fad10122880 msgr2=0x7fad1007f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:41.047 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 shutdown_connections 2020-01-26T15:36:41.048 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:41.040+0000 7fad1672c700 1 -- 172.21.15.170:0/2171736647 wait complete. 2020-01-26T15:36:41.057 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:44.058 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:44.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 Processor -- start 2020-01-26T15:36:44.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- start start 2020-01-26T15:36:44.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2f8005e5f0 0x7f2f800a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:44.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800a6dc0 con 0x7f2f8005edd0 2020-01-26T15:36:44.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8005ea20 con 0x7f2f80149040 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2f80098000 con 0x7f2f8005e5f0 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8500f700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2f8005e5f0 0x7f2f800a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f85810700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2f8005edd0 0x7f2f8007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51752/0 (socket says 172.21.15.170:51752) 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8500f700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2f8005e5f0 0x7f2f800a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f87273700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f2f80149040 0x7f2f8014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48632/0 (socket says 172.21.15.170:48632) 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f85810700 1 -- 172.21.15.170:0/3247474321 learned_addr learned my addr 172.21.15.170:0/3247474321 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:44.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830376077 0 0) 0x7f2f8005ea20 con 0x7f2f80149040 2020-01-26T15:36:44.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6c003230 con 0x7f2f80149040 2020-01-26T15:36:44.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273284001 0 0) 0x7f2f800a6dc0 con 0x7f2f8005edd0 2020-01-26T15:36:44.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f8005ea20 con 0x7f2f8005edd0 2020-01-26T15:36:44.182 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3775750295 0 0) 0x7f2f6c003230 con 0x7f2f80149040 2020-01-26T15:36:44.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 >> v2:172.21.15.170:6791/0 conn(0x7f2f8005e5f0 msgr2=0x7f2f800a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:44.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 --2- 172.21.15.170:0/3247474321 >> v2:172.21.15.170:6791/0 conn(0x7f2f8005e5f0 0x7f2f800a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:44.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 >> v1:172.21.15.170:6789/0 conn(0x7f2f8005edd0 legacy=0x7f2f8007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8005e050 con 0x7f2f80149040 2020-01-26T15:36:44.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2f78001a90 con 0x7f2f80149040 2020-01-26T15:36:44.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2f78001d60 con 0x7f2f80149040 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f8480e700 1 -- 172.21.15.170:0/3247474321 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2f78004870 con 0x7f2f80149040 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- 172.21.15.170:0/3247474321 >> v1:172.21.15.170:6790/0 conn(0x7f2f80149040 legacy=0x7f2f8014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- 172.21.15.170:0/3247474321 shutdown_connections 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 --2- 172.21.15.170:0/3247474321 >> v2:172.21.15.170:6791/0 conn(0x7f2f8005e5f0 0x7f2f800a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- 172.21.15.170:0/3247474321 >> 172.21.15.170:0/3247474321 conn(0x7f2f80098e70 msgr2=0x7f2f800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- 172.21.15.170:0/3247474321 shutdown_connections 2020-01-26T15:36:44.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.176+0000 7f2f86011700 1 -- 172.21.15.170:0/3247474321 wait complete. 2020-01-26T15:36:44.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.180+0000 7f2f86011700 1 Processor -- start 2020-01-26T15:36:44.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.180+0000 7f2f86011700 1 -- start start 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2f80121650 0x7f2f8007d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2f8007d590 0x7f2f80079de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8007d9c0 con 0x7f2f8007ad90 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800a1ad0 con 0x7f2f80121650 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8007a330 con 0x7f2f8007d590 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2f8007ad90 0x7f2f800a0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51758/0 (socket says 172.21.15.170:51758) 2020-01-26T15:36:44.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f8500f700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2f80121650 0x7f2f8007d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:44.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 -- 172.21.15.170:0/3472224381 learned_addr learned my addr 172.21.15.170:0/3472224381 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:44.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f87273700 -1 --2- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6791/0 conn(0x7f2f8007d590 0x7f2f80079de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:44.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f8500f700 1 --2- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6790/0 conn(0x7f2f80121650 0x7f2f8007d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:44.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f87273700 1 --2- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6791/0 conn(0x7f2f8007d590 0x7f2f80079de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:44.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155096516 0 0) 0x7f2f8005ea20 con 0x7f2f8007ad90 2020-01-26T15:36:44.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f68003230 con 0x7f2f8007ad90 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 698266391 0 0) 0x7f2f68003230 con 0x7f2f8007ad90 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2f8005ea20 con 0x7f2f8007ad90 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2f7c001850 con 0x7f2f8007ad90 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6791/0 conn(0x7f2f8007d590 msgr2=0x7f2f80079de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 --2- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6791/0 conn(0x7f2f8007d590 0x7f2f80079de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6790/0 conn(0x7f2f80121650 msgr2=0x7f2f8007d040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:44.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 --2- 172.21.15.170:0/3472224381 >> v2:172.21.15.170:6790/0 conn(0x7f2f80121650 0x7f2f8007d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:44.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 >> v1:172.21.15.170:6789/0 conn(0x7f2f8007ad90 legacy=0x7f2f800a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:44.193 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2f68003230 con 0x7f2f680045a0 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2f6800f450 con 0x7f2f6800a7f0 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800a1ad0 con 0x7f2f68003a20 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937694864 0 0) 0x7f2f68003230 con 0x7f2f680045a0 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6800f680 con 0x7f2f680045a0 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723196195 0 0) 0x7f2f6800f450 con 0x7f2f6800a7f0 2020-01-26T15:36:44.194 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f68003230 con 0x7f2f6800a7f0 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2794850574 0 0) 0x7f2f6800f680 con 0x7f2f680045a0 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2f6800f450 con 0x7f2f680045a0 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2f70001660 con 0x7f2f680045a0 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 -- 172.21.15.170:0/3472224381 >> v1:172.21.15.170:6791/0 conn(0x7f2f6800a7f0 legacy=0x7f2f6800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 -- 172.21.15.170:0/3472224381 >> v1:172.21.15.170:6790/0 conn(0x7f2f680045a0 legacy=0x7f2f680049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f87273700 1 -- 172.21.15.170:0/3472224381 reap_dead start 2020-01-26T15:36:44.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 -- 172.21.15.170:0/3472224381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8007a520 con 0x7f2f68003a20 2020-01-26T15:36:44.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8007ad90 con 0x7f2f68003a20 2020-01-26T15:36:44.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80121650 con 0x7f2f68003a20 2020-01-26T15:36:44.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:44.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2f7c011d40 con 0x7f2f68003a20 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c0055a0 con 0x7f2f68003a20 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.184+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2f7c005a00 con 0x7f2f68003a20 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.188+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c003360 con 0x7f2f68003a20 2020-01-26T15:36:44.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.188+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.188+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f2f7c005cd0 con 0x7f2f68003a20 2020-01-26T15:36:44.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.188+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.188+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f2f8007d9c0 con 0x7f2f68003a20 2020-01-26T15:36:44.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.196+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.196+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f2f7c0338e0 con 0x7f2f68003a20 2020-01-26T15:36:44.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2f5c003790 con 0x7f2f68003a20 2020-01-26T15:36:44.352 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f85810700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:44.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f767fc700 1 -- 172.21.15.170:0/3472224381 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2f7c033b40 con 0x7f2f68003a20 2020-01-26T15:36:44.353 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:44.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 >> v1:172.21.15.170:6800/17396 conn(0x7f2f68042ea0 legacy=0x7f2f680453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 msgr2=0x7f2f68003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:44.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f2f7c001b50 tx=0x7f2f8005e2c0).stop 2020-01-26T15:36:44.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 shutdown_connections 2020-01-26T15:36:44.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 --2- 172.21.15.170:0/3472224381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f68003a20 0x7f2f68003e90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:44.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 >> 172.21.15.170:0/3472224381 conn(0x7f2f8005bfb0 msgr2=0x7f2f80122430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:44.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 shutdown_connections 2020-01-26T15:36:44.355 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:44.352+0000 7f2f86011700 1 -- 172.21.15.170:0/3472224381 wait complete. 2020-01-26T15:36:44.366 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:47.367 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:47.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae4bff700 1 Processor -- start 2020-01-26T15:36:47.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae4bff700 1 -- start start 2020-01-26T15:36:47.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae4bff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae005ea20 con 0x7f8ae00a6870 2020-01-26T15:36:47.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae4bff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae0098000 con 0x7f8ae005e5f0 2020-01-26T15:36:47.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae4bff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae005e050 con 0x7f8ae005edd0 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae5e61700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8ae00a6870 0x7f8ae014c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51774/0 (socket says 172.21.15.170:51774) 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8adffff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f8ae005edd0 0x7f8ae007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43774/0 (socket says 172.21.15.170:43774) 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8ae5e61700 1 -- 172.21.15.170:0/2256690694 learned_addr learned my addr 172.21.15.170:0/2256690694 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552636144 0 0) 0x7f8ae005ea20 con 0x7f8ae00a6870 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac8003230 con 0x7f8ae00a6870 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.480+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529306677 0 0) 0x7f8ae0098000 con 0x7f8ae005e5f0 2020-01-26T15:36:47.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae005ea20 con 0x7f8ae005e5f0 2020-01-26T15:36:47.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358531461 0 0) 0x7f8ae005e050 con 0x7f8ae005edd0 2020-01-26T15:36:47.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae0098000 con 0x7f8ae005edd0 2020-01-26T15:36:47.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 797871109 0 0) 0x7f8ac8003230 con 0x7f8ae00a6870 2020-01-26T15:36:47.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 >> v1:172.21.15.170:6791/0 conn(0x7f8ae005edd0 legacy=0x7f8ae007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 >> v1:172.21.15.170:6790/0 conn(0x7f8ae005e5f0 legacy=0x7f8ae0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00a6ca0 con 0x7f8ae00a6870 2020-01-26T15:36:47.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8ad0001710 con 0x7f8ae00a6870 2020-01-26T15:36:47.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 >> v1:172.21.15.170:6789/0 conn(0x7f8ae00a6870 legacy=0x7f8ae014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:47.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8ac8003230 con 0x7f8ac8003ec0 2020-01-26T15:36:47.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8ae005e050 con 0x7f8ac8003a90 2020-01-26T15:36:47.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8005290 con 0x7f8ac8004d80 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033233422 0 0) 0x7f8ac8003230 con 0x7f8ac8003ec0 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac800e810 con 0x7f8ac8003ec0 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 -- 172.21.15.170:0/2256690694 >> v1:172.21.15.170:6791/0 conn(0x7f8ac8003a90 legacy=0x7f8ac80097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 -- 172.21.15.170:0/2256690694 >> v1:172.21.15.170:6790/0 conn(0x7f8ac8003ec0 legacy=0x7f8ac800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 -- 172.21.15.170:0/2256690694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00a6ca0 con 0x7f8ac8004d80 2020-01-26T15:36:47.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:47.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:47.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).ready entity=mon.0 client_cookie=f22b2c5d1832346c server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:47.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:47.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8ad804a8c0 con 0x7f8ac8004d80 2020-01-26T15:36:47.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:47.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adffff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:47.498 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad804aac0 con 0x7f8ac8004d80 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8adeffd700 1 -- 172.21.15.170:0/2256690694 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8ad80550c0 con 0x7f8ac8004d80 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 -- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 msgr2=0x7f8ac8003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f8ad8001340 tx=0x7f8ad80541d0).stop 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 -- 172.21.15.170:0/2256690694 shutdown_connections 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 --2- 172.21.15.170:0/2256690694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac8004d80 0x7f8ac8003540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 -- 172.21.15.170:0/2256690694 >> 172.21.15.170:0/2256690694 conn(0x7f8ae0098e70 msgr2=0x7f8ae00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:47.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 -- 172.21.15.170:0/2256690694 shutdown_connections 2020-01-26T15:36:47.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.484+0000 7f8ae4bff700 1 -- 172.21.15.170:0/2256690694 wait complete. 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 Processor -- start 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 -- start start 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8ae009f3e0 0x7f8ae00a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8ae00a18d0 0x7f8ae007cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae009ecb0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae0122130 con 0x7f8ae009f3e0 2020-01-26T15:36:47.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae4bff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae00a0150 con 0x7f8ae00a18d0 2020-01-26T15:36:47.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8adffff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8ae009f3e0 0x7f8ae00a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:47.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae5e61700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f8ae007d4c0 0x7f8ae00a4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43790/0 (socket says 172.21.15.170:43790) 2020-01-26T15:36:47.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8adf7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8ae00a18d0 0x7f8ae007cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:47.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8ae5e61700 1 -- 172.21.15.170:0/3532966835 learned_addr learned my addr 172.21.15.170:0/3532966835 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:47.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8adffff700 1 --2- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6790/0 conn(0x7f8ae009f3e0 0x7f8ae00a1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:47.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8adf7fe700 1 --2- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6791/0 conn(0x7f8ae00a18d0 0x7f8ae007cf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955859951 0 0) 0x7f8ae009ecb0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.488+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac0003230 con 0x7f8ae007d4c0 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1224273278 0 0) 0x7f8ac0003230 con 0x7f8ae007d4c0 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ae009ecb0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8ad00018b0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1083088053 0 0) 0x7f8ae009ecb0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6791/0 conn(0x7f8ae00a18d0 msgr2=0x7f8ae007cf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:47.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 --2- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6791/0 conn(0x7f8ae00a18d0 0x7f8ae007cf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:47.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6790/0 conn(0x7f8ae009f3e0 msgr2=0x7f8ae00a1380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:47.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 --2- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6790/0 conn(0x7f8ae009f3e0 0x7f8ae00a1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:47.512 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0121370 con 0x7f8ae007d4c0 2020-01-26T15:36:47.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae009e1d0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae009f0e0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8ad0004930 con 0x7f8ae007d4c0 2020-01-26T15:36:47.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8ad0001210 con 0x7f8ae007d4c0 2020-01-26T15:36:47.513 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f8ad0004d50 con 0x7f8ae007d4c0 2020-01-26T15:36:47.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab8003360 con 0x7f8ae007d4c0 2020-01-26T15:36:47.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.492+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f8ad004bc20 con 0x7f8ae007d4c0 2020-01-26T15:36:47.514 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.500+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f8ad00310c0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.656+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ab80037d0 con 0x7f8ae007d4c0 2020-01-26T15:36:47.658 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.656+0000 7f8adcff9700 1 -- 172.21.15.170:0/3532966835 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f8ad004a870 con 0x7f8ae007d4c0 2020-01-26T15:36:47.659 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:47.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 >> v1:172.21.15.170:6800/17396 conn(0x7f8ac003e020 legacy=0x7f8ac0040530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 >> v1:172.21.15.170:6791/0 conn(0x7f8ae007d4c0 legacy=0x7f8ae00a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:47.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 shutdown_connections 2020-01-26T15:36:47.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 --2- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6790/0 conn(0x7f8ae009f3e0 0x7f8ae00a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:47.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 --2- 172.21.15.170:0/3532966835 >> v2:172.21.15.170:6791/0 conn(0x7f8ae00a18d0 0x7f8ae007cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:47.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 >> 172.21.15.170:0/3532966835 conn(0x7f8ae00979d0 msgr2=0x7f8ae00a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:47.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 shutdown_connections 2020-01-26T15:36:47.661 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:47.660+0000 7f8ae4bff700 1 -- 172.21.15.170:0/3532966835 wait complete. 2020-01-26T15:36:47.671 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:50.673 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:50.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.784+0000 7fe617fff700 1 Processor -- start 2020-01-26T15:36:50.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.784+0000 7fe617fff700 1 -- start start 2020-01-26T15:36:50.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61805ea20 con 0x7fe61805e5f0 2020-01-26T15:36:50.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe618098000 con 0x7fe6180a6870 2020-01-26T15:36:50.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61805e050 con 0x7fe61805edd0 2020-01-26T15:36:50.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe616ffd700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe61805e5f0 0x7fe618149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51792/0 (socket says 172.21.15.170:51792) 2020-01-26T15:36:50.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe616ffd700 1 -- 172.21.15.170:0/3412879949 learned_addr learned my addr 172.21.15.170:0/3412879949 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:50.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954307341 0 0) 0x7fe61805ea20 con 0x7fe61805e5f0 2020-01-26T15:36:50.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe600003230 con 0x7fe61805e5f0 2020-01-26T15:36:50.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737308 0 0) 0x7fe618098000 con 0x7fe6180a6870 2020-01-26T15:36:50.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe61805ea20 con 0x7fe6180a6870 2020-01-26T15:36:50.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824033406 0 0) 0x7fe61805e050 con 0x7fe61805edd0 2020-01-26T15:36:50.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe618098000 con 0x7fe61805edd0 2020-01-26T15:36:50.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2478237589 0 0) 0x7fe61805ea20 con 0x7fe6180a6870 2020-01-26T15:36:50.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 >> v1:172.21.15.170:6791/0 conn(0x7fe61805edd0 legacy=0x7fe61807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 >> v1:172.21.15.170:6789/0 conn(0x7fe61805e5f0 legacy=0x7fe618149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180a6ca0 con 0x7fe6180a6870 2020-01-26T15:36:50.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe60c0015a0 con 0x7fe6180a6870 2020-01-26T15:36:50.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe60c001870 con 0x7fe6180a6870 2020-01-26T15:36:50.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe6167fc700 1 -- 172.21.15.170:0/3412879949 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe60c001c90 con 0x7fe6180a6870 2020-01-26T15:36:50.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- 172.21.15.170:0/3412879949 >> v1:172.21.15.170:6790/0 conn(0x7fe6180a6870 legacy=0x7fe61814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- 172.21.15.170:0/3412879949 shutdown_connections 2020-01-26T15:36:50.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- 172.21.15.170:0/3412879949 >> 172.21.15.170:0/3412879949 conn(0x7fe618098e70 msgr2=0x7fe6180a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:50.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- 172.21.15.170:0/3412879949 shutdown_connections 2020-01-26T15:36:50.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.788+0000 7fe617fff700 1 -- 172.21.15.170:0/3412879949 wait complete. 2020-01-26T15:36:50.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe617fff700 1 Processor -- start 2020-01-26T15:36:50.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe617fff700 1 -- start start 2020-01-26T15:36:50.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe617fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6180a34c0 con 0x7fe61807a1b0 2020-01-26T15:36:50.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe617fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6180a1fc0 con 0x7fe6181405f0 2020-01-26T15:36:50.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe617fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe618144590 con 0x7fe618145210 2020-01-26T15:36:50.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe61807a1b0 0x7fe61815a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51798/0 (socket says 172.21.15.170:51798) 2020-01-26T15:36:50.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 -- 172.21.15.170:0/307162618 learned_addr learned my addr 172.21.15.170:0/307162618 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:50.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe61d8a0700 1 --1- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6790/0 conn(0x7fe6181405f0 0x7fe61815e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48676/0 (socket says 172.21.15.170:48676) 2020-01-26T15:36:50.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360463755 0 0) 0x7fe618144590 con 0x7fe618145210 2020-01-26T15:36:50.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f8003230 con 0x7fe618145210 2020-01-26T15:36:50.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079813932 0 0) 0x7fe6180a34c0 con 0x7fe61807a1b0 2020-01-26T15:36:50.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe618144590 con 0x7fe61807a1b0 2020-01-26T15:36:50.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294952829 0 0) 0x7fe6180a1fc0 con 0x7fe6181405f0 2020-01-26T15:36:50.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6180a34c0 con 0x7fe6181405f0 2020-01-26T15:36:50.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 455478513 0 0) 0x7fe618144590 con 0x7fe61807a1b0 2020-01-26T15:36:50.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6180a1fc0 con 0x7fe61807a1b0 2020-01-26T15:36:50.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe608001910 con 0x7fe61807a1b0 2020-01-26T15:36:50.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6791/0 conn(0x7fe618145210 legacy=0x7fe6180799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6790/0 conn(0x7fe6181405f0 legacy=0x7fe61815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6789/0 conn(0x7fe61807a1b0 legacy=0x7fe61815a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe6180a34c0 con 0x7fe5f800ad40 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe618144590 con 0x7fe5f8004ec0 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8004230 con 0x7fe5f8003d40 2020-01-26T15:36:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216970397 0 0) 0x7fe6180a34c0 con 0x7fe5f800ad40 2020-01-26T15:36:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 -- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6791/0 conn(0x7fe5f8004ec0 legacy=0x7fe5f8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 -- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6790/0 conn(0x7fe5f800ad40 legacy=0x7fe5f800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 -- 172.21.15.170:0/307162618 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180a3e60 con 0x7fe5f8003d40 2020-01-26T15:36:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6181405f0 con 0x7fe5f8003d40 2020-01-26T15:36:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.792+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe618145210 con 0x7fe5f8003d40 2020-01-26T15:36:50.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:50.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe60800ebe0 con 0x7fe5f8003d40 2020-01-26T15:36:50.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800ede0 con 0x7fe5f8003d40 2020-01-26T15:36:50.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe6080046a0 con 0x7fe5f8003d40 2020-01-26T15:36:50.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f0003360 con 0x7fe5f8003d40 2020-01-26T15:36:50.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe6080048f0 con 0x7fe5f8003d40 2020-01-26T15:36:50.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.796+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fe60804d7e0 con 0x7fe5f8003d40 2020-01-26T15:36:50.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.800+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.800+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe608033950 con 0x7fe5f8003d40 2020-01-26T15:36:50.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.952+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5f0003790 con 0x7fe5f8003d40 2020-01-26T15:36:50.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.952+0000 7fe616ffd700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:50.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.952+0000 7fe5fffff700 1 -- 172.21.15.170:0/307162618 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe608033bb0 con 0x7fe5f8003d40 2020-01-26T15:36:50.955 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:50.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 >> v1:172.21.15.170:6800/17396 conn(0x7fe5f80481e0 legacy=0x7fe5f804a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 msgr2=0x7fe5f800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 --2- 172.21.15.170:0/307162618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8003d40 0x7fe5f800a7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fe608001720 tx=0x7fe608011500).stop 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe61d8a0700 1 -- 172.21.15.170:0/307162618 reap_dead start 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 shutdown_connections 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 >> 172.21.15.170:0/307162618 conn(0x7fe6180247b0 msgr2=0x7fe618097a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 shutdown_connections 2020-01-26T15:36:50.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:50.956+0000 7fe617fff700 1 -- 172.21.15.170:0/307162618 wait complete. 2020-01-26T15:36:50.967 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:53.969 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:54.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 Processor -- start 2020-01-26T15:36:54.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 -- start start 2020-01-26T15:36:54.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fda8805e5f0 0x7fda880a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:54.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fda88149040 0x7fda8814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:54.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda880a6dc0 con 0x7fda8805edd0 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fda8805ea20 con 0x7fda88149040 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8c98a700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fda88098000 con 0x7fda8805e5f0 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda87fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fda8805edd0 0x7fda8807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51812/0 (socket says 172.21.15.170:51812) 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda87fff700 1 -- 172.21.15.170:0/1921829872 learned_addr learned my addr 172.21.15.170:0/1921829872 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda877fe700 -1 --2- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6791/0 conn(0x7fda8805e5f0 0x7fda880a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda877fe700 1 --2- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6791/0 conn(0x7fda8805e5f0 0x7fda880a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:54.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8dbec700 -1 --2- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6790/0 conn(0x7fda88149040 0x7fda8814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6790/0 conn(0x7fda88149040 0x7fda8814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116364256 0 0) 0x7fda880a6dc0 con 0x7fda8805edd0 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.084+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda70003230 con 0x7fda8805edd0 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3341520413 0 0) 0x7fda70003230 con 0x7fda8805edd0 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6791/0 conn(0x7fda8805e5f0 msgr2=0x7fda880a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 --2- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6791/0 conn(0x7fda8805e5f0 0x7fda880a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6790/0 conn(0x7fda88149040 msgr2=0x7fda8814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:54.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 --2- 172.21.15.170:0/1921829872 >> v2:172.21.15.170:6790/0 conn(0x7fda88149040 0x7fda8814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8805e050 con 0x7fda8805edd0 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fda78001710 con 0x7fda8805edd0 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 >> v1:172.21.15.170:6789/0 conn(0x7fda8805edd0 legacy=0x7fda8807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fda70003230 con 0x7fda70003860 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fda880a6dc0 con 0x7fda700077d0 2020-01-26T15:36:54.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8805ea20 con 0x7fda7000b5a0 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920792622 0 0) 0x7fda70003230 con 0x7fda70003860 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda7000f300 con 0x7fda70003860 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030020585 0 0) 0x7fda880a6dc0 con 0x7fda700077d0 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda70003230 con 0x7fda700077d0 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 -- 172.21.15.170:0/1921829872 >> v1:172.21.15.170:6791/0 conn(0x7fda700077d0 legacy=0x7fda70009ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 -- 172.21.15.170:0/1921829872 >> v1:172.21.15.170:6790/0 conn(0x7fda70003860 legacy=0x7fda70003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4143499569 0 0) 0x7fda7000f300 con 0x7fda70003860 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 -- 172.21.15.170:0/1921829872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70054460 con 0x7fda7000b5a0 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda780049a0 tx=0x7fda78001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 -- 172.21.15.170:0/1921829872 reap_dead start 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda780049a0 tx=0x7fda78001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fda780049a0 tx=0x7fda78001de0).ready entity=mon.0 client_cookie=1dd6d1600d3d47a8 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:54.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fda780049a0 tx=0x7fda78001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fda78004760 con 0x7fda7000b5a0 2020-01-26T15:36:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fda780049a0 tx=0x7fda78001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8dbec700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fda780049a0 tx=0x7fda78001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80005c90 con 0x7fda7000b5a0 2020-01-26T15:36:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda86ffd700 1 -- 172.21.15.170:0/1921829872 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fda80010ab0 con 0x7fda7000b5a0 2020-01-26T15:36:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 -- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 msgr2=0x7fda7000dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fda780049a0 tx=0x7fda78001de0).stop 2020-01-26T15:36:54.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 -- 172.21.15.170:0/1921829872 shutdown_connections 2020-01-26T15:36:54.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 --2- 172.21.15.170:0/1921829872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7000b5a0 0x7fda7000dab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:54.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 -- 172.21.15.170:0/1921829872 >> 172.21.15.170:0/1921829872 conn(0x7fda88098e70 msgr2=0x7fda880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 -- 172.21.15.170:0/1921829872 shutdown_connections 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.088+0000 7fda8c98a700 1 -- 172.21.15.170:0/1921829872 wait complete. 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8c98a700 1 Processor -- start 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8c98a700 1 -- start start 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8c98a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda880a1b00 con 0x7fda880a16d0 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8c98a700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8806f910 con 0x7fda880a1200 2020-01-26T15:36:54.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8c98a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda880a0160 con 0x7fda8809fd30 2020-01-26T15:36:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8dbec700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fda8809fd30 0x7fda8813b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43830/0 (socket says 172.21.15.170:43830) 2020-01-26T15:36:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda8dbec700 1 -- 172.21.15.170:0/649655968 learned_addr learned my addr 172.21.15.170:0/649655968 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda87fff700 1 --1- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6790/0 conn(0x7fda880a1200 0x7fda88132fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48700/0 (socket says 172.21.15.170:48700) 2020-01-26T15:36:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961830990 0 0) 0x7fda880a0160 con 0x7fda8809fd30 2020-01-26T15:36:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003230 con 0x7fda8809fd30 2020-01-26T15:36:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842682470 0 0) 0x7fda8806f910 con 0x7fda880a1200 2020-01-26T15:36:54.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda880a0160 con 0x7fda880a1200 2020-01-26T15:36:54.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857881583 0 0) 0x7fda880a1b00 con 0x7fda880a16d0 2020-01-26T15:36:54.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda8806f910 con 0x7fda880a16d0 2020-01-26T15:36:54.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3349009815 0 0) 0x7fda68003230 con 0x7fda8809fd30 2020-01-26T15:36:54.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fda880a1b00 con 0x7fda8809fd30 2020-01-26T15:36:54.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fda80010d80 con 0x7fda8809fd30 2020-01-26T15:36:54.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3318570604 0 0) 0x7fda8806f910 con 0x7fda880a16d0 2020-01-26T15:36:54.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fda68003230 con 0x7fda880a16d0 2020-01-26T15:36:54.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fda7c0015c0 con 0x7fda880a16d0 2020-01-26T15:36:54.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6791/0 conn(0x7fda8809fd30 legacy=0x7fda8813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6790/0 conn(0x7fda880a1200 legacy=0x7fda88132fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6789/0 conn(0x7fda880a16d0 legacy=0x7fda881337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fda880a0160 con 0x7fda68003a90 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fda880a1b00 con 0x7fda68003f50 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.092+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68010830 con 0x7fda680050c0 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:54.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134125339 0 0) 0x7fda880a1b00 con 0x7fda68003f50 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda8806f910 con 0x7fda68003f50 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358844367 0 0) 0x7fda880a0160 con 0x7fda68003a90 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda880a1b00 con 0x7fda68003a90 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 -- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6791/0 conn(0x7fda68003f50 legacy=0x7fda6800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 -- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6790/0 conn(0x7fda68003a90 legacy=0x7fda680097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 -- 172.21.15.170:0/649655968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fda880723e0 con 0x7fda680050c0 2020-01-26T15:36:54.115 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda880a1200 con 0x7fda680050c0 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8809fd30 con 0x7fda680050c0 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fda7c001e00 con 0x7fda680050c0 2020-01-26T15:36:54.116 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.117 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78011df0 con 0x7fda680050c0 2020-01-26T15:36:54.117 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60003360 con 0x7fda680050c0 2020-01-26T15:36:54.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fda780049e0 con 0x7fda680050c0 2020-01-26T15:36:54.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.096+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fda7804ced0 con 0x7fda680050c0 2020-01-26T15:36:54.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.104+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.104+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fda78033080 con 0x7fda680050c0 2020-01-26T15:36:54.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.256+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda60003790 con 0x7fda680050c0 2020-01-26T15:36:54.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.256+0000 7fda87fff700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:54.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.256+0000 7fda84ff9700 1 -- 172.21.15.170:0/649655968 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fda780332e0 con 0x7fda680050c0 2020-01-26T15:36:54.261 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 >> v1:172.21.15.170:6800/17396 conn(0x7fda680485e0 legacy=0x7fda6804aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 msgr2=0x7fda68003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 --2- 172.21.15.170:0/649655968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda680050c0 0x7fda68003540 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fda7c005660 tx=0x7fda7c001bd0).stop 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8dbec700 1 -- 172.21.15.170:0/649655968 reap_dead start 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 shutdown_connections 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 >> 172.21.15.170:0/649655968 conn(0x7fda88097d00 msgr2=0x7fda8807fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 shutdown_connections 2020-01-26T15:36:54.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:54.260+0000 7fda8c98a700 1 -- 172.21.15.170:0/649655968 wait complete. 2020-01-26T15:36:54.263 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:54.271 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:36:57.272 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:36:57.393 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 Processor -- start 2020-01-26T15:36:57.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 -- start start 2020-01-26T15:36:57.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6f50146c30 0x7f6f50149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:57.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6f501495c0 0x7f6f5014ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:36:57.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500a5b80 con 0x7f6f500a5750 2020-01-26T15:36:57.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500a43f0 con 0x7f6f501495c0 2020-01-26T15:36:57.394 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f551cd700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500a5210 con 0x7f6f50146c30 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4f59e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f6f500a5750 0x7f6f500a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48714/0 (socket says 172.21.15.170:48714) 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4f59e700 1 -- 172.21.15.170:0/3418878722 learned_addr learned my addr 172.21.15.170:0/3418878722 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4ed9d700 -1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6791/0 conn(0x7f6f50146c30 0x7f6f50149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f549cc700 -1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6790/0 conn(0x7f6f501495c0 0x7f6f5014ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f549cc700 1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6790/0 conn(0x7f6f501495c0 0x7f6f5014ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4ed9d700 1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6791/0 conn(0x7f6f50146c30 0x7f6f50149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:57.395 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310392991 0 0) 0x7f6f500a5b80 con 0x7f6f500a5750 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f3c003230 con 0x7f6f500a5750 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 979305270 0 0) 0x7f6f3c003230 con 0x7f6f500a5750 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6791/0 conn(0x7f6f50146c30 msgr2=0x7f6f50149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6791/0 conn(0x7f6f50146c30 0x7f6f50149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6790/0 conn(0x7f6f501495c0 msgr2=0x7f6f5014ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6790/0 conn(0x7f6f501495c0 0x7f6f5014ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:57.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50080440 con 0x7f6f500a5750 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.388+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6f40001710 con 0x7f6f500a5750 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6f40001910 con 0x7f6f500a5750 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f4e59c700 1 -- 172.21.15.170:0/3418878722 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6f400045b0 con 0x7f6f500a5750 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 -- 172.21.15.170:0/3418878722 >> v1:172.21.15.170:6790/0 conn(0x7f6f500a5750 legacy=0x7f6f500a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 -- 172.21.15.170:0/3418878722 shutdown_connections 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6790/0 conn(0x7f6f501495c0 0x7f6f5014ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:57.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 --2- 172.21.15.170:0/3418878722 >> v2:172.21.15.170:6791/0 conn(0x7f6f50146c30 0x7f6f50149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:36:57.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 -- 172.21.15.170:0/3418878722 >> 172.21.15.170:0/3418878722 conn(0x7f6f5005e050 msgr2=0x7f6f50098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:57.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 -- 172.21.15.170:0/3418878722 shutdown_connections 2020-01-26T15:36:57.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 -- 172.21.15.170:0/3418878722 wait complete. 2020-01-26T15:36:57.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 Processor -- start 2020-01-26T15:36:57.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.392+0000 7f6f551cd700 1 -- start start 2020-01-26T15:36:57.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f551cd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6f500a1ea0 0x7f6f500a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:57.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f551cd700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500a22d0 con 0x7f6f50136660 2020-01-26T15:36:57.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f551cd700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5007da00 con 0x7f6f50095e90 2020-01-26T15:36:57.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f551cd700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6f50097aa0 con 0x7f6f500a1ea0 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f4f59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6f500a1ea0 0x7f6f500a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f4ed9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f6f50095e90 0x7f6f500962c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48722/0 (socket says 172.21.15.170:48722) 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f4ed9d700 1 -- 172.21.15.170:0/2133130258 learned_addr learned my addr 172.21.15.170:0/2133130258 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f4f59e700 1 --2- 172.21.15.170:0/2133130258 >> v2:172.21.15.170:6791/0 conn(0x7f6f500a1ea0 0x7f6f500a0e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694561086 0 0) 0x7f6f5007da00 con 0x7f6f50095e90 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f34003230 con 0x7f6f50095e90 2020-01-26T15:36:57.403 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585683696 0 0) 0x7f6f500a22d0 con 0x7f6f50136660 2020-01-26T15:36:57.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5007da00 con 0x7f6f50136660 2020-01-26T15:36:57.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1073530227 0 0) 0x7f6f34003230 con 0x7f6f50095e90 2020-01-26T15:36:57.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f500a22d0 con 0x7f6f50095e90 2020-01-26T15:36:57.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6f38002740 con 0x7f6f50095e90 2020-01-26T15:36:57.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3006640266 0 0) 0x7f6f5007da00 con 0x7f6f50136660 2020-01-26T15:36:57.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f34003230 con 0x7f6f50136660 2020-01-26T15:36:57.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6f48002980 con 0x7f6f50136660 2020-01-26T15:36:57.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 >> v2:172.21.15.170:6791/0 conn(0x7f6f500a1ea0 msgr2=0x7f6f500a0e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:36:57.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 --2- 172.21.15.170:0/2133130258 >> v2:172.21.15.170:6791/0 conn(0x7f6f500a1ea0 0x7f6f500a0e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:36:57.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 >> v1:172.21.15.170:6790/0 conn(0x7f6f50095e90 legacy=0x7f6f500962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 >> v1:172.21.15.170:6789/0 conn(0x7f6f50136660 legacy=0x7f6f50138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6f5007da00 con 0x7f6f34004da0 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6f34005300 con 0x7f6f34003ec0 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50097aa0 con 0x7f6f3400c000 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216337375 0 0) 0x7f6f34005300 con 0x7f6f34003ec0 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f3400e990 con 0x7f6f34003ec0 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605766273 0 0) 0x7f6f5007da00 con 0x7f6f34004da0 2020-01-26T15:36:57.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f34005300 con 0x7f6f34004da0 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 -- 172.21.15.170:0/2133130258 >> v1:172.21.15.170:6791/0 conn(0x7f6f34003ec0 legacy=0x7f6f340045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 -- 172.21.15.170:0/2133130258 >> v1:172.21.15.170:6790/0 conn(0x7f6f34004da0 legacy=0x7f6f3400a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 -- 172.21.15.170:0/2133130258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f6f500a13d0 con 0x7f6f3400c000 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5011faa0 con 0x7f6f3400c000 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f50121cb0 con 0x7f6f3400c000 2020-01-26T15:36:57.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:36:57.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6f48005cb0 con 0x7f6f3400c000 2020-01-26T15:36:57.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.396+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800e080 con 0x7f6f3400c000 2020-01-26T15:36:57.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.400+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f28003360 con 0x7f6f3400c000 2020-01-26T15:36:57.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.400+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.400+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.400+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f6f4800e270 con 0x7f6f3400c000 2020-01-26T15:36:57.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.400+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f6f4804dbb0 con 0x7f6f3400c000 2020-01-26T15:36:57.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.404+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.404+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f6f48033ce0 con 0x7f6f3400c000 2020-01-26T15:36:57.563 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6f28003790 con 0x7f6f3400c000 2020-01-26T15:36:57.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f549cc700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:36:57.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f47fff700 1 -- 172.21.15.170:0/2133130258 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6f48033f40 con 0x7f6f3400c000 2020-01-26T15:36:57.564 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:36:57.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 >> v1:172.21.15.170:6800/17396 conn(0x7f6f34048890 legacy=0x7f6f3404ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 msgr2=0x7f6f3400e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 --2- 172.21.15.170:0/2133130258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f3400c000 0x7f6f3400e440 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f6f48002280 tx=0x7f6f480117d0).stop 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f549cc700 1 -- 172.21.15.170:0/2133130258 reap_dead start 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f549cc700 1 -- 172.21.15.170:0/2133130258 reap_dead start 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 shutdown_connections 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 >> 172.21.15.170:0/2133130258 conn(0x7f6f500a4110 msgr2=0x7f6f5007f500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:36:57.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 shutdown_connections 2020-01-26T15:36:57.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:36:57.564+0000 7f6f551cd700 1 -- 172.21.15.170:0/2133130258 wait complete. 2020-01-26T15:36:57.584 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:00.585 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:00.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.700+0000 7ff560e35700 1 Processor -- start 2020-01-26T15:37:00.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.700+0000 7ff560e35700 1 -- start start 2020-01-26T15:37:00.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c05ea20 con 0x7ff55c0a6870 2020-01-26T15:37:00.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c098000 con 0x7ff55c05e5f0 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c05e050 con 0x7ff55c05edd0 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55bfff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff55c05edd0 0x7ff55c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43860/0 (socket says 172.21.15.170:43860) 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55bfff700 1 -- 172.21.15.170:0/2964456927 learned_addr learned my addr 172.21.15.170:0/2964456927 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947909183 0 0) 0x7ff55c098000 con 0x7ff55c05e5f0 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff544003230 con 0x7ff55c05e5f0 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220210324 0 0) 0x7ff55c05ea20 con 0x7ff55c0a6870 2020-01-26T15:37:00.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff55c098000 con 0x7ff55c0a6870 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756517880 0 0) 0x7ff55c05e050 con 0x7ff55c05edd0 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff55c05ea20 con 0x7ff55c05edd0 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4044606300 0 0) 0x7ff544003230 con 0x7ff55c05e5f0 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 >> v1:172.21.15.170:6791/0 conn(0x7ff55c05edd0 legacy=0x7ff55c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 >> v1:172.21.15.170:6789/0 conn(0x7ff55c0a6870 legacy=0x7ff55c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0a6ca0 con 0x7ff55c05e5f0 2020-01-26T15:37:00.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff550001710 con 0x7ff55c05e5f0 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5500019e0 con 0x7ff55c05e5f0 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff55affd700 1 -- 172.21.15.170:0/2964456927 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff550001ec0 con 0x7ff55c05e5f0 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- 172.21.15.170:0/2964456927 >> v1:172.21.15.170:6790/0 conn(0x7ff55c05e5f0 legacy=0x7ff55c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- 172.21.15.170:0/2964456927 shutdown_connections 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- 172.21.15.170:0/2964456927 >> 172.21.15.170:0/2964456927 conn(0x7ff55c098e70 msgr2=0x7ff55c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- 172.21.15.170:0/2964456927 shutdown_connections 2020-01-26T15:37:00.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.704+0000 7ff560e35700 1 -- 172.21.15.170:0/2964456927 wait complete. 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 Processor -- start 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 -- start start 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff55c0a1440 0x7ff55c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff55c140710 0x7ff55c07be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c07c810 con 0x7ff55c07c3e0 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c0a1bc0 con 0x7ff55c0a1440 2020-01-26T15:37:00.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c141700 con 0x7ff55c140710 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff55bfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff55c0a1440 0x7ff55c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff55b7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff55c140710 0x7ff55c07be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff55c07c3e0 0x7ff55c0a1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51866/0 (socket says 172.21.15.170:51866) 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 -- 172.21.15.170:0/4038683567 learned_addr learned my addr 172.21.15.170:0/4038683567 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff55bfff700 1 --2- 172.21.15.170:0/4038683567 >> v2:172.21.15.170:6790/0 conn(0x7ff55c0a1440 0x7ff55c1401c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff55b7fe700 1 --2- 172.21.15.170:0/4038683567 >> v2:172.21.15.170:6791/0 conn(0x7ff55c140710 0x7ff55c07be90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628030711 0 0) 0x7ff55c07c810 con 0x7ff55c07c3e0 2020-01-26T15:37:00.716 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c003230 con 0x7ff55c07c3e0 2020-01-26T15:37:00.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 570522729 0 0) 0x7ff53c003230 con 0x7ff55c07c3e0 2020-01-26T15:37:00.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff55c07c810 con 0x7ff55c07c3e0 2020-01-26T15:37:00.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff554001a50 con 0x7ff55c07c3e0 2020-01-26T15:37:00.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 >> v2:172.21.15.170:6791/0 conn(0x7ff55c140710 msgr2=0x7ff55c07be90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:00.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 --2- 172.21.15.170:0/4038683567 >> v2:172.21.15.170:6791/0 conn(0x7ff55c140710 0x7ff55c07be90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:00.717 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 >> v2:172.21.15.170:6790/0 conn(0x7ff55c0a1440 msgr2=0x7ff55c1401c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:00.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 --2- 172.21.15.170:0/4038683567 >> v2:172.21.15.170:6790/0 conn(0x7ff55c0a1440 0x7ff55c1401c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:00.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 >> v1:172.21.15.170:6789/0 conn(0x7ff55c07c3e0 legacy=0x7ff55c0a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:00.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff53c003230 con 0x7ff53c003a20 2020-01-26T15:37:00.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff53c00f320 con 0x7ff53c003f10 2020-01-26T15:37:00.718 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c0a1bc0 con 0x7ff53c00b800 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488527179 0 0) 0x7ff53c003230 con 0x7ff53c003a20 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c00f550 con 0x7ff53c003a20 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454294976 0 0) 0x7ff53c00f320 con 0x7ff53c003f10 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c003230 con 0x7ff53c003f10 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 -- 172.21.15.170:0/4038683567 >> v1:172.21.15.170:6791/0 conn(0x7ff53c003f10 legacy=0x7ff53c004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 -- 172.21.15.170:0/4038683567 >> v1:172.21.15.170:6790/0 conn(0x7ff53c003a20 legacy=0x7ff53c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 -- 172.21.15.170:0/4038683567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0979d0 con 0x7ff53c00b800 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c0a38f0 con 0x7ff53c00b800 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 -- 172.21.15.170:0/4038683567 reap_dead start 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c09e150 con 0x7ff53c00b800 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff554012310 con 0x7ff53c00b800 2020-01-26T15:37:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff554010070 con 0x7ff53c00b800 2020-01-26T15:37:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.708+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff5540126c0 con 0x7ff53c00b800 2020-01-26T15:37:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.712+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.712+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534003360 con 0x7ff53c00b800 2020-01-26T15:37:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.712+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ff554012910 con 0x7ff53c00b800 2020-01-26T15:37:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.712+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.712+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ff55404dc30 con 0x7ff53c00b800 2020-01-26T15:37:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.716+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.716+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ff554033dc0 con 0x7ff53c00b800 2020-01-26T15:37:00.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.868+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff534003790 con 0x7ff53c00b800 2020-01-26T15:37:00.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff562097700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:00.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff558ff9700 1 -- 172.21.15.170:0/4038683567 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff554034020 con 0x7ff53c00b800 2020-01-26T15:37:00.872 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:00.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 >> v1:172.21.15.170:6800/17396 conn(0x7ff53c040d70 legacy=0x7ff53c043280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 msgr2=0x7ff53c00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:00.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7ff554001930 tx=0x7ff5540116a0).stop 2020-01-26T15:37:00.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 shutdown_connections 2020-01-26T15:37:00.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 --2- 172.21.15.170:0/4038683567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff53c00b800 0x7ff53c00dc40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:00.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 >> 172.21.15.170:0/4038683567 conn(0x7ff55c0a7b50 msgr2=0x7ff55c145a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:00.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 shutdown_connections 2020-01-26T15:37:00.875 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:00.872+0000 7ff560e35700 1 -- 172.21.15.170:0/4038683567 wait complete. 2020-01-26T15:37:00.894 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:03.895 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:04.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 Processor -- start 2020-01-26T15:37:04.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 -- start start 2020-01-26T15:37:04.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f716805edd0 0x7f716805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7168098000 con 0x7f71680a6870 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716805e050 con 0x7f7168149040 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f71680a6ca0 con 0x7f716805edd0 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716759e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f716805edd0 0x7f716805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716759e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f716805edd0 0x7f716805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f7166d9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f71680a6870 0x7f716807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48760/0 (socket says 172.21.15.170:48760) 2020-01-26T15:37:04.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f7166d9d700 1 -- 172.21.15.170:0/3932827708 learned_addr learned my addr 172.21.15.170:0/3932827708 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:04.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716d0ab700 1 --1- 172.21.15.170:0/3932827708 >> v1:172.21.15.170:6791/0 conn(0x7f7168149040 0x7f716814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43882/0 (socket says 172.21.15.170:43882) 2020-01-26T15:37:04.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276608084 0 0) 0x7f716805e050 con 0x7f7168149040 2020-01-26T15:37:04.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7154003230 con 0x7f7168149040 2020-01-26T15:37:04.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334265141 0 0) 0x7f7168098000 con 0x7f71680a6870 2020-01-26T15:37:04.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716805e050 con 0x7f71680a6870 2020-01-26T15:37:04.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 586102490 0 0) 0x7f716805e050 con 0x7f71680a6870 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 >> v2:172.21.15.170:6791/0 conn(0x7f716805edd0 msgr2=0x7f716805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 --2- 172.21.15.170:0/3932827708 >> v2:172.21.15.170:6791/0 conn(0x7f716805edd0 0x7f716805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 >> v1:172.21.15.170:6791/0 conn(0x7f7168149040 legacy=0x7f716814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716814ecb0 con 0x7f71680a6870 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f71500016f0 con 0x7f71680a6870 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7150001940 con 0x7f71680a6870 2020-01-26T15:37:04.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716c8aa700 1 -- 172.21.15.170:0/3932827708 >> v1:172.21.15.170:6790/0 conn(0x7f71680a6870 legacy=0x7f716807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.012+0000 7f716659c700 1 -- 172.21.15.170:0/3932827708 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f71500045b0 con 0x7f71680a6870 2020-01-26T15:37:04.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- 172.21.15.170:0/3932827708 shutdown_connections 2020-01-26T15:37:04.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 --2- 172.21.15.170:0/3932827708 >> v2:172.21.15.170:6791/0 conn(0x7f716805edd0 0x7f716805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:04.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- 172.21.15.170:0/3932827708 >> 172.21.15.170:0/3932827708 conn(0x7f7168098e70 msgr2=0x7f71680a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:04.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- 172.21.15.170:0/3932827708 shutdown_connections 2020-01-26T15:37:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- 172.21.15.170:0/3932827708 wait complete. 2020-01-26T15:37:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 Processor -- start 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- start start 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7168122570 0x7f716809edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680a3ac0 con 0x7f716807b9d0 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716807c600 con 0x7f7168120480 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716c8aa700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f71681331e0 con 0x7f7168122570 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716759e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7168122570 0x7f716809edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f716759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f7168122570 0x7f716809edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:04.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f7166d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f7168120480 0x7f71681208b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43888/0 (socket says 172.21.15.170:43888) 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f7166d9d700 1 -- 172.21.15.170:0/277531158 learned_addr learned my addr 172.21.15.170:0/277531158 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245807615 0 0) 0x7f71680a3ac0 con 0x7f716807b9d0 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c003230 con 0x7f716807b9d0 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303759533 0 0) 0x7f716807c600 con 0x7f7168120480 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.016+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71680a3ac0 con 0x7f7168120480 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2482196932 0 0) 0x7f714c003230 con 0x7f716807b9d0 2020-01-26T15:37:04.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f716807c600 con 0x7f716807b9d0 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f7158001ca0 con 0x7f716807b9d0 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 >> v2:172.21.15.170:6790/0 conn(0x7f7168122570 msgr2=0x7f716809edc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 --2- 172.21.15.170:0/277531158 >> v2:172.21.15.170:6790/0 conn(0x7f7168122570 0x7f716809edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 >> v1:172.21.15.170:6791/0 conn(0x7f7168120480 legacy=0x7f71681208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 >> v1:172.21.15.170:6789/0 conn(0x7f716807b9d0 legacy=0x7f716807be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f71680a3ac0 con 0x7f714c003c30 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f714c003230 con 0x7f714c0040f0 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71681331e0 con 0x7f714c004de0 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83822139 0 0) 0x7f714c003230 con 0x7f714c0040f0 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c00e560 con 0x7f714c0040f0 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839043035 0 0) 0x7f71680a3ac0 con 0x7f714c003c30 2020-01-26T15:37:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c003230 con 0x7f714c003c30 2020-01-26T15:37:04.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3489930278 0 0) 0x7f714c003230 con 0x7f714c003c30 2020-01-26T15:37:04.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f71680a3ac0 con 0x7f714c003c30 2020-01-26T15:37:04.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f7160001920 con 0x7f714c003c30 2020-01-26T15:37:04.034 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 -- 172.21.15.170:0/277531158 >> v1:172.21.15.170:6791/0 conn(0x7f714c0040f0 legacy=0x7f714c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 -- 172.21.15.170:0/277531158 >> v1:172.21.15.170:6790/0 conn(0x7f714c003c30 legacy=0x7f714c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 -- 172.21.15.170:0/277531158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168121350 con 0x7f714c004de0 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7168120480 con 0x7f714c004de0 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7168120a30 con 0x7f714c004de0 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.035 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:04.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7150004b70 con 0x7f714c004de0 2020-01-26T15:37:04.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.037 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158011c60 con 0x7f714c004de0 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f715800b220 con 0x7f714c004de0 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.020+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.024+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f715800a570 con 0x7f714c004de0 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.024+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7140003360 con 0x7f714c004de0 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.024+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.038 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.024+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f715804cf40 con 0x7f714c004de0 2020-01-26T15:37:04.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.028+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.039 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.028+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f7158033070 con 0x7f714c004de0 2020-01-26T15:37:04.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7140003790 con 0x7f714c004de0 2020-01-26T15:37:04.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716d0ab700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:04.185 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f715ffff700 1 -- 172.21.15.170:0/277531158 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f71580332d0 con 0x7f714c004de0 2020-01-26T15:37:04.185 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:04.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 >> v1:172.21.15.170:6800/17396 conn(0x7f714c0482a0 legacy=0x7f714c04a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 msgr2=0x7f714c00e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:04.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716c8aa700 1 --2- 172.21.15.170:0/277531158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c004de0 0x7f714c00e010 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f7150004db0 tx=0x7f714c005530).stop 2020-01-26T15:37:04.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716d0ab700 1 -- 172.21.15.170:0/277531158 reap_dead start 2020-01-26T15:37:04.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.184+0000 7f716d0ab700 1 -- 172.21.15.170:0/277531158 reap_dead start 2020-01-26T15:37:04.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.188+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 shutdown_connections 2020-01-26T15:37:04.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.188+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 >> 172.21.15.170:0/277531158 conn(0x7f716805bf50 msgr2=0x7f716809de10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:04.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.188+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 shutdown_connections 2020-01-26T15:37:04.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:04.188+0000 7f716c8aa700 1 -- 172.21.15.170:0/277531158 wait complete. 2020-01-26T15:37:04.198 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:07.199 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:07.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.316+0000 7f89dd3b2700 1 Processor -- start 2020-01-26T15:37:07.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.316+0000 7f89dd3b2700 1 -- start start 2020-01-26T15:37:07.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f89d805e5f0 0x7f89d80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:07.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80a6dc0 con 0x7f89d805edd0 2020-01-26T15:37:07.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d805ea20 con 0x7f89d8149040 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f89d8098000 con 0x7f89d805e5f0 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dcbb1700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f89d805edd0 0x7f89d807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48776/0 (socket says 172.21.15.170:48776) 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dcbb1700 1 -- 172.21.15.170:0/2085831113 learned_addr learned my addr 172.21.15.170:0/2085831113 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d7fff700 -1 --2- 172.21.15.170:0/2085831113 >> v2:172.21.15.170:6790/0 conn(0x7f89d805e5f0 0x7f89d80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d7fff700 1 --2- 172.21.15.170:0/2085831113 >> v2:172.21.15.170:6790/0 conn(0x7f89d805e5f0 0x7f89d80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070946580 0 0) 0x7f89d80a6dc0 con 0x7f89d805edd0 2020-01-26T15:37:07.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c0003230 con 0x7f89d805edd0 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699778426 0 0) 0x7f89d805ea20 con 0x7f89d8149040 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d80a6dc0 con 0x7f89d8149040 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2863841571 0 0) 0x7f89d80a6dc0 con 0x7f89d8149040 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 >> v2:172.21.15.170:6790/0 conn(0x7f89d805e5f0 msgr2=0x7f89d80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 --2- 172.21.15.170:0/2085831113 >> v2:172.21.15.170:6790/0 conn(0x7f89d805e5f0 0x7f89d80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 >> v1:172.21.15.170:6790/0 conn(0x7f89d805edd0 legacy=0x7f89d807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d805e050 con 0x7f89d8149040 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f89d0001a70 con 0x7f89d8149040 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f89d0001d40 con 0x7f89d8149040 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89d77fe700 1 -- 172.21.15.170:0/2085831113 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f89d00021a0 con 0x7f89d8149040 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- 172.21.15.170:0/2085831113 >> v1:172.21.15.170:6791/0 conn(0x7f89d8149040 legacy=0x7f89d814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- 172.21.15.170:0/2085831113 shutdown_connections 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 --2- 172.21.15.170:0/2085831113 >> v2:172.21.15.170:6790/0 conn(0x7f89d805e5f0 0x7f89d80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- 172.21.15.170:0/2085831113 >> 172.21.15.170:0/2085831113 conn(0x7f89d8098e70 msgr2=0x7f89d80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:07.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- 172.21.15.170:0/2085831113 shutdown_connections 2020-01-26T15:37:07.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.320+0000 7f89dd3b2700 1 -- 172.21.15.170:0/2085831113 wait complete. 2020-01-26T15:37:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 Processor -- start 2020-01-26T15:37:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 -- start start 2020-01-26T15:37:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f89d809b350 0x7f89d8139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d809b780 con 0x7f89d8099a00 2020-01-26T15:37:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80a74e0 con 0x7f89d809e550 2020-01-26T15:37:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f89d80a0350 con 0x7f89d809b350 2020-01-26T15:37:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dcbb1700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f89d8099a00 0x7f89d807c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48782/0 (socket says 172.21.15.170:48782) 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dcbb1700 1 -- 172.21.15.170:0/1161133284 learned_addr learned my addr 172.21.15.170:0/1161133284 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89de614700 -1 --2- 172.21.15.170:0/1161133284 >> v2:172.21.15.170:6791/0 conn(0x7f89d809b350 0x7f89d8139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89de614700 1 --2- 172.21.15.170:0/1161133284 >> v2:172.21.15.170:6791/0 conn(0x7f89d809b350 0x7f89d8139a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183212896 0 0) 0x7f89d80a74e0 con 0x7f89d809e550 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b8003230 con 0x7f89d809e550 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484871685 0 0) 0x7f89d809b780 con 0x7f89d8099a00 2020-01-26T15:37:07.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d80a74e0 con 0x7f89d8099a00 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4121107834 0 0) 0x7f89b8003230 con 0x7f89d809e550 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89d809b780 con 0x7f89d809e550 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f89cc002600 con 0x7f89d809e550 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3349419581 0 0) 0x7f89d80a74e0 con 0x7f89d8099a00 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89b8003230 con 0x7f89d8099a00 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f89c8001890 con 0x7f89d8099a00 2020-01-26T15:37:07.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 895090299 0 0) 0x7f89d809b780 con 0x7f89d809e550 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 >> v2:172.21.15.170:6791/0 conn(0x7f89d809b350 msgr2=0x7f89d8139a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 --2- 172.21.15.170:0/1161133284 >> v2:172.21.15.170:6791/0 conn(0x7f89d809b350 0x7f89d8139a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 >> v1:172.21.15.170:6790/0 conn(0x7f89d8099a00 legacy=0x7f89d807c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8097a60 con 0x7f89d809e550 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d809aeb0 con 0x7f89d809e550 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f89cc000f10 con 0x7f89d809e550 2020-01-26T15:37:07.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8139f50 con 0x7f89d809e550 2020-01-26T15:37:07.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.324+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f89cc001370 con 0x7f89d809e550 2020-01-26T15:37:07.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.328+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f89cc0015f0 con 0x7f89d809e550 2020-01-26T15:37:07.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.328+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f89cc04b990 con 0x7f89d809e550 2020-01-26T15:37:07.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.328+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d8056600 con 0x7f89d809e550 2020-01-26T15:37:07.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.332+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f89cc030eb0 con 0x7f89d809e550 2020-01-26T15:37:07.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.488+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f89d809b120 con 0x7f89d809e550 2020-01-26T15:37:07.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89d57fa700 1 -- 172.21.15.170:0/1161133284 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f89cc04a5a0 con 0x7f89d809e550 2020-01-26T15:37:07.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 >> v1:172.21.15.170:6800/17396 conn(0x7f89b803e5a0 legacy=0x7f89b8040ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 >> v1:172.21.15.170:6791/0 conn(0x7f89d809e550 legacy=0x7f89d807d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 shutdown_connections 2020-01-26T15:37:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 --2- 172.21.15.170:0/1161133284 >> v2:172.21.15.170:6791/0 conn(0x7f89d809b350 0x7f89d8139a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 >> 172.21.15.170:0/1161133284 conn(0x7f89d805c110 msgr2=0x7f89d80a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 shutdown_connections 2020-01-26T15:37:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:07.492+0000 7f89dd3b2700 1 -- 172.21.15.170:0/1161133284 wait complete. 2020-01-26T15:37:07.504 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:10.505 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:10.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c928d700 1 Processor -- start 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c928d700 1 -- start start 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c928d700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fd7c405e5f0 0x7fd7c40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c928d700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40a6dc0 con 0x7fd7c4149040 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c928d700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c405ea20 con 0x7fd7c405edd0 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c928d700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c4098000 con 0x7fd7c405e5f0 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7ca4ef700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd7c4149040 0x7fd7c414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51916/0 (socket says 172.21.15.170:51916) 2020-01-26T15:37:10.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7ca4ef700 1 -- 172.21.15.170:0/2310429259 learned_addr learned my addr 172.21.15.170:0/2310429259 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c3fff700 -1 --2- 172.21.15.170:0/2310429259 >> v2:172.21.15.170:6791/0 conn(0x7fd7c405e5f0 0x7fd7c40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/2310429259 >> v2:172.21.15.170:6791/0 conn(0x7fd7c405e5f0 0x7fd7c40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638665073 0 0) 0x7fd7c40a6dc0 con 0x7fd7c4149040 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b4003230 con 0x7fd7c4149040 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480982962 0 0) 0x7fd7c405ea20 con 0x7fd7c405edd0 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.620+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c40a6dc0 con 0x7fd7c405edd0 2020-01-26T15:37:10.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1169929918 0 0) 0x7fd7c40a6dc0 con 0x7fd7c405edd0 2020-01-26T15:37:10.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 >> v2:172.21.15.170:6791/0 conn(0x7fd7c405e5f0 msgr2=0x7fd7c40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:10.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 --2- 172.21.15.170:0/2310429259 >> v2:172.21.15.170:6791/0 conn(0x7fd7c405e5f0 0x7fd7c40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:10.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 >> v1:172.21.15.170:6789/0 conn(0x7fd7c4149040 legacy=0x7fd7c414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c405e050 con 0x7fd7c405edd0 2020-01-26T15:37:10.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd7b80016f0 con 0x7fd7c405edd0 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd7b80018f0 con 0x7fd7c405edd0 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c37fe700 1 -- 172.21.15.170:0/2310429259 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd7b8001d50 con 0x7fd7c405edd0 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 -- 172.21.15.170:0/2310429259 >> v1:172.21.15.170:6791/0 conn(0x7fd7c405edd0 legacy=0x7fd7c407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 -- 172.21.15.170:0/2310429259 shutdown_connections 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 --2- 172.21.15.170:0/2310429259 >> v2:172.21.15.170:6791/0 conn(0x7fd7c405e5f0 0x7fd7c40a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 -- 172.21.15.170:0/2310429259 >> 172.21.15.170:0/2310429259 conn(0x7fd7c4098e70 msgr2=0x7fd7c40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:10.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 -- 172.21.15.170:0/2310429259 shutdown_connections 2020-01-26T15:37:10.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 -- 172.21.15.170:0/2310429259 wait complete. 2020-01-26T15:37:10.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 Processor -- start 2020-01-26T15:37:10.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.624+0000 7fd7c928d700 1 -- start start 2020-01-26T15:37:10.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c928d700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40a3f10 con 0x7fd7c40a3ae0 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c928d700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c41211c0 con 0x7fd7c4120d90 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c928d700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c411f430 con 0x7fd7c4122b60 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd7c40a3ae0 0x7fd7c40786e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51924/0 (socket says 172.21.15.170:51924) 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 -- 172.21.15.170:0/738451613 learned_addr learned my addr 172.21.15.170:0/738451613 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c8a8c700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fd7c4122b60 0x7fd7c4121cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43922/0 (socket says 172.21.15.170:43922) 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033624674 0 0) 0x7fd7c41211c0 con 0x7fd7c4120d90 2020-01-26T15:37:10.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a4003230 con 0x7fd7c4120d90 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489678916 0 0) 0x7fd7c40a3f10 con 0x7fd7c40a3ae0 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c41211c0 con 0x7fd7c40a3ae0 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551510019 0 0) 0x7fd7c411f430 con 0x7fd7c4122b60 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c40a3f10 con 0x7fd7c4122b60 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3199959978 0 0) 0x7fd7a4003230 con 0x7fd7c4120d90 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7c411f430 con 0x7fd7c4120d90 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd7bc001740 con 0x7fd7c4120d90 2020-01-26T15:37:10.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 978339439 0 0) 0x7fd7c41211c0 con 0x7fd7c40a3ae0 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7a4003230 con 0x7fd7c40a3ae0 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd7b0002700 con 0x7fd7c40a3ae0 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 >> v1:172.21.15.170:6791/0 conn(0x7fd7c4122b60 legacy=0x7fd7c4121cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 >> v1:172.21.15.170:6790/0 conn(0x7fd7c4120d90 legacy=0x7fd7c4138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 >> v1:172.21.15.170:6789/0 conn(0x7fd7c40a3ae0 legacy=0x7fd7c40786e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:10.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd7c411f430 con 0x7fd7a4005130 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd7c40a3f10 con 0x7fd7a400cf50 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4012bc0 con 0x7fd7a4003d40 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365780932 0 0) 0x7fd7c411f430 con 0x7fd7a4005130 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c41211c0 con 0x7fd7a4005130 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443510863 0 0) 0x7fd7c40a3f10 con 0x7fd7a400cf50 2020-01-26T15:37:10.637 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c411f430 con 0x7fd7a400cf50 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 -- 172.21.15.170:0/738451613 >> v1:172.21.15.170:6791/0 conn(0x7fd7a400cf50 legacy=0x7fd7a400f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 -- 172.21.15.170:0/738451613 >> v1:172.21.15.170:6790/0 conn(0x7fd7a4005130 legacy=0x7fd7a4003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 -- 172.21.15.170:0/738451613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fd7c4078ee0 con 0x7fd7a4003d40 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.628+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c4120d90 con 0x7fd7a4003d40 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c4122d80 con 0x7fd7a4003d40 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd7b000cc10 con 0x7fd7a4003d40 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000ce10 con 0x7fd7a4003d40 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c003360 con 0x7fd7a4003d40 2020-01-26T15:37:10.639 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fd7b000e160 con 0x7fd7a4003d40 2020-01-26T15:37:10.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.632+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fd7b004d4e0 con 0x7fd7a4003d40 2020-01-26T15:37:10.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.640+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.640 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.640+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fd7b0033630 con 0x7fd7a4003d40 2020-01-26T15:37:10.794 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.792+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd79c003790 con 0x7fd7a4003d40 2020-01-26T15:37:10.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c3fff700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:10.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c17fa700 1 -- 172.21.15.170:0/738451613 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fd7b0033890 con 0x7fd7a4003d40 2020-01-26T15:37:10.796 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:10.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 >> v1:172.21.15.170:6800/17396 conn(0x7fd7a404a7f0 legacy=0x7fd7a404cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 msgr2=0x7fd7a400a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:10.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 --2- 172.21.15.170:0/738451613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a4003d40 0x7fd7a400a7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fd7b0002510 tx=0x7fd7b0011500).stop 2020-01-26T15:37:10.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7ca4ef700 1 -- 172.21.15.170:0/738451613 reap_dead start 2020-01-26T15:37:10.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 shutdown_connections 2020-01-26T15:37:10.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 >> 172.21.15.170:0/738451613 conn(0x7fd7c4098ef0 msgr2=0x7fd7c407e600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:10.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 shutdown_connections 2020-01-26T15:37:10.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:10.796+0000 7fd7c928d700 1 -- 172.21.15.170:0/738451613 wait complete. 2020-01-26T15:37:10.808 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:13.810 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:13.932 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 Processor -- start 2020-01-26T15:37:13.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 -- start start 2020-01-26T15:37:13.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f86c805edd0 0x7f86c805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:13.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f86c8149040 0x7f86c814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:13.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c8098000 con 0x7f86c80a6870 2020-01-26T15:37:13.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f86c805e050 con 0x7f86c8149040 2020-01-26T15:37:13.933 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cdccb700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80a6ca0 con 0x7f86c805edd0 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cccc9700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f86c80a6870 0x7f86c807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48810/0 (socket says 172.21.15.170:48810) 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cccc9700 1 -- 172.21.15.170:0/1027019757 learned_addr learned my addr 172.21.15.170:0/1027019757 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cd4ca700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f86c805edd0 0x7f86c805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cef2d700 -1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6790/0 conn(0x7f86c8149040 0x7f86c814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cef2d700 1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6790/0 conn(0x7f86c8149040 0x7f86c814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86cd4ca700 1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6791/0 conn(0x7f86c805edd0 0x7f86c805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:13.934 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510828221 0 0) 0x7f86c8098000 con 0x7f86c80a6870 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b4003230 con 0x7f86c80a6870 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3465796106 0 0) 0x7f86b4003230 con 0x7f86c80a6870 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6791/0 conn(0x7f86c805edd0 msgr2=0x7f86c805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6791/0 conn(0x7f86c805edd0 0x7f86c805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6790/0 conn(0x7f86c8149040 msgr2=0x7f86c814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6790/0 conn(0x7f86c8149040 0x7f86c814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:13.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c814c9e0 con 0x7f86c80a6870 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.928+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f86b8001710 con 0x7f86c80a6870 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f86b8001910 con 0x7f86c80a6870 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86bffff700 1 -- 172.21.15.170:0/1027019757 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f86b80045b0 con 0x7f86c80a6870 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 -- 172.21.15.170:0/1027019757 >> v1:172.21.15.170:6790/0 conn(0x7f86c80a6870 legacy=0x7f86c807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 -- 172.21.15.170:0/1027019757 shutdown_connections 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6790/0 conn(0x7f86c8149040 0x7f86c814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 --2- 172.21.15.170:0/1027019757 >> v2:172.21.15.170:6791/0 conn(0x7f86c805edd0 0x7f86c805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:13.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 -- 172.21.15.170:0/1027019757 >> 172.21.15.170:0/1027019757 conn(0x7f86c8098e70 msgr2=0x7f86c80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:13.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 -- 172.21.15.170:0/1027019757 shutdown_connections 2020-01-26T15:37:13.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 -- 172.21.15.170:0/1027019757 wait complete. 2020-01-26T15:37:13.940 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.932+0000 7f86cdccb700 1 Processor -- start 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cdccb700 1 -- start start 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cdccb700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f86c80a4950 0x7f86c81296b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cdccb700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c807ae00 con 0x7f86c80a2270 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cdccb700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80a26a0 con 0x7f86c8134b20 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cdccb700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80a1560 con 0x7f86c80a4950 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cccc9700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f86c80a4950 0x7f86c81296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:13.941 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cccc9700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f86c80a4950 0x7f86c81296b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cd4ca700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f86c80a2270 0x7f86c812c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51942/0 (socket says 172.21.15.170:51942) 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cd4ca700 1 -- 172.21.15.170:0/3506936174 learned_addr learned my addr 172.21.15.170:0/3506936174 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951536754 0 0) 0x7f86c807ae00 con 0x7f86c80a2270 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a8003230 con 0x7f86c80a2270 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931105322 0 0) 0x7f86c80a26a0 con 0x7f86c8134b20 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c807ae00 con 0x7f86c8134b20 2020-01-26T15:37:13.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3871400300 0 0) 0x7f86a8003230 con 0x7f86c80a2270 2020-01-26T15:37:13.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f86c80a26a0 con 0x7f86c80a2270 2020-01-26T15:37:13.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f86c4002780 con 0x7f86c80a2270 2020-01-26T15:37:13.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 >> v2:172.21.15.170:6790/0 conn(0x7f86c80a4950 msgr2=0x7f86c81296b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:13.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 --2- 172.21.15.170:0/3506936174 >> v2:172.21.15.170:6790/0 conn(0x7f86c80a4950 0x7f86c81296b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:13.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 >> v1:172.21.15.170:6791/0 conn(0x7f86c8134b20 legacy=0x7f86c8136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:13.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 >> v1:172.21.15.170:6789/0 conn(0x7f86c80a2270 legacy=0x7f86c812c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f86a8003230 con 0x7f86a80040f0 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f86a800e560 con 0x7f86a8003c30 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80a1560 con 0x7f86a8004eb0 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183421383 0 0) 0x7f86a800e560 con 0x7f86a8003c30 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a800e8e0 con 0x7f86a8003c30 2020-01-26T15:37:13.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216210793 0 0) 0x7f86a8003230 con 0x7f86a80040f0 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cef2d700 1 -- 172.21.15.170:0/3506936174 >> v1:172.21.15.170:6791/0 conn(0x7f86a8003c30 legacy=0x7f86a80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cef2d700 1 -- 172.21.15.170:0/3506936174 >> v1:172.21.15.170:6790/0 conn(0x7f86a80040f0 legacy=0x7f86a800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cef2d700 1 -- 172.21.15.170:0/3506936174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80a45d0 con 0x7f86a8004eb0 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80a39a0 con 0x7f86a8004eb0 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.936+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c80a4d80 con 0x7f86a8004eb0 2020-01-26T15:37:13.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f86c0012790 con 0x7f86a8004eb0 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c0012990 con 0x7f86a8004eb0 2020-01-26T15:37:13.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f86c0012df0 con 0x7f86a8004eb0 2020-01-26T15:37:13.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a0003360 con 0x7f86a8004eb0 2020-01-26T15:37:13.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f86c00113a0 con 0x7f86a8004eb0 2020-01-26T15:37:13.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.940+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f86c004da20 con 0x7f86a8004eb0 2020-01-26T15:37:13.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.944+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:13.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:13.944+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f86c0033b70 con 0x7f86a8004eb0 2020-01-26T15:37:14.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f86a0003790 con 0x7f86a8004eb0 2020-01-26T15:37:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cef2d700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:14.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86bdffb700 1 -- 172.21.15.170:0/3506936174 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f86c0033dd0 con 0x7f86a8004eb0 2020-01-26T15:37:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:14.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 >> v1:172.21.15.170:6800/17396 conn(0x7f86a804c990 legacy=0x7f86a804eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:14.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 msgr2=0x7f86a800e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f86c00011d0 tx=0x7f86c0010d50).stop 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cef2d700 1 -- 172.21.15.170:0/3506936174 reap_dead start 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 shutdown_connections 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 --2- 172.21.15.170:0/3506936174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86a8004eb0 0x7f86a800e010 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 >> 172.21.15.170:0/3506936174 conn(0x7f86c805bdd0 msgr2=0x7f86c811ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 shutdown_connections 2020-01-26T15:37:14.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:14.100+0000 7f86cdccb700 1 -- 172.21.15.170:0/3506936174 wait complete. 2020-01-26T15:37:14.113 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:17.114 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:17.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 Processor -- start 2020-01-26T15:37:17.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 -- start start 2020-01-26T15:37:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f3de005e5f0 0x7f3de00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3de0149040 0x7f3de014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00a6dc0 con 0x7f3de005edd0 2020-01-26T15:37:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3de005ea20 con 0x7f3de0149040 2020-01-26T15:37:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3de0098000 con 0x7f3de005e5f0 2020-01-26T15:37:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de5fbd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f3de005e5f0 0x7f3de00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de67be700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f3de005edd0 0x7f3de007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43956/0 (socket says 172.21.15.170:43956) 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de67be700 1 -- 172.21.15.170:0/492855229 learned_addr learned my addr 172.21.15.170:0/492855229 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de5fbd700 1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6791/0 conn(0x7f3de005e5f0 0x7f3de00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de8221700 -1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6790/0 conn(0x7f3de0149040 0x7f3de014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de8221700 1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6790/0 conn(0x7f3de0149040 0x7f3de014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662786266 0 0) 0x7f3de00a6dc0 con 0x7f3de005edd0 2020-01-26T15:37:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dcc003230 con 0x7f3de005edd0 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2806341171 0 0) 0x7f3dcc003230 con 0x7f3de005edd0 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6791/0 conn(0x7f3de005e5f0 msgr2=0x7f3de00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6791/0 conn(0x7f3de005e5f0 0x7f3de00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6790/0 conn(0x7f3de0149040 msgr2=0x7f3de014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6790/0 conn(0x7f3de0149040 0x7f3de014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de005e050 con 0x7f3de005edd0 2020-01-26T15:37:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3dd4001710 con 0x7f3de005edd0 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3dd4001aa0 con 0x7f3de005edd0 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de57bc700 1 -- 172.21.15.170:0/492855229 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3dd4004760 con 0x7f3de005edd0 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.228+0000 7f3de6fbf700 1 -- 172.21.15.170:0/492855229 >> v1:172.21.15.170:6791/0 conn(0x7f3de005edd0 legacy=0x7f3de007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- 172.21.15.170:0/492855229 shutdown_connections 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6790/0 conn(0x7f3de0149040 0x7f3de014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 --2- 172.21.15.170:0/492855229 >> v2:172.21.15.170:6791/0 conn(0x7f3de005e5f0 0x7f3de00a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- 172.21.15.170:0/492855229 >> 172.21.15.170:0/492855229 conn(0x7f3de0098e70 msgr2=0x7f3de00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- 172.21.15.170:0/492855229 shutdown_connections 2020-01-26T15:37:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- 172.21.15.170:0/492855229 wait complete. 2020-01-26T15:37:17.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 Processor -- start 2020-01-26T15:37:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- start start 2020-01-26T15:37:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3de01310e0 0x7f3de0131510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de0060fc0 con 0x7f3de007c9e0 2020-01-26T15:37:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de0131a60 con 0x7f3de009eff0 2020-01-26T15:37:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de6fbf700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3de009f820 con 0x7f3de01310e0 2020-01-26T15:37:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de5fbd700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3de01310e0 0x7f3de0131510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de67be700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f3de009eff0 0x7f3de0060640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43962/0 (socket says 172.21.15.170:43962) 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de67be700 1 -- 172.21.15.170:0/3324301827 learned_addr learned my addr 172.21.15.170:0/3324301827 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3de5fbd700 1 --2- 172.21.15.170:0/3324301827 >> v2:172.21.15.170:6790/0 conn(0x7f3de01310e0 0x7f3de0131510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608289907 0 0) 0x7f3de0131a60 con 0x7f3de009eff0 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc8003230 con 0x7f3de009eff0 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475310057 0 0) 0x7f3de0060fc0 con 0x7f3de007c9e0 2020-01-26T15:37:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.232+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de0131a60 con 0x7f3de007c9e0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1483222874 0 0) 0x7f3dc8003230 con 0x7f3de009eff0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3de0060fc0 con 0x7f3de009eff0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3dd40047e0 con 0x7f3de009eff0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 36517326 0 0) 0x7f3de0131a60 con 0x7f3de007c9e0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3dc8003230 con 0x7f3de007c9e0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1621601917 0 0) 0x7f3de0060fc0 con 0x7f3de009eff0 2020-01-26T15:37:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 >> v2:172.21.15.170:6790/0 conn(0x7f3de01310e0 msgr2=0x7f3de0131510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 --2- 172.21.15.170:0/3324301827 >> v2:172.21.15.170:6790/0 conn(0x7f3de01310e0 0x7f3de0131510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 >> v1:172.21.15.170:6789/0 conn(0x7f3de007c9e0 legacy=0x7f3de007ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de007d610 con 0x7f3de009eff0 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de0139770 con 0x7f3de009eff0 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0139cc0 con 0x7f3de009eff0 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3dd4001230 con 0x7f3de009eff0 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3dd4004be0 con 0x7f3de009eff0 2020-01-26T15:37:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc003360 con 0x7f3de009eff0 2020-01-26T15:37:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f3dd4010620 con 0x7f3de009eff0 2020-01-26T15:37:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.236+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f3dd404bac0 con 0x7f3de009eff0 2020-01-26T15:37:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.240+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f3dd4030fe0 con 0x7f3de009eff0 2020-01-26T15:37:17.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3dbc0037d0 con 0x7f3de009eff0 2020-01-26T15:37:17.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3dd2ffd700 1 -- 172.21.15.170:0/3324301827 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f3dd404a6d0 con 0x7f3de009eff0 2020-01-26T15:37:17.399 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 >> v1:172.21.15.170:6800/17396 conn(0x7f3dc803e500 legacy=0x7f3dc8040a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 >> v1:172.21.15.170:6791/0 conn(0x7f3de009eff0 legacy=0x7f3de0060640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 shutdown_connections 2020-01-26T15:37:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 --2- 172.21.15.170:0/3324301827 >> v2:172.21.15.170:6790/0 conn(0x7f3de01310e0 0x7f3de0131510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 >> 172.21.15.170:0/3324301827 conn(0x7f3de0025150 msgr2=0x7f3de007de40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:17.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 shutdown_connections 2020-01-26T15:37:17.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:17.400+0000 7f3de6fbf700 1 -- 172.21.15.170:0/3324301827 wait complete. 2020-01-26T15:37:17.419 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:20.420 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:20.753 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.748+0000 7fe30a172700 1 Processor -- start 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.748+0000 7fe30a172700 1 -- start start 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe30405e5f0 0x7fe3040a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe304149040 0x7fe30414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040a6dc0 con 0x7fe30405edd0 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe30405ea20 con 0x7fe30405e5f0 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe304098000 con 0x7fe304149040 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe309170700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe30405e5f0 0x7fe3040a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:20.754 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30b3d4700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe304149040 0x7fe30414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe309971700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe30405edd0 0x7fe30407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48844/0 (socket says 172.21.15.170:48844) 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe309971700 1 -- 172.21.15.170:0/249360274 learned_addr learned my addr 172.21.15.170:0/249360274 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe309170700 1 --2- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6790/0 conn(0x7fe30405e5f0 0x7fe3040a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6791/0 conn(0x7fe304149040 0x7fe30414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444102223 0 0) 0x7fe3040a6dc0 con 0x7fe30405edd0 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f0003230 con 0x7fe30405edd0 2020-01-26T15:37:20.755 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 783934681 0 0) 0x7fe2f0003230 con 0x7fe30405edd0 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6791/0 conn(0x7fe304149040 msgr2=0x7fe30414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 --2- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6791/0 conn(0x7fe304149040 0x7fe30414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6790/0 conn(0x7fe30405e5f0 msgr2=0x7fe3040a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 --2- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6790/0 conn(0x7fe30405e5f0 0x7fe3040a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30405e050 con 0x7fe30405edd0 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe300001a90 con 0x7fe30405edd0 2020-01-26T15:37:20.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe300001e20 con 0x7fe30405edd0 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30896f700 1 -- 172.21.15.170:0/249360274 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe300004ae0 con 0x7fe30405edd0 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- 172.21.15.170:0/249360274 >> v1:172.21.15.170:6790/0 conn(0x7fe30405edd0 legacy=0x7fe30407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- 172.21.15.170:0/249360274 shutdown_connections 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 --2- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6791/0 conn(0x7fe304149040 0x7fe30414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 --2- 172.21.15.170:0/249360274 >> v2:172.21.15.170:6790/0 conn(0x7fe30405e5f0 0x7fe3040a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- 172.21.15.170:0/249360274 >> 172.21.15.170:0/249360274 conn(0x7fe304098e70 msgr2=0x7fe3040a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:20.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- 172.21.15.170:0/249360274 shutdown_connections 2020-01-26T15:37:20.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- 172.21.15.170:0/249360274 wait complete. 2020-01-26T15:37:20.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 Processor -- start 2020-01-26T15:37:20.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.752+0000 7fe30a172700 1 -- start start 2020-01-26T15:37:20.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30a172700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040a2620 con 0x7fe3040a4b70 2020-01-26T15:37:20.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30a172700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe304121970 con 0x7fe3040a2110 2020-01-26T15:37:20.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30a172700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30407d610 con 0x7fe30407d1e0 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe309971700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe3040a2110 0x7fe3040a4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48850/0 (socket says 172.21.15.170:48850) 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe309971700 1 -- 172.21.15.170:0/763521882 learned_addr learned my addr 172.21.15.170:0/763521882 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe309170700 1 --1- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6789/0 conn(0x7fe3040a4b70 0x7fe30407c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51976/0 (socket says 172.21.15.170:51976) 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293830198 0 0) 0x7fe304121970 con 0x7fe3040a2110 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2ec003230 con 0x7fe3040a2110 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652822386 0 0) 0x7fe30407d610 con 0x7fe30407d1e0 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe304121970 con 0x7fe30407d1e0 2020-01-26T15:37:20.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716885341 0 0) 0x7fe3040a2620 con 0x7fe3040a4b70 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30407d610 con 0x7fe3040a4b70 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2767984989 0 0) 0x7fe2ec003230 con 0x7fe3040a2110 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3040a2620 con 0x7fe3040a2110 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe3000017a0 con 0x7fe3040a2110 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2147347365 0 0) 0x7fe304121970 con 0x7fe30407d1e0 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2ec003230 con 0x7fe30407d1e0 2020-01-26T15:37:20.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe2fc0025c0 con 0x7fe30407d1e0 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1017261603 0 0) 0x7fe30407d610 con 0x7fe3040a4b70 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe304121970 con 0x7fe3040a4b70 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe2f4002610 con 0x7fe3040a4b70 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6791/0 conn(0x7fe30407d1e0 legacy=0x7fe30413b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6790/0 conn(0x7fe3040a2110 legacy=0x7fe3040a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6789/0 conn(0x7fe3040a4b70 legacy=0x7fe30407c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:20.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe3040a2620 con 0x7fe2ec0087e0 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe30407d610 con 0x7fe2ec0045a0 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec005290 con 0x7fe2ec00c430 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465434472 0 0) 0x7fe30407d610 con 0x7fe2ec0045a0 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2ec00edc0 con 0x7fe2ec0045a0 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614817417 0 0) 0x7fe3040a2620 con 0x7fe2ec0087e0 2020-01-26T15:37:20.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30407d610 con 0x7fe2ec0087e0 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 -- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6791/0 conn(0x7fe2ec0045a0 legacy=0x7fe2ec0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 -- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6790/0 conn(0x7fe2ec0087e0 legacy=0x7fe2ec00ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 -- 172.21.15.170:0/763521882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fe30409ed80 con 0x7fe2ec00c430 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3040a2110 con 0x7fe2ec00c430 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30407d1e0 con 0x7fe2ec00c430 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe2fc011c40 con 0x7fe2ec00c430 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.756+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00ea30 con 0x7fe2ec00c430 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.760+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.760+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e0003360 con 0x7fe2ec00c430 2020-01-26T15:37:20.768 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.760+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe2fc00ec20 con 0x7fe2ec00c430 2020-01-26T15:37:20.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.760+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.760+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fe2fc04d090 con 0x7fe2ec00c430 2020-01-26T15:37:20.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.764+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.769 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.764+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe2fc0331e0 con 0x7fe2ec00c430 2020-01-26T15:37:20.927 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe2e0003790 con 0x7fe2ec00c430 2020-01-26T15:37:20.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30b3d4700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:20.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe2fa7fc700 1 -- 172.21.15.170:0/763521882 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe2fc033440 con 0x7fe2ec00c430 2020-01-26T15:37:20.929 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:20.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 >> v1:172.21.15.170:6800/17396 conn(0x7fe2ec048aa0 legacy=0x7fe2ec04afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 msgr2=0x7fe2ec00e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:20.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 --2- 172.21.15.170:0/763521882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2ec00c430 0x7fe2ec00e870 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fe2fc002390 tx=0x7fe2fc011230).stop 2020-01-26T15:37:20.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30b3d4700 1 -- 172.21.15.170:0/763521882 reap_dead start 2020-01-26T15:37:20.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 shutdown_connections 2020-01-26T15:37:20.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 >> 172.21.15.170:0/763521882 conn(0x7fe3040a1150 msgr2=0x7fe304024bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:20.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 shutdown_connections 2020-01-26T15:37:20.931 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:20.928+0000 7fe30a172700 1 -- 172.21.15.170:0/763521882 wait complete. 2020-01-26T15:37:20.941 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:23.943 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:24.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e68ce700 1 Processor -- start 2020-01-26T15:37:24.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e68ce700 1 -- start start 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e68ce700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fd6e005edd0 0x7fd6e005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e68ce700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e0098000 con 0x7fd6e00a6870 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e68ce700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e005e050 con 0x7fd6e0149040 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e68ce700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00a6ca0 con 0x7fd6e005edd0 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e60cd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fd6e005edd0 0x7fd6e005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e60cd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fd6e005edd0 0x7fd6e005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:24.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e7b30700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fd6e0149040 0x7fd6e014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:43994/0 (socket says 172.21.15.170:43994) 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e7b30700 1 -- 172.21.15.170:0/541789906 learned_addr learned my addr 172.21.15.170:0/541789906 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e58cc700 1 --1- 172.21.15.170:0/541789906 >> v1:172.21.15.170:6789/0 conn(0x7fd6e00a6870 0x7fd6e007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51990/0 (socket says 172.21.15.170:51990) 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829262893 0 0) 0x7fd6e005e050 con 0x7fd6e0149040 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6cc003230 con 0x7fd6e0149040 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027826541 0 0) 0x7fd6e0098000 con 0x7fd6e00a6870 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.056+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e005e050 con 0x7fd6e00a6870 2020-01-26T15:37:24.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1573915933 0 0) 0x7fd6e005e050 con 0x7fd6e00a6870 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 >> v2:172.21.15.170:6791/0 conn(0x7fd6e005edd0 msgr2=0x7fd6e005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 --2- 172.21.15.170:0/541789906 >> v2:172.21.15.170:6791/0 conn(0x7fd6e005edd0 0x7fd6e005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 >> v1:172.21.15.170:6791/0 conn(0x7fd6e0149040 legacy=0x7fd6e014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e014ecb0 con 0x7fd6e00a6870 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd6d00016f0 con 0x7fd6e00a6870 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 >> v1:172.21.15.170:6789/0 conn(0x7fd6e00a6870 legacy=0x7fd6e007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd6e005e050 con 0x7fd6cc00a7f0 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd6cc003230 con 0x7fd6cc004b20 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00a6ca0 con 0x7fd6cc004f50 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688947567 0 0) 0x7fd6e005e050 con 0x7fd6cc00a7f0 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e0098000 con 0x7fd6cc00a7f0 2020-01-26T15:37:24.066 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285699603 0 0) 0x7fd6cc003230 con 0x7fd6cc004b20 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e005e050 con 0x7fd6cc004b20 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 -- 172.21.15.170:0/541789906 >> v1:172.21.15.170:6791/0 conn(0x7fd6cc004b20 legacy=0x7fd6cc003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 -- 172.21.15.170:0/541789906 >> v1:172.21.15.170:6790/0 conn(0x7fd6cc00a7f0 legacy=0x7fd6cc00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 -- 172.21.15.170:0/541789906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc054560 con 0x7fd6cc004f50 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.067 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).ready entity=mon.0 client_cookie=e955e36a6636fdd server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd6d0010ab0 con 0x7fd6cc004f50 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0010cb0 con 0x7fd6cc004f50 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e50cb700 1 -- 172.21.15.170:0/541789906 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd6d00056d0 con 0x7fd6cc004f50 2020-01-26T15:37:24.068 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e68ce700 1 -- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 msgr2=0x7fd6cc003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e68ce700 1 --2- 172.21.15.170:0/541789906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6cc004f50 0x7fd6cc003d40 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fd6d0000fe0 tx=0x7fd6d000c050).stop 2020-01-26T15:37:24.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e7b30700 1 -- 172.21.15.170:0/541789906 reap_dead start 2020-01-26T15:37:24.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e68ce700 1 -- 172.21.15.170:0/541789906 shutdown_connections 2020-01-26T15:37:24.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e68ce700 1 -- 172.21.15.170:0/541789906 >> 172.21.15.170:0/541789906 conn(0x7fd6e0098e70 msgr2=0x7fd6e00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:24.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e68ce700 1 -- 172.21.15.170:0/541789906 shutdown_connections 2020-01-26T15:37:24.069 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.060+0000 7fd6e68ce700 1 -- 172.21.15.170:0/541789906 wait complete. 2020-01-26T15:37:24.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e68ce700 1 Processor -- start 2020-01-26T15:37:24.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e68ce700 1 -- start start 2020-01-26T15:37:24.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e68ce700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e009bb40 con 0x7fd6e009dc60 2020-01-26T15:37:24.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e68ce700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e007de00 con 0x7fd6e00653b0 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e68ce700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e007e030 con 0x7fd6e00a3640 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e58cc700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd6e009dc60 0x7fd6e00a4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52002/0 (socket says 172.21.15.170:52002) 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e60cd700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fd6e00653b0 0x7fd6e00a4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48876/0 (socket says 172.21.15.170:48876) 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e58cc700 1 -- 172.21.15.170:0/4142696843 learned_addr learned my addr 172.21.15.170:0/4142696843 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6e7b30700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fd6e00a3640 0x7fd6e013bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44004/0 (socket says 172.21.15.170:44004) 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488586273 0 0) 0x7fd6e007e030 con 0x7fd6e00a3640 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c8003230 con 0x7fd6e00a3640 2020-01-26T15:37:24.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330523557 0 0) 0x7fd6e009bb40 con 0x7fd6e009dc60 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e007e030 con 0x7fd6e009dc60 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847696707 0 0) 0x7fd6e007de00 con 0x7fd6e00653b0 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e009bb40 con 0x7fd6e00653b0 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1561242706 0 0) 0x7fd6c8003230 con 0x7fd6e00a3640 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6e007de00 con 0x7fd6e00a3640 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd6d8001680 con 0x7fd6e00a3640 2020-01-26T15:37:24.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 412931454 0 0) 0x7fd6e009bb40 con 0x7fd6e00653b0 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6c8003230 con 0x7fd6e00653b0 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1084123059 0 0) 0x7fd6e007e030 con 0x7fd6e009dc60 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6e009bb40 con 0x7fd6e009dc60 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd6dc001500 con 0x7fd6e00653b0 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fd6d000ed00 con 0x7fd6e009dc60 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 >> v1:172.21.15.170:6791/0 conn(0x7fd6e00a3640 legacy=0x7fd6e013bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 >> v1:172.21.15.170:6790/0 conn(0x7fd6e00653b0 legacy=0x7fd6e00a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 >> v1:172.21.15.170:6789/0 conn(0x7fd6e009dc60 legacy=0x7fd6e00a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd6e007de00 con 0x7fd6c8003540 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd6e007e030 con 0x7fd6c800b170 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.064+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80041e0 con 0x7fd6c80087e0 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501583288 0 0) 0x7fd6e007de00 con 0x7fd6c8003540 2020-01-26T15:37:24.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c800edc0 con 0x7fd6c8003540 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694305870 0 0) 0x7fd6e007e030 con 0x7fd6c800b170 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e007de00 con 0x7fd6c800b170 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 -- 172.21.15.170:0/4142696843 >> v1:172.21.15.170:6791/0 conn(0x7fd6c800b170 legacy=0x7fd6c800d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 -- 172.21.15.170:0/4142696843 >> v1:172.21.15.170:6790/0 conn(0x7fd6c8003540 legacy=0x7fd6c8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 -- 172.21.15.170:0/4142696843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fd6e009be40 con 0x7fd6c80087e0 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e009c0d0 con 0x7fd6c80087e0 2020-01-26T15:37:24.079 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e00653b0 con 0x7fd6c80087e0 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd6d0005d70 con 0x7fd6c80087e0 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d000e0a0 con 0x7fd6c80087e0 2020-01-26T15:37:24.080 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc003360 con 0x7fd6c80087e0 2020-01-26T15:37:24.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fd6d000e290 con 0x7fd6c80087e0 2020-01-26T15:37:24.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.081 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.068+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fd6d004d520 con 0x7fd6c80087e0 2020-01-26T15:37:24.082 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.076+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.082 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.076+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fd6d0033930 con 0x7fd6c80087e0 2020-01-26T15:37:24.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd6bc003790 con 0x7fd6c80087e0 2020-01-26T15:37:24.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e58cc700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:24.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6d6ffd700 1 -- 172.21.15.170:0/4142696843 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fd6d00312e0 con 0x7fd6c80087e0 2020-01-26T15:37:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 >> v1:172.21.15.170:6800/17396 conn(0x7fd6c8048980 legacy=0x7fd6c804ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 msgr2=0x7fd6c800ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 --2- 172.21.15.170:0/4142696843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c80087e0 0x7fd6c800ac20 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fd6d000b800 tx=0x7fd6d0010d60).stop 2020-01-26T15:37:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e7b30700 1 -- 172.21.15.170:0/4142696843 reap_dead start 2020-01-26T15:37:24.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 shutdown_connections 2020-01-26T15:37:24.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 >> 172.21.15.170:0/4142696843 conn(0x7fd6e0098e10 msgr2=0x7fd6e005edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:24.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 shutdown_connections 2020-01-26T15:37:24.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:24.232+0000 7fd6e68ce700 1 -- 172.21.15.170:0/4142696843 wait complete. 2020-01-26T15:37:24.249 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:27.250 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:27.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 Processor -- start 2020-01-26T15:37:27.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 -- start start 2020-01-26T15:37:27.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f77b005e5f0 0x7f77b00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:27.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f77b0149040 0x7f77b014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:27.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00a6dc0 con 0x7f77b005edd0 2020-01-26T15:37:27.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f77b005ea20 con 0x7f77b0149040 2020-01-26T15:37:27.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77af59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f77b0098000 con 0x7f77b005e5f0 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77b4d5f700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f77b0149040 0x7f77b014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77ae59c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f77b005e5f0 0x7f77b00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77aed9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f77b005edd0 0x7f77b007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48890/0 (socket says 172.21.15.170:48890) 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77ae59c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f77b005e5f0 0x7f77b00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77aed9d700 1 -- 172.21.15.170:0/2451981458 learned_addr learned my addr 172.21.15.170:0/2451981458 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.368+0000 7f77b4d5f700 1 --2- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6790/0 conn(0x7f77b0149040 0x7f77b014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678914808 0 0) 0x7f77b00a6dc0 con 0x7f77b005edd0 2020-01-26T15:37:27.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7798003230 con 0x7f77b005edd0 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1481755344 0 0) 0x7f7798003230 con 0x7f77b005edd0 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6791/0 conn(0x7f77b005e5f0 msgr2=0x7f77b00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 --2- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6791/0 conn(0x7f77b005e5f0 0x7f77b00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6790/0 conn(0x7f77b0149040 msgr2=0x7f77b014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 --2- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6790/0 conn(0x7f77b0149040 0x7f77b014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b005e050 con 0x7f77b005edd0 2020-01-26T15:37:27.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f77a0001710 con 0x7f77b005edd0 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f77a0001aa0 con 0x7f77b005edd0 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 -- 172.21.15.170:0/2451981458 >> v1:172.21.15.170:6790/0 conn(0x7f77b005edd0 legacy=0x7f77b007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77add9b700 1 -- 172.21.15.170:0/2451981458 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f77a00045b0 con 0x7f77b005edd0 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 -- 172.21.15.170:0/2451981458 shutdown_connections 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 --2- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6790/0 conn(0x7f77b0149040 0x7f77b014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 --2- 172.21.15.170:0/2451981458 >> v2:172.21.15.170:6791/0 conn(0x7f77b005e5f0 0x7f77b00a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 -- 172.21.15.170:0/2451981458 >> 172.21.15.170:0/2451981458 conn(0x7f77b0098e70 msgr2=0x7f77b00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:27.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 -- 172.21.15.170:0/2451981458 shutdown_connections 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 -- 172.21.15.170:0/2451981458 wait complete. 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 Processor -- start 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.372+0000 7f77af59e700 1 -- start start 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f77b0079200 0x7f77b013bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b0079ff0 con 0x7f77b0079bc0 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b007a2d0 con 0x7f77b0078dd0 2020-01-26T15:37:27.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f77b01201f0 con 0x7f77b0079200 2020-01-26T15:37:27.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77ae59c700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f77b0078dd0 0x7f77b0138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44022/0 (socket says 172.21.15.170:44022) 2020-01-26T15:37:27.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77ae59c700 1 -- 172.21.15.170:0/2216813262 learned_addr learned my addr 172.21.15.170:0/2216813262 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:27.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77b4d5f700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f77b0079200 0x7f77b013bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:27.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77b4d5f700 1 --2- 172.21.15.170:0/2216813262 >> v2:172.21.15.170:6791/0 conn(0x7f77b0079200 0x7f77b013bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:27.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746596054 0 0) 0x7f77a0000f10 con 0x7f77b0079bc0 2020-01-26T15:37:27.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7794003230 con 0x7f77b0079bc0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919946651 0 0) 0x7f77b007a2d0 con 0x7f77b0078dd0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7794004680 con 0x7f77b0078dd0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 747367516 0 0) 0x7f7794003230 con 0x7f77b0079bc0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f77b007a2d0 con 0x7f77b0079bc0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f77a00015d0 con 0x7f77b0079bc0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1580607506 0 0) 0x7f7794004680 con 0x7f77b0078dd0 2020-01-26T15:37:27.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7794003230 con 0x7f77b0078dd0 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f77a4002740 con 0x7f77b0078dd0 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1260450314 0 0) 0x7f77b007a2d0 con 0x7f77b0079bc0 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 >> v2:172.21.15.170:6791/0 conn(0x7f77b0079200 msgr2=0x7f77b013bd60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 --2- 172.21.15.170:0/2216813262 >> v2:172.21.15.170:6791/0 conn(0x7f77b0079200 0x7f77b013bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 >> v1:172.21.15.170:6791/0 conn(0x7f77b0078dd0 legacy=0x7f77b0138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0097bc0 con 0x7f77b0079bc0 2020-01-26T15:37:27.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00a3540 con 0x7f77b0079bc0 2020-01-26T15:37:27.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b0121200 con 0x7f77b0079bc0 2020-01-26T15:37:27.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f77a0001850 con 0x7f77b0079bc0 2020-01-26T15:37:27.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f77a0004ce0 con 0x7f77b0079bc0 2020-01-26T15:37:27.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f77a0004ee0 con 0x7f77b0079bc0 2020-01-26T15:37:27.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f77b0079ff0 con 0x7f77b0079bc0 2020-01-26T15:37:27.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.376+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7788003360 con 0x7f77b0079bc0 2020-01-26T15:37:27.388 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.384+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f77a0030fd0 con 0x7f77b0079bc0 2020-01-26T15:37:27.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.536+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f77880037d0 con 0x7f77b0079bc0 2020-01-26T15:37:27.538 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.536+0000 7f779f7fe700 1 -- 172.21.15.170:0/2216813262 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f77a004a720 con 0x7f77b0079bc0 2020-01-26T15:37:27.538 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:27.539 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 >> v1:172.21.15.170:6800/17396 conn(0x7f779403e730 legacy=0x7f7794040c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:27.539 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 >> v1:172.21.15.170:6790/0 conn(0x7f77b0079bc0 legacy=0x7f77b00a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:27.540 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 shutdown_connections 2020-01-26T15:37:27.540 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 --2- 172.21.15.170:0/2216813262 >> v2:172.21.15.170:6791/0 conn(0x7f77b0079200 0x7f77b013bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:27.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 >> 172.21.15.170:0/2216813262 conn(0x7f77b005c110 msgr2=0x7f77b00a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:27.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 shutdown_connections 2020-01-26T15:37:27.541 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:27.540+0000 7f77af59e700 1 -- 172.21.15.170:0/2216813262 wait complete. 2020-01-26T15:37:27.551 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:30.552 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:30.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f0694c65700 1 Processor -- start 2020-01-26T15:37:30.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f0694c65700 1 -- start start 2020-01-26T15:37:30.674 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f0694c65700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f069005e5f0 0x7f06900a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f0694c65700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900a6dc0 con 0x7f0690149040 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f0694c65700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069005ea20 con 0x7f069005edd0 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f0694c65700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0690098000 con 0x7f069005e5f0 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f068ffff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f069005edd0 0x7f069007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44030/0 (socket says 172.21.15.170:44030) 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f068ffff700 1 -- 172.21.15.170:0/2875062591 learned_addr learned my addr 172.21.15.170:0/2875062591 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.668+0000 7f068f7fe700 -1 --2- 172.21.15.170:0/2875062591 >> v2:172.21.15.170:6790/0 conn(0x7f069005e5f0 0x7f06900a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068f7fe700 1 --2- 172.21.15.170:0/2875062591 >> v2:172.21.15.170:6790/0 conn(0x7f069005e5f0 0x7f06900a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498766722 0 0) 0x7f069005ea20 con 0x7f069005edd0 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0678003230 con 0x7f069005edd0 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 983519029 0 0) 0x7f0678003230 con 0x7f069005edd0 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 >> v2:172.21.15.170:6790/0 conn(0x7f069005e5f0 msgr2=0x7f06900a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 --2- 172.21.15.170:0/2875062591 >> v2:172.21.15.170:6790/0 conn(0x7f069005e5f0 0x7f06900a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 >> v1:172.21.15.170:6790/0 conn(0x7f0690149040 legacy=0x7f069014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069005e050 con 0x7f069005edd0 2020-01-26T15:37:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0688001a90 con 0x7f069005edd0 2020-01-26T15:37:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0688001d60 con 0x7f069005edd0 2020-01-26T15:37:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f068effd700 1 -- 172.21.15.170:0/2875062591 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0688004930 con 0x7f069005edd0 2020-01-26T15:37:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 -- 172.21.15.170:0/2875062591 >> v1:172.21.15.170:6791/0 conn(0x7f069005edd0 legacy=0x7f069007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 -- 172.21.15.170:0/2875062591 shutdown_connections 2020-01-26T15:37:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 --2- 172.21.15.170:0/2875062591 >> v2:172.21.15.170:6790/0 conn(0x7f069005e5f0 0x7f06900a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 -- 172.21.15.170:0/2875062591 >> 172.21.15.170:0/2875062591 conn(0x7f0690098e70 msgr2=0x7f06900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 -- 172.21.15.170:0/2875062591 shutdown_connections 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 -- 172.21.15.170:0/2875062591 wait complete. 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 Processor -- start 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.672+0000 7f0694c65700 1 -- start start 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0694c65700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f06900a3190 0x7f069015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:30.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0694c65700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069009e150 con 0x7f0690079bc0 2020-01-26T15:37:30.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0694c65700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900a2d60 con 0x7f069007a1a0 2020-01-26T15:37:30.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0694c65700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f06900a5640 con 0x7f06900a3190 2020-01-26T15:37:30.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068ffff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0690079bc0 0x7f0690079010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52034/0 (socket says 172.21.15.170:52034) 2020-01-26T15:37:30.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068ffff700 1 -- 172.21.15.170:0/3919087923 learned_addr learned my addr 172.21.15.170:0/3919087923 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:30.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0695ec7700 -1 --2- 172.21.15.170:0/3919087923 >> v2:172.21.15.170:6790/0 conn(0x7f06900a3190 0x7f069015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:30.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0695ec7700 1 --2- 172.21.15.170:0/3919087923 >> v2:172.21.15.170:6790/0 conn(0x7f06900a3190 0x7f069015dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:30.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494345595 0 0) 0x7f06900a2d60 con 0x7f069007a1a0 2020-01-26T15:37:30.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0670003230 con 0x7f069007a1a0 2020-01-26T15:37:30.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612096700 0 0) 0x7f069009e150 con 0x7f0690079bc0 2020-01-26T15:37:30.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06900a2d60 con 0x7f0690079bc0 2020-01-26T15:37:30.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 171104261 0 0) 0x7f0670003230 con 0x7f069007a1a0 2020-01-26T15:37:30.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f069009e150 con 0x7f069007a1a0 2020-01-26T15:37:30.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f06840026f0 con 0x7f069007a1a0 2020-01-26T15:37:30.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3959215051 0 0) 0x7f06900a2d60 con 0x7f0690079bc0 2020-01-26T15:37:30.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0670003230 con 0x7f0690079bc0 2020-01-26T15:37:30.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f06880017a0 con 0x7f0690079bc0 2020-01-26T15:37:30.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 >> v2:172.21.15.170:6790/0 conn(0x7f06900a3190 msgr2=0x7f069015dd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:30.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 --2- 172.21.15.170:0/3919087923 >> v2:172.21.15.170:6790/0 conn(0x7f06900a3190 0x7f069015dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:30.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 >> v1:172.21.15.170:6790/0 conn(0x7f069007a1a0 legacy=0x7f069015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.686 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 >> v1:172.21.15.170:6789/0 conn(0x7f0690079bc0 legacy=0x7f0690079010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f069009e150 con 0x7f067000ad40 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f06900a2d60 con 0x7f0670003ef0 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06900a5640 con 0x7f0670004da0 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435773011 0 0) 0x7f06900a2d60 con 0x7f0670003ef0 2020-01-26T15:37:30.687 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f067000e990 con 0x7f0670003ef0 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932191325 0 0) 0x7f069009e150 con 0x7f067000ad40 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06900a2d60 con 0x7f067000ad40 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2611617702 0 0) 0x7f067000e990 con 0x7f0670003ef0 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f069009e150 con 0x7f0670003ef0 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0688005010 con 0x7f0670003ef0 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 -- 172.21.15.170:0/3919087923 >> v1:172.21.15.170:6791/0 conn(0x7f0670003ef0 legacy=0x7f06700045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.688 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 -- 172.21.15.170:0/3919087923 >> v1:172.21.15.170:6790/0 conn(0x7f067000ad40 legacy=0x7f067000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 -- 172.21.15.170:0/3919087923 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f06901602a0 con 0x7f0670004da0 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069007a1a0 con 0x7f0670004da0 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069015e280 con 0x7f0670004da0 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f068400b400 con 0x7f0670004da0 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.676+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068400b600 con 0x7f0670004da0 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.680+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.680+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0668003360 con 0x7f0670004da0 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.680+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f0684008890 con 0x7f0670004da0 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.680+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.680+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f068404dac0 con 0x7f0670004da0 2020-01-26T15:37:30.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.684+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.684+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f0684033c10 con 0x7f0670004da0 2020-01-26T15:37:30.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0668003790 con 0x7f0670004da0 2020-01-26T15:37:30.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f068f7fe700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:30.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f068cff9700 1 -- 172.21.15.170:0/3919087923 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0684033e70 con 0x7f0670004da0 2020-01-26T15:37:30.840 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:30.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 >> v1:172.21.15.170:6800/17396 conn(0x7f06700485a0 legacy=0x7f067004aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 msgr2=0x7f067000a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0695ec7700 1 -- 172.21.15.170:0/3919087923 reap_dead start 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0684002500 tx=0x7f0684011780).stop 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 shutdown_connections 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 --2- 172.21.15.170:0/3919087923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0670004da0 0x7f067000a7f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 >> 172.21.15.170:0/3919087923 conn(0x7f06900247b0 msgr2=0x7f069007f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:30.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 shutdown_connections 2020-01-26T15:37:30.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:30.840+0000 7f0694c65700 1 -- 172.21.15.170:0/3919087923 wait complete. 2020-01-26T15:37:30.854 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:33.855 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:33.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 Processor -- start 2020-01-26T15:37:33.974 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- start start 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa48c0a6870 0x7fa48c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c05ea20 con 0x7fa48c05edd0 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c098000 con 0x7fa48c05e5f0 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c05e050 con 0x7fa48c0a6870 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48bfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa48c05edd0 0x7fa48c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52050/0 (socket says 172.21.15.170:52050) 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48bfff700 1 -- 172.21.15.170:0/2595246733 learned_addr learned my addr 172.21.15.170:0/2595246733 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:33.975 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48b7fe700 1 --1- 172.21.15.170:0/2595246733 >> v1:172.21.15.170:6790/0 conn(0x7fa48c05e5f0 0x7fa48c149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48928/0 (socket says 172.21.15.170:48928) 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa491b22700 -1 --2- 172.21.15.170:0/2595246733 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0a6870 0x7fa48c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa491b22700 1 --2- 172.21.15.170:0/2595246733 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0a6870 0x7fa48c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603672157 0 0) 0x7fa48c098000 con 0x7fa48c05e5f0 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa46c003230 con 0x7fa48c05e5f0 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76787796 0 0) 0x7fa48c05ea20 con 0x7fa48c05edd0 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa48c098000 con 0x7fa48c05edd0 2020-01-26T15:37:33.976 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3424943509 0 0) 0x7fa46c003230 con 0x7fa48c05e5f0 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0a6870 msgr2=0x7fa48c14c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 --2- 172.21.15.170:0/2595246733 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0a6870 0x7fa48c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 >> v1:172.21.15.170:6789/0 conn(0x7fa48c05edd0 legacy=0x7fa48c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0a6ca0 con 0x7fa48c05e5f0 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa474001710 con 0x7fa48c05e5f0 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa4740019e0 con 0x7fa48c05e5f0 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa48affd700 1 -- 172.21.15.170:0/2595246733 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa4740044f0 con 0x7fa48c05e5f0 2020-01-26T15:37:33.977 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- 172.21.15.170:0/2595246733 >> v1:172.21.15.170:6790/0 conn(0x7fa48c05e5f0 legacy=0x7fa48c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- 172.21.15.170:0/2595246733 shutdown_connections 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 --2- 172.21.15.170:0/2595246733 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0a6870 0x7fa48c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- 172.21.15.170:0/2595246733 >> 172.21.15.170:0/2595246733 conn(0x7fa48c098e70 msgr2=0x7fa48c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- 172.21.15.170:0/2595246733 shutdown_connections 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.972+0000 7fa4908c0700 1 -- 172.21.15.170:0/2595246733 wait complete. 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 Processor -- start 2020-01-26T15:37:33.978 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 -- start start 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa48c061c20 0x7fa48c061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa48c0631a0 0x7fa48c131d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c1322d0 con 0x7fa48c062d70 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c0a3b80 con 0x7fa48c061c20 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa4908c0700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c09e450 con 0x7fa48c0631a0 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48b7fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa48c062d70 0x7fa48c131580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52056/0 (socket says 172.21.15.170:52056) 2020-01-26T15:37:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48b7fe700 1 -- 172.21.15.170:0/2905248442 learned_addr learned my addr 172.21.15.170:0/2905248442 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa491b22700 -1 --2- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0631a0 0x7fa48c131d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa491b22700 1 --2- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0631a0 0x7fa48c131d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48bfff700 -1 --2- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6790/0 conn(0x7fa48c061c20 0x7fa48c061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48bfff700 1 --2- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6790/0 conn(0x7fa48c061c20 0x7fa48c061400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080693925 0 0) 0x7fa48c1322d0 con 0x7fa48c062d70 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa464003230 con 0x7fa48c062d70 2020-01-26T15:37:33.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3393191327 0 0) 0x7fa464003230 con 0x7fa48c062d70 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa48c1322d0 con 0x7fa48c062d70 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa4740015d0 con 0x7fa48c062d70 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0631a0 msgr2=0x7fa48c131d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 --2- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6791/0 conn(0x7fa48c0631a0 0x7fa48c131d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6790/0 conn(0x7fa48c061c20 msgr2=0x7fa48c061400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 --2- 172.21.15.170:0/2905248442 >> v2:172.21.15.170:6790/0 conn(0x7fa48c061c20 0x7fa48c061400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 >> v1:172.21.15.170:6789/0 conn(0x7fa48c062d70 legacy=0x7fa48c131580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fa464003230 con 0x7fa464003a20 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fa46400f280 con 0x7fa46400a530 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0a3b80 con 0x7fa464003eb0 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111097304 0 0) 0x7fa464003230 con 0x7fa464003a20 2020-01-26T15:37:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa46400f4b0 con 0x7fa464003a20 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48b7fe700 1 -- 172.21.15.170:0/2905248442 >> v1:172.21.15.170:6791/0 conn(0x7fa46400a530 legacy=0x7fa46400c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380971932 0 0) 0x7fa46400f280 con 0x7fa46400a530 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48b7fe700 1 -- 172.21.15.170:0/2905248442 >> v1:172.21.15.170:6790/0 conn(0x7fa464003a20 legacy=0x7fa4640077d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa491b22700 1 -- 172.21.15.170:0/2905248442 reap_dead start 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.976+0000 7fa48b7fe700 1 -- 172.21.15.170:0/2905248442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c065e10 con 0x7fa464003eb0 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c061c20 con 0x7fa464003eb0 2020-01-26T15:37:33.987 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c061400 con 0x7fa464003eb0 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fa47400b330 con 0x7fa464003eb0 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47400b530 con 0x7fa464003eb0 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fa4740047c0 con 0x7fa464003eb0 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa468003360 con 0x7fa464003eb0 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fa474004a10 con 0x7fa464003eb0 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.980+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fa47404dea0 con 0x7fa464003eb0 2020-01-26T15:37:33.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.984+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:33.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:33.984+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fa474034050 con 0x7fa464003eb0 2020-01-26T15:37:34.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa468003790 con 0x7fa464003eb0 2020-01-26T15:37:34.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa48b7fe700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:34.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa488ff9700 1 -- 172.21.15.170:0/2905248442 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa4740342b0 con 0x7fa464003eb0 2020-01-26T15:37:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:34.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 >> v1:172.21.15.170:6800/17396 conn(0x7fa464040980 legacy=0x7fa464042e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:34.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 msgr2=0x7fa464009fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:34.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fa4740017d0 tx=0x7fa47400ca90).stop 2020-01-26T15:37:34.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 shutdown_connections 2020-01-26T15:37:34.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 --2- 172.21.15.170:0/2905248442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa464003eb0 0x7fa464009fe0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:34.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 >> 172.21.15.170:0/2905248442 conn(0x7fa48c0a67d0 msgr2=0x7fa48c0a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:34.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 shutdown_connections 2020-01-26T15:37:34.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:34.144+0000 7fa4908c0700 1 -- 172.21.15.170:0/2905248442 wait complete. 2020-01-26T15:37:34.155 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:37.156 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c1262700 1 Processor -- start 2020-01-26T15:37:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c1262700 1 -- start start 2020-01-26T15:37:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c1262700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe5bc05e5f0 0x7fe5bc0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c1262700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0a6dc0 con 0x7fe5bc149040 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c1262700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc05ea20 con 0x7fe5bc05edd0 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c1262700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc098000 con 0x7fe5bc05e5f0 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c0a61700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe5bc05edd0 0x7fe5bc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48944/0 (socket says 172.21.15.170:48944) 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c0a61700 1 -- 172.21.15.170:0/2679871616 learned_addr learned my addr 172.21.15.170:0/2679871616 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5c24c4700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe5bc149040 0x7fe5bc14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52070/0 (socket says 172.21.15.170:52070) 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5b3fff700 -1 --2- 172.21.15.170:0/2679871616 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc05e5f0 0x7fe5bc0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/2679871616 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc05e5f0 0x7fe5bc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641115289 0 0) 0x7fe5bc05ea20 con 0x7fe5bc05edd0 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a4003230 con 0x7fe5bc05edd0 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442481323 0 0) 0x7fe5bc0a6dc0 con 0x7fe5bc149040 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.272+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5bc05ea20 con 0x7fe5bc149040 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2949297888 0 0) 0x7fe5a4003230 con 0x7fe5bc05edd0 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc05e5f0 msgr2=0x7fe5bc0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 --2- 172.21.15.170:0/2679871616 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc05e5f0 0x7fe5bc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 >> v1:172.21.15.170:6789/0 conn(0x7fe5bc149040 legacy=0x7fe5bc14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc05e050 con 0x7fe5bc05edd0 2020-01-26T15:37:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe5b8001710 con 0x7fe5bc05edd0 2020-01-26T15:37:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe5b80019e0 con 0x7fe5bc05edd0 2020-01-26T15:37:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5b37fe700 1 -- 172.21.15.170:0/2679871616 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe5b80045b0 con 0x7fe5bc05edd0 2020-01-26T15:37:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- 172.21.15.170:0/2679871616 >> v1:172.21.15.170:6790/0 conn(0x7fe5bc05edd0 legacy=0x7fe5bc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.281 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- 172.21.15.170:0/2679871616 shutdown_connections 2020-01-26T15:37:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 --2- 172.21.15.170:0/2679871616 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc05e5f0 0x7fe5bc0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- 172.21.15.170:0/2679871616 >> 172.21.15.170:0/2679871616 conn(0x7fe5bc098e70 msgr2=0x7fe5bc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- 172.21.15.170:0/2679871616 shutdown_connections 2020-01-26T15:37:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- 172.21.15.170:0/2679871616 wait complete. 2020-01-26T15:37:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 Processor -- start 2020-01-26T15:37:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- start start 2020-01-26T15:37:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe5bc09fa00 0x7fe5bc09fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc09e150 con 0x7fe5bc133d80 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc13cd60 con 0x7fe5bc11f170 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.276+0000 7fe5c1262700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc09e6b0 con 0x7fe5bc09fa00 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5c0a61700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe5bc09fa00 0x7fe5bc09fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe5bc133d80 0x7fe5bc1341b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52074/0 (socket says 172.21.15.170:52074) 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 -- 172.21.15.170:0/3253275664 learned_addr learned my addr 172.21.15.170:0/3253275664 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5c0a61700 1 --2- 172.21.15.170:0/3253275664 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc09fa00 0x7fe5bc09fe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783131296 0 0) 0x7fe5bc09e150 con 0x7fe5bc133d80 2020-01-26T15:37:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c003230 con 0x7fe5bc133d80 2020-01-26T15:37:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107382201 0 0) 0x7fe5bc13cd60 con 0x7fe5bc11f170 2020-01-26T15:37:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5bc09e150 con 0x7fe5bc11f170 2020-01-26T15:37:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3811433084 0 0) 0x7fe5bc09e150 con 0x7fe5bc11f170 2020-01-26T15:37:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5bc13cd60 con 0x7fe5bc11f170 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe5b4001be0 con 0x7fe5bc11f170 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3836120157 0 0) 0x7fe59c003230 con 0x7fe5bc133d80 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5bc09e150 con 0x7fe5bc133d80 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe5ac002700 con 0x7fe5bc133d80 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc09fa00 msgr2=0x7fe5bc09fe30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 --2- 172.21.15.170:0/3253275664 >> v2:172.21.15.170:6790/0 conn(0x7fe5bc09fa00 0x7fe5bc09fe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 >> v1:172.21.15.170:6791/0 conn(0x7fe5bc11f170 legacy=0x7fe5bc11f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 >> v1:172.21.15.170:6789/0 conn(0x7fe5bc133d80 legacy=0x7fe5bc1341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe59c003230 con 0x7fe59c004f20 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe59c004260 con 0x7fe59c00ad40 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc09e6b0 con 0x7fe59c003d40 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 -- 172.21.15.170:0/3253275664 >> v1:172.21.15.170:6791/0 conn(0x7fe59c00ad40 legacy=0x7fe59c00d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626914790 0 0) 0x7fe59c003230 con 0x7fe59c004f20 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 -- 172.21.15.170:0/3253275664 >> v1:172.21.15.170:6790/0 conn(0x7fe59c004f20 legacy=0x7fe59c003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 -- 172.21.15.170:0/3253275664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fe5bc13dfa0 con 0x7fe59c003d40 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc11f170 con 0x7fe59c003d40 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc11f6a0 con 0x7fe59c003d40 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe5ac00eaa0 con 0x7fe59c003d40 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.280+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00eca0 con 0x7fe59c003d40 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.284+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.284+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.284+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe5ac005780 con 0x7fe59c003d40 2020-01-26T15:37:37.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.284+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe594003360 con 0x7fe59c003d40 2020-01-26T15:37:37.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.284+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fe5ac04d3b0 con 0x7fe59c003d40 2020-01-26T15:37:37.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.288+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.294 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.288+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe5ac033500 con 0x7fe59c003d40 2020-01-26T15:37:37.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.440+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe594003790 con 0x7fe59c003d40 2020-01-26T15:37:37.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5b3fff700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:37.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5b17fa700 1 -- 172.21.15.170:0/3253275664 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe5ac033760 con 0x7fe59c003d40 2020-01-26T15:37:37.443 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:37.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 >> v1:172.21.15.170:6800/17396 conn(0x7fe59c0483e0 legacy=0x7fe59c04a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 msgr2=0x7fe59c00a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:37.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c24c4700 1 -- 172.21.15.170:0/3253275664 reap_dead start 2020-01-26T15:37:37.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fe5b4001e40 tx=0x7fe5ac0113c0).stop 2020-01-26T15:37:37.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 shutdown_connections 2020-01-26T15:37:37.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 --2- 172.21.15.170:0/3253275664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe59c003d40 0x7fe59c00a7f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:37.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 >> 172.21.15.170:0/3253275664 conn(0x7fe5bc05c000 msgr2=0x7fe5bc122460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:37.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 shutdown_connections 2020-01-26T15:37:37.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:37.444+0000 7fe5c1262700 1 -- 172.21.15.170:0/3253275664 wait complete. 2020-01-26T15:37:37.459 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:40.460 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8d94f7700 1 Processor -- start 2020-01-26T15:37:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8d94f7700 1 -- start start 2020-01-26T15:37:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8d94f7700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe8d405e5f0 0x7fe8d40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8d94f7700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40a6dc0 con 0x7fe8d405edd0 2020-01-26T15:37:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8d94f7700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d405ea20 con 0x7fe8d4149040 2020-01-26T15:37:40.586 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8d94f7700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d4098000 con 0x7fe8d405e5f0 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8cbfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe8d405e5f0 0x7fe8d40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8da759700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe8d4149040 0x7fe8d414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48968/0 (socket says 172.21.15.170:48968) 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8da759700 1 -- 172.21.15.170:0/2853622958 learned_addr learned my addr 172.21.15.170:0/2853622958 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.576+0000 7fe8cbfff700 1 --2- 172.21.15.170:0/2853622958 >> v2:172.21.15.170:6790/0 conn(0x7fe8d405e5f0 0x7fe8d40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705547652 0 0) 0x7fe8d405ea20 con 0x7fe8d4149040 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8bc003230 con 0x7fe8d4149040 2020-01-26T15:37:40.587 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365556357 0 0) 0x7fe8d40a6dc0 con 0x7fe8d405edd0 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d405ea20 con 0x7fe8d405edd0 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1826764762 0 0) 0x7fe8d405ea20 con 0x7fe8d405edd0 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 >> v2:172.21.15.170:6790/0 conn(0x7fe8d405e5f0 msgr2=0x7fe8d40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 --2- 172.21.15.170:0/2853622958 >> v2:172.21.15.170:6790/0 conn(0x7fe8d405e5f0 0x7fe8d40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 >> v1:172.21.15.170:6790/0 conn(0x7fe8d4149040 legacy=0x7fe8d414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d405e050 con 0x7fe8d405edd0 2020-01-26T15:37:40.588 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe8d00016f0 con 0x7fe8d405edd0 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 >> v1:172.21.15.170:6789/0 conn(0x7fe8d405edd0 legacy=0x7fe8d407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 --2- 172.21.15.170:0/2853622958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8bc00b800 0x7fe8bc00dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe8d405ea20 con 0x7fe8bc004b20 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe8d40a6dc0 con 0x7fe8bc004f70 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4098000 con 0x7fe8bc00b800 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8da759700 1 --2- 172.21.15.170:0/2853622958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8bc00b800 0x7fe8bc00dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:40.589 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403511196 0 0) 0x7fe8d40a6dc0 con 0x7fe8bc004f70 2020-01-26T15:37:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8bc00f660 con 0x7fe8bc004f70 2020-01-26T15:37:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424949251 0 0) 0x7fe8d405ea20 con 0x7fe8bc004b20 2020-01-26T15:37:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d40a6dc0 con 0x7fe8bc004b20 2020-01-26T15:37:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3076279496 0 0) 0x7fe8bc00f660 con 0x7fe8bc004f70 2020-01-26T15:37:40.590 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8bc00b800 msgr2=0x7fe8bc00dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 --2- 172.21.15.170:0/2853622958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8bc00b800 0x7fe8bc00dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 >> v1:172.21.15.170:6790/0 conn(0x7fe8bc004b20 legacy=0x7fe8bc003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc00f390 con 0x7fe8bc004f70 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe8c4001440 con 0x7fe8bc004f70 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe8c4001710 con 0x7fe8bc004f70 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8cb7fe700 1 -- 172.21.15.170:0/2853622958 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe8c4001b70 con 0x7fe8bc004f70 2020-01-26T15:37:40.591 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2853622958 >> v1:172.21.15.170:6791/0 conn(0x7fe8bc004f70 legacy=0x7fe8bc003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8da759700 1 -- 172.21.15.170:0/2853622958 reap_dead start 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2853622958 shutdown_connections 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2853622958 >> 172.21.15.170:0/2853622958 conn(0x7fe8d4098e70 msgr2=0x7fe8d40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2853622958 shutdown_connections 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.580+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2853622958 wait complete. 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 Processor -- start 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 -- start start 2020-01-26T15:37:40.592 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe8d41340c0 0x7fe8d413bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:40.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40a3ef0 con 0x7fe8d40a3820 2020-01-26T15:37:40.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40a21c0 con 0x7fe8d4072b50 2020-01-26T15:37:40.593 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d41207b0 con 0x7fe8d41340c0 2020-01-26T15:37:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d8cf6700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fe8d4072b50 0x7fe8d40a3020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44102/0 (socket says 172.21.15.170:44102) 2020-01-26T15:37:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d8cf6700 1 -- 172.21.15.170:0/2295878716 learned_addr learned my addr 172.21.15.170:0/2295878716 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8da759700 -1 --2- 172.21.15.170:0/2295878716 >> v2:172.21.15.170:6791/0 conn(0x7fe8d41340c0 0x7fe8d413bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8da759700 1 --2- 172.21.15.170:0/2295878716 >> v2:172.21.15.170:6791/0 conn(0x7fe8d41340c0 0x7fe8d413bdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012486231 0 0) 0x7fe8d40a21c0 con 0x7fe8d4072b50 2020-01-26T15:37:40.597 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b4003230 con 0x7fe8d4072b50 2020-01-26T15:37:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953057038 0 0) 0x7fe8d40a3ef0 con 0x7fe8d40a3820 2020-01-26T15:37:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d40a21c0 con 0x7fe8d40a3820 2020-01-26T15:37:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3515570486 0 0) 0x7fe8b4003230 con 0x7fe8d4072b50 2020-01-26T15:37:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8d40a3ef0 con 0x7fe8d4072b50 2020-01-26T15:37:40.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe8d0001d90 con 0x7fe8d4072b50 2020-01-26T15:37:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2308105548 0 0) 0x7fe8d40a3ef0 con 0x7fe8d4072b50 2020-01-26T15:37:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 >> v2:172.21.15.170:6791/0 conn(0x7fe8d41340c0 msgr2=0x7fe8d413bdc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:40.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 --2- 172.21.15.170:0/2295878716 >> v2:172.21.15.170:6791/0 conn(0x7fe8d41340c0 0x7fe8d413bdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:40.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 >> v1:172.21.15.170:6789/0 conn(0x7fe8d40a3820 legacy=0x7fe8d41338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4073130 con 0x7fe8d4072b50 2020-01-26T15:37:40.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d409e230 con 0x7fe8d4072b50 2020-01-26T15:37:40.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d413c310 con 0x7fe8d4072b50 2020-01-26T15:37:40.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe8d0002360 con 0x7fe8d4072b50 2020-01-26T15:37:40.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.584+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe8d0002780 con 0x7fe8d4072b50 2020-01-26T15:37:40.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.588+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac003360 con 0x7fe8d4072b50 2020-01-26T15:37:40.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.588+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fe8d00107b0 con 0x7fe8d4072b50 2020-01-26T15:37:40.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.588+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7fe8d004ba90 con 0x7fe8d4072b50 2020-01-26T15:37:40.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.592+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fe8d0010de0 con 0x7fe8d4072b50 2020-01-26T15:37:40.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.744+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe8ac0037d0 con 0x7fe8d4072b50 2020-01-26T15:37:40.743 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.744+0000 7fe8c97fa700 1 -- 172.21.15.170:0/2295878716 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fe8d0031010 con 0x7fe8d4072b50 2020-01-26T15:37:40.744 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:40.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 >> v1:172.21.15.170:6800/17396 conn(0x7fe8b403e0d0 legacy=0x7fe8b40405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 >> v1:172.21.15.170:6791/0 conn(0x7fe8d4072b50 legacy=0x7fe8d40a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:40.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 shutdown_connections 2020-01-26T15:37:40.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 --2- 172.21.15.170:0/2295878716 >> v2:172.21.15.170:6791/0 conn(0x7fe8d41340c0 0x7fe8d413bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:40.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 >> 172.21.15.170:0/2295878716 conn(0x7fe8d405edd0 msgr2=0x7fe8d407fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:40.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 shutdown_connections 2020-01-26T15:37:40.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:40.748+0000 7fe8d94f7700 1 -- 172.21.15.170:0/2295878716 wait complete. 2020-01-26T15:37:40.763 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:43.764 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:43.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 Processor -- start 2020-01-26T15:37:43.885 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- start start 2020-01-26T15:37:43.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f899805e5f0 0x7f89980a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:43.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89980a6dc0 con 0x7f899805edd0 2020-01-26T15:37:43.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899805ea20 con 0x7f8998149040 2020-01-26T15:37:43.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8998098000 con 0x7f899805e5f0 2020-01-26T15:37:43.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899e930700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f899805edd0 0x7f899807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52108/0 (socket says 172.21.15.170:52108) 2020-01-26T15:37:43.886 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899e930700 1 -- 172.21.15.170:0/3989982221 learned_addr learned my addr 172.21.15.170:0/3989982221 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899e12f700 -1 --2- 172.21.15.170:0/3989982221 >> v2:172.21.15.170:6790/0 conn(0x7f899805e5f0 0x7f89980a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899e12f700 1 --2- 172.21.15.170:0/3989982221 >> v2:172.21.15.170:6790/0 conn(0x7f899805e5f0 0x7f89980a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253077798 0 0) 0x7f899805ea20 con 0x7f8998149040 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8984003230 con 0x7f8998149040 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037868507 0 0) 0x7f89980a6dc0 con 0x7f899805edd0 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f899805ea20 con 0x7f899805edd0 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 928705106 0 0) 0x7f8984003230 con 0x7f8998149040 2020-01-26T15:37:43.887 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 >> v2:172.21.15.170:6790/0 conn(0x7f899805e5f0 msgr2=0x7f89980a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 --2- 172.21.15.170:0/3989982221 >> v2:172.21.15.170:6790/0 conn(0x7f899805e5f0 0x7f89980a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 >> v1:172.21.15.170:6789/0 conn(0x7f899805edd0 legacy=0x7f899807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899805e050 con 0x7f8998149040 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8990001710 con 0x7f8998149040 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8990001910 con 0x7f8998149040 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899d92e700 1 -- 172.21.15.170:0/3989982221 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8990001ec0 con 0x7f8998149040 2020-01-26T15:37:43.888 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- 172.21.15.170:0/3989982221 >> v1:172.21.15.170:6791/0 conn(0x7f8998149040 legacy=0x7f899814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:43.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- 172.21.15.170:0/3989982221 shutdown_connections 2020-01-26T15:37:43.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 --2- 172.21.15.170:0/3989982221 >> v2:172.21.15.170:6790/0 conn(0x7f899805e5f0 0x7f89980a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:43.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- 172.21.15.170:0/3989982221 >> 172.21.15.170:0/3989982221 conn(0x7f8998098e70 msgr2=0x7f89980a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:43.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- 172.21.15.170:0/3989982221 shutdown_connections 2020-01-26T15:37:43.889 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.884+0000 7f899f131700 1 -- 172.21.15.170:0/3989982221 wait complete. 2020-01-26T15:37:43.892 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 Processor -- start 2020-01-26T15:37:43.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 -- start start 2020-01-26T15:37:43.893 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f899809f110 0x7f899807d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8998098ef0 con 0x7f899807d590 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899809e4f0 con 0x7f8998138750 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f899809f540 con 0x7f899809f110 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899e930700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f899809f110 0x7f899807d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899e12f700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f899807d590 0x7f899809ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:48992/0 (socket says 172.21.15.170:48992) 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899e930700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f899809f110 0x7f899807d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:43.894 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899e12f700 1 -- 172.21.15.170:0/1205756489 learned_addr learned my addr 172.21.15.170:0/1205756489 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708991785 0 0) 0x7f899809e4f0 con 0x7f8998138750 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8980003230 con 0x7f8998138750 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567114423 0 0) 0x7f8998098ef0 con 0x7f899807d590 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f899809e4f0 con 0x7f899807d590 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 114940588 0 0) 0x7f8980003230 con 0x7f8998138750 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8998098ef0 con 0x7f8998138750 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8990001a20 con 0x7f8998138750 2020-01-26T15:37:43.895 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3520555196 0 0) 0x7f899809e4f0 con 0x7f899807d590 2020-01-26T15:37:43.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8980003230 con 0x7f899807d590 2020-01-26T15:37:43.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8988002740 con 0x7f899807d590 2020-01-26T15:37:43.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1795978171 0 0) 0x7f8998098ef0 con 0x7f8998138750 2020-01-26T15:37:43.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 >> v2:172.21.15.170:6790/0 conn(0x7f899809f110 msgr2=0x7f899807d040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:43.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 --2- 172.21.15.170:0/1205756489 >> v2:172.21.15.170:6790/0 conn(0x7f899809f110 0x7f899807d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:43.896 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 >> v1:172.21.15.170:6790/0 conn(0x7f899807d590 legacy=0x7f899809ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998122fa0 con 0x7f8998138750 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899809dff0 con 0x7f8998138750 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f89980a0700 con 0x7f8998138750 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8990001230 con 0x7f8998138750 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.888+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8990002370 con 0x7f8998138750 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.892+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8974003360 con 0x7f8998138750 2020-01-26T15:37:43.897 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.892+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f8990002570 con 0x7f8998138750 2020-01-26T15:37:43.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.892+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f8990049360 con 0x7f8998138750 2020-01-26T15:37:43.898 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:43.896+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f899002e940 con 0x7f8998138750 2020-01-26T15:37:44.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f89740037d0 con 0x7f8998138750 2020-01-26T15:37:44.051 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f898f7fe700 1 -- 172.21.15.170:0/1205756489 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f899002f4f0 con 0x7f8998138750 2020-01-26T15:37:44.051 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:44.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 >> v1:172.21.15.170:6800/17396 conn(0x7f898003e470 legacy=0x7f8980040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:44.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 >> v1:172.21.15.170:6791/0 conn(0x7f8998138750 legacy=0x7f899813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:44.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 shutdown_connections 2020-01-26T15:37:44.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 --2- 172.21.15.170:0/1205756489 >> v2:172.21.15.170:6790/0 conn(0x7f899809f110 0x7f899807d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:44.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 >> 172.21.15.170:0/1205756489 conn(0x7f8998097990 msgr2=0x7f899807f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:44.053 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 shutdown_connections 2020-01-26T15:37:44.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:44.052+0000 7f899f131700 1 -- 172.21.15.170:0/1205756489 wait complete. 2020-01-26T15:37:44.064 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:47.066 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:47.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.180+0000 7f8e0d7e6700 1 Processor -- start 2020-01-26T15:37:47.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.180+0000 7f8e0d7e6700 1 -- start start 2020-01-26T15:37:47.187 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8e0805edd0 0x7f8e0805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8e080a6870 0x7f8e0807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e08098000 con 0x7f8e080804d0 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0805e050 con 0x7f8e0805edd0 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080a6ca0 con 0x7f8e080a6870 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0ea48700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f8e080804d0 0x7f8e080247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49002/0 (socket says 172.21.15.170:49002) 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0ea48700 1 -- 172.21.15.170:0/852557813 learned_addr learned my addr 172.21.15.170:0/852557813 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:47.188 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e07fff700 -1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6791/0 conn(0x7f8e080a6870 0x7f8e0807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0cfe5700 -1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6790/0 conn(0x7f8e0805edd0 0x7f8e0805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0cfe5700 1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6790/0 conn(0x7f8e0805edd0 0x7f8e0805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e07fff700 1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6791/0 conn(0x7f8e080a6870 0x7f8e0807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045212010 0 0) 0x7f8e08098000 con 0x7f8e080804d0 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df8003230 con 0x7f8e080804d0 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3769351790 0 0) 0x7f8df8003230 con 0x7f8e080804d0 2020-01-26T15:37:47.189 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6791/0 conn(0x7f8e080a6870 msgr2=0x7f8e0807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6791/0 conn(0x7f8e080a6870 0x7f8e0807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6790/0 conn(0x7f8e0805edd0 msgr2=0x7f8e0805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6790/0 conn(0x7f8e0805edd0 0x7f8e0805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08024fb0 con 0x7f8e080804d0 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8e00001a90 con 0x7f8e080804d0 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8e00001c90 con 0x7f8e080804d0 2020-01-26T15:37:47.190 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e077fe700 1 -- 172.21.15.170:0/852557813 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8e00004930 con 0x7f8e080804d0 2020-01-26T15:37:47.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/852557813 >> v1:172.21.15.170:6790/0 conn(0x7f8e080804d0 legacy=0x7f8e080247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:47.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/852557813 shutdown_connections 2020-01-26T15:37:47.191 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6790/0 conn(0x7f8e0805edd0 0x7f8e0805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:47.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 --2- 172.21.15.170:0/852557813 >> v2:172.21.15.170:6791/0 conn(0x7f8e080a6870 0x7f8e0807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:47.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/852557813 >> 172.21.15.170:0/852557813 conn(0x7f8e08098e70 msgr2=0x7f8e080a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:47.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/852557813 shutdown_connections 2020-01-26T15:37:47.192 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.184+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/852557813 wait complete. 2020-01-26T15:37:47.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.188+0000 7f8e0d7e6700 1 Processor -- start 2020-01-26T15:37:47.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.188+0000 7f8e0d7e6700 1 -- start start 2020-01-26T15:37:47.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8e0809a9f0 0x7f8e08122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:47.195 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0809c150 con 0x7f8e0809bd20 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080a01d0 con 0x7f8e0809b8f0 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0809f6f0 con 0x7f8e0809a9f0 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0cfe5700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8e0809a9f0 0x7f8e08122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0cfe5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8e0809a9f0 0x7f8e08122e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0ea48700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f8e0809bd20 0x7f8e080a49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49008/0 (socket says 172.21.15.170:49008) 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0ea48700 1 -- 172.21.15.170:0/4033024876 learned_addr learned my addr 172.21.15.170:0/4033024876 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:47.196 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427976454 0 0) 0x7f8e0809c150 con 0x7f8e0809bd20 2020-01-26T15:37:47.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de8003230 con 0x7f8e0809bd20 2020-01-26T15:37:47.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931730643 0 0) 0x7f8e080a01d0 con 0x7f8e0809b8f0 2020-01-26T15:37:47.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0809c150 con 0x7f8e0809b8f0 2020-01-26T15:37:47.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3335569282 0 0) 0x7f8de8003230 con 0x7f8e0809bd20 2020-01-26T15:37:47.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8e080a01d0 con 0x7f8e0809bd20 2020-01-26T15:37:47.197 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8e00001bb0 con 0x7f8e0809bd20 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 58246769 0 0) 0x7f8e0809c150 con 0x7f8e0809b8f0 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8de8003230 con 0x7f8e0809b8f0 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8df4001650 con 0x7f8e0809b8f0 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2497164790 0 0) 0x7f8e080a01d0 con 0x7f8e0809bd20 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 >> v2:172.21.15.170:6791/0 conn(0x7f8e0809a9f0 msgr2=0x7f8e08122e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 --2- 172.21.15.170:0/4033024876 >> v2:172.21.15.170:6791/0 conn(0x7f8e0809a9f0 0x7f8e08122e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 >> v1:172.21.15.170:6791/0 conn(0x7f8e0809b8f0 legacy=0x7f8e080a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0809c4c0 con 0x7f8e0809bd20 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e081395e0 con 0x7f8e0809bd20 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e08139990 con 0x7f8e0809bd20 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8e00001570 con 0x7f8e0809bd20 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8e00004db0 con 0x7f8e0809bd20 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f8e00010870 con 0x7f8e0809bd20 2020-01-26T15:37:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.192+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de0003360 con 0x7f8e0809bd20 2020-01-26T15:37:47.200 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.196+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f8e0004be00 con 0x7f8e0809bd20 2020-01-26T15:37:47.200 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.200+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f8e0809c4c0 con 0x7f8e0809bd20 2020-01-26T15:37:47.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8de00037d0 con 0x7f8e0809bd20 2020-01-26T15:37:47.351 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e057fa700 1 -- 172.21.15.170:0/4033024876 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f8e00031440 con 0x7f8e0809bd20 2020-01-26T15:37:47.352 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:47.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 >> v1:172.21.15.170:6800/17396 conn(0x7f8de803e470 legacy=0x7f8de8040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:47.353 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 >> v1:172.21.15.170:6790/0 conn(0x7f8e0809bd20 legacy=0x7f8e080a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:47.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 shutdown_connections 2020-01-26T15:37:47.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 --2- 172.21.15.170:0/4033024876 >> v2:172.21.15.170:6791/0 conn(0x7f8e0809a9f0 0x7f8e08122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:47.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 >> 172.21.15.170:0/4033024876 conn(0x7f8e080a5520 msgr2=0x7f8e08097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:47.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 shutdown_connections 2020-01-26T15:37:47.354 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:47.352+0000 7f8e0d7e6700 1 -- 172.21.15.170:0/4033024876 wait complete. 2020-01-26T15:37:47.371 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:50.371 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:50.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 Processor -- start 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- start start 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fcbbc146c30 0x7fcbbc149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fcbbc1495c0 0x7fcbbc14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc0a5b80 con 0x7fcbbc0a5750 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc0a43f0 con 0x7fcbbc146c30 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc0a5210 con 0x7fcbbc1495c0 2020-01-26T15:37:50.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbbad9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fcbbc0a5750 0x7fcbbc0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44138/0 (socket says 172.21.15.170:44138) 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbbad9d700 1 -- 172.21.15.170:0/95671791 learned_addr learned my addr 172.21.15.170:0/95671791 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbbb59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fcbbc1495c0 0x7fcbbc14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbbb59e700 1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc1495c0 0x7fcbbc14ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbba59c700 -1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6790/0 conn(0x7fcbbc146c30 0x7fcbbc149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbba59c700 1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6790/0 conn(0x7fcbbc146c30 0x7fcbbc149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563764743 0 0) 0x7fcbbc0a5b80 con 0x7fcbbc0a5750 2020-01-26T15:37:50.493 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba8003230 con 0x7fcbbc0a5750 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2285713012 0 0) 0x7fcba8003230 con 0x7fcbbc0a5750 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc1495c0 msgr2=0x7fcbbc14ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc1495c0 0x7fcbbc14ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6790/0 conn(0x7fcbbc146c30 msgr2=0x7fcbbc149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6790/0 conn(0x7fcbbc146c30 0x7fcbbc149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc080440 con 0x7fcbbc0a5750 2020-01-26T15:37:50.494 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcbb4001a90 con 0x7fcbbc0a5750 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcbb4001e20 con 0x7fcbbc0a5750 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbb9d9b700 1 -- 172.21.15.170:0/95671791 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcbb4004930 con 0x7fcbbc0a5750 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- 172.21.15.170:0/95671791 >> v1:172.21.15.170:6791/0 conn(0x7fcbbc0a5750 legacy=0x7fcbbc0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- 172.21.15.170:0/95671791 shutdown_connections 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc1495c0 0x7fcbbc14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 --2- 172.21.15.170:0/95671791 >> v2:172.21.15.170:6790/0 conn(0x7fcbbc146c30 0x7fcbbc149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- 172.21.15.170:0/95671791 >> 172.21.15.170:0/95671791 conn(0x7fcbbc05e050 msgr2=0x7fcbbc098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:50.495 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- 172.21.15.170:0/95671791 shutdown_connections 2020-01-26T15:37:50.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.488+0000 7fcbc097a700 1 -- 172.21.15.170:0/95671791 wait complete. 2020-01-26T15:37:50.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbc097a700 1 Processor -- start 2020-01-26T15:37:50.496 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbc097a700 1 -- start start 2020-01-26T15:37:50.499 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbc097a700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fcbbc12b3a0 0x7fcbbc12b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:50.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbc097a700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc121020 con 0x7fcbbc12bd20 2020-01-26T15:37:50.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbc097a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc12c150 con 0x7fcbbc0923c0 2020-01-26T15:37:50.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbc097a700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc0a2a70 con 0x7fcbbc12b3a0 2020-01-26T15:37:50.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbbad9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fcbbc0923c0 0x7fcbbc0905b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44144/0 (socket says 172.21.15.170:44144) 2020-01-26T15:37:50.500 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbbb59e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fcbbc12bd20 0x7fcbbc13edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49020/0 (socket says 172.21.15.170:49020) 2020-01-26T15:37:50.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbbad9d700 1 -- 172.21.15.170:0/3571443515 learned_addr learned my addr 172.21.15.170:0/3571443515 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:50.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbba59c700 -1 --2- 172.21.15.170:0/3571443515 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc12b3a0 0x7fcbbc12b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:50.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbba59c700 1 --2- 172.21.15.170:0/3571443515 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc12b3a0 0x7fcbbc12b7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:50.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539373180 0 0) 0x7fcbbc121020 con 0x7fcbbc12bd20 2020-01-26T15:37:50.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba0003230 con 0x7fcbbc12bd20 2020-01-26T15:37:50.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342606034 0 0) 0x7fcbbc12c150 con 0x7fcbbc0923c0 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbbc121020 con 0x7fcbbc0923c0 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.492+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3487891636 0 0) 0x7fcba0003230 con 0x7fcbbc12bd20 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcbbc12c150 con 0x7fcbbc12bd20 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcbac002620 con 0x7fcbbc12bd20 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2802472138 0 0) 0x7fcbbc121020 con 0x7fcbbc0923c0 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcba0003230 con 0x7fcbbc0923c0 2020-01-26T15:37:50.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcbb40017a0 con 0x7fcbbc0923c0 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1780218288 0 0) 0x7fcbbc12c150 con 0x7fcbbc12bd20 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc12b3a0 msgr2=0x7fcbbc12b7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 --2- 172.21.15.170:0/3571443515 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc12b3a0 0x7fcbbc12b7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 >> v1:172.21.15.170:6791/0 conn(0x7fcbbc0923c0 legacy=0x7fcbbc0905b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc121620 con 0x7fcbbc12bd20 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc121a20 con 0x7fcbbc12bd20 2020-01-26T15:37:50.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc0952d0 con 0x7fcbbc12bd20 2020-01-26T15:37:50.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcbac000e90 con 0x7fcbbc12bd20 2020-01-26T15:37:50.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcbac0012f0 con 0x7fcbbc12bd20 2020-01-26T15:37:50.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc056600 con 0x7fcbbc12bd20 2020-01-26T15:37:50.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fcbac001570 con 0x7fcbbc12bd20 2020-01-26T15:37:50.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.496+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7fcbac04b9c0 con 0x7fcbbc12bd20 2020-01-26T15:37:50.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.504+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fcbac030e80 con 0x7fcbbc12bd20 2020-01-26T15:37:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.656+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcbbc05cc60 con 0x7fcbbc12bd20 2020-01-26T15:37:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.656+0000 7fcbb37fe700 1 -- 172.21.15.170:0/3571443515 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fcbac04a630 con 0x7fcbbc12bd20 2020-01-26T15:37:50.658 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:50.659 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 >> v1:172.21.15.170:6800/17396 conn(0x7fcba003e490 legacy=0x7fcba00409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:50.659 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 >> v1:172.21.15.170:6790/0 conn(0x7fcbbc12bd20 legacy=0x7fcbbc13edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:50.659 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 shutdown_connections 2020-01-26T15:37:50.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 --2- 172.21.15.170:0/3571443515 >> v2:172.21.15.170:6791/0 conn(0x7fcbbc12b3a0 0x7fcbbc12b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:50.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 >> 172.21.15.170:0/3571443515 conn(0x7fcbbc0a6f90 msgr2=0x7fcbbc05ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:50.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 shutdown_connections 2020-01-26T15:37:50.660 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:50.660+0000 7fcbc097a700 1 -- 172.21.15.170:0/3571443515 wait complete. 2020-01-26T15:37:50.670 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:53.671 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:53.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beed47700 1 Processor -- start 2020-01-26T15:37:53.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beed47700 1 -- start start 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beed47700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6be805edd0 0x7f6be805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beed47700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be8098000 con 0x7f6be8149040 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beed47700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be805e050 con 0x7f6be80a6870 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beed47700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80a6ca0 con 0x7f6be805edd0 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bee546700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6be805edd0 0x7f6be805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bee546700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6be805edd0 0x7f6be805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:53.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beffa9700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f6be8149040 0x7f6be814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52152/0 (socket says 172.21.15.170:52152) 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6beffa9700 1 -- 172.21.15.170:0/4077452011 learned_addr learned my addr 172.21.15.170:0/4077452011 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bedd45700 1 --1- 172.21.15.170:0/4077452011 >> v1:172.21.15.170:6791/0 conn(0x7f6be80a6870 0x7f6be807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44154/0 (socket says 172.21.15.170:44154) 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751753923 0 0) 0x7f6be805e050 con 0x7f6be80a6870 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd4003230 con 0x7f6be80a6870 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442256487 0 0) 0x7f6be8098000 con 0x7f6be8149040 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.784+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be805e050 con 0x7f6be8149040 2020-01-26T15:37:53.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 114800059 0 0) 0x7f6bd4003230 con 0x7f6be80a6870 2020-01-26T15:37:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 >> v2:172.21.15.170:6790/0 conn(0x7f6be805edd0 msgr2=0x7f6be805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 --2- 172.21.15.170:0/4077452011 >> v2:172.21.15.170:6790/0 conn(0x7f6be805edd0 0x7f6be805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 >> v1:172.21.15.170:6789/0 conn(0x7f6be8149040 legacy=0x7f6be814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be814ecb0 con 0x7f6be80a6870 2020-01-26T15:37:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6bd0001710 con 0x7f6be80a6870 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6bd00019e0 con 0x7f6be80a6870 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6bed544700 1 -- 172.21.15.170:0/4077452011 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6bd00044f0 con 0x7f6be80a6870 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 -- 172.21.15.170:0/4077452011 >> v1:172.21.15.170:6791/0 conn(0x7f6be80a6870 legacy=0x7f6be807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 -- 172.21.15.170:0/4077452011 shutdown_connections 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 --2- 172.21.15.170:0/4077452011 >> v2:172.21.15.170:6790/0 conn(0x7f6be805edd0 0x7f6be805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 -- 172.21.15.170:0/4077452011 >> 172.21.15.170:0/4077452011 conn(0x7f6be8098e70 msgr2=0x7f6be80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 -- 172.21.15.170:0/4077452011 shutdown_connections 2020-01-26T15:37:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 -- 172.21.15.170:0/4077452011 wait complete. 2020-01-26T15:37:53.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 Processor -- start 2020-01-26T15:37:53.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.788+0000 7f6beed47700 1 -- start start 2020-01-26T15:37:53.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6beed47700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6be81208e0 0x7f6be80a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:53.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6beed47700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be8120600 con 0x7f6be807d100 2020-01-26T15:37:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6beed47700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80a1a50 con 0x7f6be80a3930 2020-01-26T15:37:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6beed47700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80a3d60 con 0x7f6be81208e0 2020-01-26T15:37:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f6be80a3930 0x7f6be807c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49034/0 (socket says 172.21.15.170:49034) 2020-01-26T15:37:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 -- 172.21.15.170:0/1039424786 learned_addr learned my addr 172.21.15.170:0/1039424786 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bee546700 -1 --2- 172.21.15.170:0/1039424786 >> v2:172.21.15.170:6790/0 conn(0x7f6be81208e0 0x7f6be80a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bee546700 1 --2- 172.21.15.170:0/1039424786 >> v2:172.21.15.170:6790/0 conn(0x7f6be81208e0 0x7f6be80a29a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577118048 0 0) 0x7f6be8120600 con 0x7f6be807d100 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc003230 con 0x7f6be807d100 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125706681 0 0) 0x7f6be80a1a50 con 0x7f6be80a3930 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be8120600 con 0x7f6be80a3930 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1234866726 0 0) 0x7f6be8120600 con 0x7f6be80a3930 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6be80a1a50 con 0x7f6be80a3930 2020-01-26T15:37:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1579633842 0 0) 0x7f6bcc003230 con 0x7f6be807d100 2020-01-26T15:37:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6be8120600 con 0x7f6be807d100 2020-01-26T15:37:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6bd00015d0 con 0x7f6be80a3930 2020-01-26T15:37:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6bd8001c70 con 0x7f6be807d100 2020-01-26T15:37:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 >> v2:172.21.15.170:6790/0 conn(0x7f6be81208e0 msgr2=0x7f6be80a29a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 --2- 172.21.15.170:0/1039424786 >> v2:172.21.15.170:6790/0 conn(0x7f6be81208e0 0x7f6be80a29a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 >> v1:172.21.15.170:6790/0 conn(0x7f6be80a3930 legacy=0x7f6be807c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 >> v1:172.21.15.170:6789/0 conn(0x7f6be807d100 legacy=0x7f6be813aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6bcc003230 con 0x7f6bcc004fd0 2020-01-26T15:37:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6bcc0041d0 con 0x7f6bcc00ad40 2020-01-26T15:37:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80a3d60 con 0x7f6bcc003d40 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002047067 0 0) 0x7f6bcc003230 con 0x7f6bcc004fd0 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc00e990 con 0x7f6bcc004fd0 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637051844 0 0) 0x7f6bcc0041d0 con 0x7f6bcc00ad40 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc003230 con 0x7f6bcc00ad40 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 -- 172.21.15.170:0/1039424786 >> v1:172.21.15.170:6791/0 conn(0x7f6bcc00ad40 legacy=0x7f6bcc00d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 -- 172.21.15.170:0/1039424786 >> v1:172.21.15.170:6790/0 conn(0x7f6bcc004fd0 legacy=0x7f6bcc003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 -- 172.21.15.170:0/1039424786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f6be809e150 con 0x7f6bcc003d40 2020-01-26T15:37:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be807d530 con 0x7f6bcc003d40 2020-01-26T15:37:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80a3930 con 0x7f6bcc003d40 2020-01-26T15:37:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6bd000a4d0 con 0x7f6bcc003d40 2020-01-26T15:37:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.792+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00086d0 con 0x7f6bcc003d40 2020-01-26T15:37:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.796+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.796+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0003360 con 0x7f6bcc003d40 2020-01-26T15:37:53.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.796+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f6bd00088c0 con 0x7f6bcc003d40 2020-01-26T15:37:53.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.796+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.796+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f6bd004d700 con 0x7f6bcc003d40 2020-01-26T15:37:53.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.800+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.800+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f6bd0033850 con 0x7f6bcc003d40 2020-01-26T15:37:53.954 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6bc0003790 con 0x7f6bcc003d40 2020-01-26T15:37:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6bedd45700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6be6ffd700 1 -- 172.21.15.170:0/1039424786 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6bd0033ab0 con 0x7f6bcc003d40 2020-01-26T15:37:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:53.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 >> v1:172.21.15.170:6800/17396 conn(0x7f6bcc048790 legacy=0x7f6bcc04aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 msgr2=0x7f6bcc00a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:53.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beffa9700 1 -- 172.21.15.170:0/1039424786 reap_dead start 2020-01-26T15:37:53.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f6bd0001110 tx=0x7f6bd0011490).stop 2020-01-26T15:37:53.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 shutdown_connections 2020-01-26T15:37:53.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 --2- 172.21.15.170:0/1039424786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bcc003d40 0x7f6bcc00a7f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:53.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 >> 172.21.15.170:0/1039424786 conn(0x7f6be8099080 msgr2=0x7f6be8072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:53.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 shutdown_connections 2020-01-26T15:37:53.958 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:53.956+0000 7f6beed47700 1 -- 172.21.15.170:0/1039424786 wait complete. 2020-01-26T15:37:53.968 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:37:56.970 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:37:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 Processor -- start 2020-01-26T15:37:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 -- start start 2020-01-26T15:37:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f81e0146c30 0x7f81e0149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f81e01495c0 0x7f81e014ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00a5b80 con 0x7f81e00a5750 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00a43f0 con 0x7f81e01495c0 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.084+0000 7f81e49cc700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00a5210 con 0x7f81e0146c30 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81de59c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f81e0146c30 0x7f81e0149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81de59c700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f81e0146c30 0x7f81e0149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81df59e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f81e01495c0 0x7f81e014ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:37:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ded9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f81e00a5750 0x7f81e00a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49046/0 (socket says 172.21.15.170:49046) 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81df59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f81e01495c0 0x7f81e014ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ded9d700 1 -- 172.21.15.170:0/3068838227 learned_addr learned my addr 172.21.15.170:0/3068838227 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621286292 0 0) 0x7f81e00a5b80 con 0x7f81e00a5750 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81cc003230 con 0x7f81e00a5750 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 908544684 0 0) 0x7f81cc003230 con 0x7f81e00a5750 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 >> v2:172.21.15.170:6791/0 conn(0x7f81e0146c30 msgr2=0x7f81e0149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:57.091 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 --2- 172.21.15.170:0/3068838227 >> v2:172.21.15.170:6791/0 conn(0x7f81e0146c30 0x7f81e0149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 >> v2:172.21.15.170:6790/0 conn(0x7f81e01495c0 msgr2=0x7f81e014ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 --2- 172.21.15.170:0/3068838227 >> v2:172.21.15.170:6790/0 conn(0x7f81e01495c0 0x7f81e014ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0080440 con 0x7f81e00a5750 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f81d8001710 con 0x7f81e00a5750 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f81d8001aa0 con 0x7f81e00a5750 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 -- 172.21.15.170:0/3068838227 >> v1:172.21.15.170:6790/0 conn(0x7f81e00a5750 legacy=0x7f81e00a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.092 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81ddd9b700 1 -- 172.21.15.170:0/3068838227 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f81d8004760 con 0x7f81e00a5750 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 -- 172.21.15.170:0/3068838227 shutdown_connections 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 --2- 172.21.15.170:0/3068838227 >> v2:172.21.15.170:6790/0 conn(0x7f81e01495c0 0x7f81e014ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 --2- 172.21.15.170:0/3068838227 >> v2:172.21.15.170:6791/0 conn(0x7f81e0146c30 0x7f81e0149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 -- 172.21.15.170:0/3068838227 >> 172.21.15.170:0/3068838227 conn(0x7f81e005e050 msgr2=0x7f81e0098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 -- 172.21.15.170:0/3068838227 shutdown_connections 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 -- 172.21.15.170:0/3068838227 wait complete. 2020-01-26T15:37:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 Processor -- start 2020-01-26T15:37:57.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.088+0000 7f81e49cc700 1 -- start start 2020-01-26T15:37:57.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81e49cc700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f81e011e3a0 0x7f81e011cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:57.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81e49cc700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00a2090 con 0x7f81e00a1c60 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81e49cc700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e012ff00 con 0x7f81e0121ac0 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81e49cc700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00a0f90 con 0x7f81e011e3a0 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f81e0121ac0 0x7f81e011dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44178/0 (socket says 172.21.15.170:44178) 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 -- 172.21.15.170:0/3743359463 learned_addr learned my addr 172.21.15.170:0/3743359463 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81de59c700 -1 --2- 172.21.15.170:0/3743359463 >> v2:172.21.15.170:6791/0 conn(0x7f81e011e3a0 0x7f81e011cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81de59c700 1 --2- 172.21.15.170:0/3743359463 >> v2:172.21.15.170:6791/0 conn(0x7f81e011e3a0 0x7f81e011cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:37:57.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319734769 0 0) 0x7f81e00a2090 con 0x7f81e00a1c60 2020-01-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c4003230 con 0x7f81e00a1c60 2020-01-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673585690 0 0) 0x7f81e012ff00 con 0x7f81e0121ac0 2020-01-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e00a2090 con 0x7f81e0121ac0 2020-01-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3429601551 0 0) 0x7f81c4003230 con 0x7f81e00a1c60 2020-01-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f81e012ff00 con 0x7f81e00a1c60 2020-01-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f81c8002620 con 0x7f81e00a1c60 2020-01-26T15:37:57.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 >> v2:172.21.15.170:6791/0 conn(0x7f81e011e3a0 msgr2=0x7f81e011cc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:37:57.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 --2- 172.21.15.170:0/3743359463 >> v2:172.21.15.170:6791/0 conn(0x7f81e011e3a0 0x7f81e011cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:57.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 >> v1:172.21.15.170:6791/0 conn(0x7f81e0121ac0 legacy=0x7f81e011dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 >> v1:172.21.15.170:6789/0 conn(0x7f81e00a1c60 legacy=0x7f81e0129a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.100 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f81c4003230 con 0x7f81c400a7f0 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f81c400f450 con 0x7f81c4004140 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00a0f90 con 0x7f81c4003c30 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984976861 0 0) 0x7f81c4003230 con 0x7f81c400a7f0 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 -- 172.21.15.170:0/3743359463 >> v1:172.21.15.170:6791/0 conn(0x7f81c4004140 legacy=0x7f81c4004b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.101 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 -- 172.21.15.170:0/3743359463 >> v1:172.21.15.170:6790/0 conn(0x7f81c400a7f0 legacy=0x7f81c400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 -- 172.21.15.170:0/3743359463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e012a250 con 0x7f81c4003c30 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e012a520 con 0x7f81c4003c30 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e0121c60 con 0x7f81c4003c30 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:37:57.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f81d800cdd0 con 0x7f81c4003c30 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d80049b0 con 0x7f81c4003c30 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.092+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f81d8004d50 con 0x7f81c4003c30 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.096+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.096+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b8003360 con 0x7f81c4003c30 2020-01-26T15:37:57.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.096+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f81d8006180 con 0x7f81c4003c30 2020-01-26T15:37:57.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.096+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.096+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f81d804d300 con 0x7f81c4003c30 2020-01-26T15:37:57.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.104+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.104+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f81d8033490 con 0x7f81c4003c30 2020-01-26T15:37:57.259 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.260+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81b8003790 con 0x7f81c4003c30 2020-01-26T15:37:57.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.260+0000 7f81ded9d700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:37:57.260 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.260+0000 7f81d77fe700 1 -- 172.21.15.170:0/3743359463 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f81d80336f0 con 0x7f81c4003c30 2020-01-26T15:37:57.261 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:37:57.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 >> v1:172.21.15.170:6800/17396 conn(0x7f81c4048080 legacy=0x7f81c404a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81df59e700 1 -- 172.21.15.170:0/3743359463 reap_dead start 2020-01-26T15:37:57.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 msgr2=0x7f81c40045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:37:57.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f81d8001e80 tx=0x7f81d8010e00).stop 2020-01-26T15:37:57.262 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 shutdown_connections 2020-01-26T15:37:57.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 --2- 172.21.15.170:0/3743359463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c4003c30 0x7f81c40045a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:37:57.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 >> 172.21.15.170:0/3743359463 conn(0x7f81e00a4110 msgr2=0x7f81e007f500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:37:57.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 shutdown_connections 2020-01-26T15:37:57.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:37:57.264+0000 7f81e49cc700 1 -- 172.21.15.170:0/3743359463 wait complete. 2020-01-26T15:37:57.273 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:00.274 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:00.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 Processor -- start 2020-01-26T15:38:00.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 -- start start 2020-01-26T15:38:00.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f977c05edd0 0x7f977c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:00.396 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f977c0a6870 0x7f977c07ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:00.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c098000 con 0x7f977c0804d0 2020-01-26T15:38:00.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f977c05e050 con 0x7f977c0a6870 2020-01-26T15:38:00.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977bfff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0a6ca0 con 0x7f977c05edd0 2020-01-26T15:38:00.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977b7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f977c05edd0 0x7f977c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:00.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f9781974700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f977c0804d0 0x7f977c0247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44194/0 (socket says 172.21.15.170:44194) 2020-01-26T15:38:00.397 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977b7fe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f977c05edd0 0x7f977c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f9781974700 1 -- 172.21.15.170:0/2447231049 learned_addr learned my addr 172.21.15.170:0/2447231049 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977affd700 -1 --2- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6790/0 conn(0x7f977c0a6870 0x7f977c07ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.392+0000 7f977affd700 1 --2- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6790/0 conn(0x7f977c0a6870 0x7f977c07ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754516237 0 0) 0x7f977c098000 con 0x7f977c0804d0 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9768003230 con 0x7f977c0804d0 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4141899886 0 0) 0x7f9768003230 con 0x7f977c0804d0 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6791/0 conn(0x7f977c05edd0 msgr2=0x7f977c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:00.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 --2- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6791/0 conn(0x7f977c05edd0 0x7f977c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6790/0 conn(0x7f977c0a6870 msgr2=0x7f977c07ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 --2- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6790/0 conn(0x7f977c0a6870 0x7f977c07ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c024fb0 con 0x7f977c0804d0 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f9774001a90 con 0x7f977c0804d0 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9774001e20 con 0x7f977c0804d0 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977a7fc700 1 -- 172.21.15.170:0/2447231049 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f9774004ae0 con 0x7f977c0804d0 2020-01-26T15:38:00.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 -- 172.21.15.170:0/2447231049 >> v1:172.21.15.170:6791/0 conn(0x7f977c0804d0 legacy=0x7f977c0247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:00.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 -- 172.21.15.170:0/2447231049 shutdown_connections 2020-01-26T15:38:00.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 --2- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6791/0 conn(0x7f977c05edd0 0x7f977c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:00.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 --2- 172.21.15.170:0/2447231049 >> v2:172.21.15.170:6790/0 conn(0x7f977c0a6870 0x7f977c07ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:00.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 -- 172.21.15.170:0/2447231049 >> 172.21.15.170:0/2447231049 conn(0x7f977c098e70 msgr2=0x7f977c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:00.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 -- 172.21.15.170:0/2447231049 shutdown_connections 2020-01-26T15:38:00.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 -- 172.21.15.170:0/2447231049 wait complete. 2020-01-26T15:38:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 Processor -- start 2020-01-26T15:38:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.396+0000 7f977bfff700 1 -- start start 2020-01-26T15:38:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f977c07f6a0 0x7f977c0a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f977c1385e0 0x7f977c13aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c122ff0 con 0x7f977c0a43e0 2020-01-26T15:38:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0a2df0 con 0x7f977c1385e0 2020-01-26T15:38:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0a3080 con 0x7f977c07f6a0 2020-01-26T15:38:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f977c07f6a0 0x7f977c0a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f977c07f6a0 0x7f977c0a28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977b7fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f977c0a43e0 0x7f977c07eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52196/0 (socket says 172.21.15.170:52196) 2020-01-26T15:38:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977b7fe700 1 -- 172.21.15.170:0/3766951552 learned_addr learned my addr 172.21.15.170:0/3766951552 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9781974700 -1 --2- 172.21.15.170:0/3766951552 >> v2:172.21.15.170:6790/0 conn(0x7f977c1385e0 0x7f977c13aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9781974700 1 --2- 172.21.15.170:0/3766951552 >> v2:172.21.15.170:6790/0 conn(0x7f977c1385e0 0x7f977c13aa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266709906 0 0) 0x7f977c122ff0 con 0x7f977c0a43e0 2020-01-26T15:38:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760003230 con 0x7f977c0a43e0 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 337193962 0 0) 0x7f9760003230 con 0x7f977c0a43e0 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f977c122ff0 con 0x7f977c0a43e0 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f976c002780 con 0x7f977c0a43e0 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 >> v2:172.21.15.170:6791/0 conn(0x7f977c07f6a0 msgr2=0x7f977c0a28a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 --2- 172.21.15.170:0/3766951552 >> v2:172.21.15.170:6791/0 conn(0x7f977c07f6a0 0x7f977c0a28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 >> v2:172.21.15.170:6790/0 conn(0x7f977c1385e0 msgr2=0x7f977c13aa20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 --2- 172.21.15.170:0/3766951552 >> v2:172.21.15.170:6790/0 conn(0x7f977c1385e0 0x7f977c13aa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 >> v1:172.21.15.170:6789/0 conn(0x7f977c0a43e0 legacy=0x7f977c07eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9760003230 con 0x7f976000a7f0 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f976000f450 con 0x7f9760003aa0 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a2df0 con 0x7f9760003ef0 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781172875 0 0) 0x7f976000f450 con 0x7f9760003aa0 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f976000e440 con 0x7f9760003aa0 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364958586 0 0) 0x7f9760003230 con 0x7f976000a7f0 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f976000f450 con 0x7f976000a7f0 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 -- 172.21.15.170:0/3766951552 >> v1:172.21.15.170:6791/0 conn(0x7f9760003aa0 legacy=0x7f97600045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 -- 172.21.15.170:0/3766951552 >> v1:172.21.15.170:6790/0 conn(0x7f976000a7f0 legacy=0x7f976000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 -- 172.21.15.170:0/3766951552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0a6790 con 0x7f9760003ef0 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9781974700 1 -- 172.21.15.170:0/3766951552 reap_dead start 2020-01-26T15:38:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c122b30 con 0x7f9760003ef0 2020-01-26T15:38:00.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:00.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c09e1a0 con 0x7f9760003ef0 2020-01-26T15:38:00.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.400+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9764009d70 con 0x7f9760003ef0 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764007990 con 0x7f9760003ef0 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9764007df0 con 0x7f9760003ef0 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754003360 con 0x7f9760003ef0 2020-01-26T15:38:00.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f9764005780 con 0x7f9760003ef0 2020-01-26T15:38:00.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.404+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f976404d010 con 0x7f9760003ef0 2020-01-26T15:38:00.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.408+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.408+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f97640330e0 con 0x7f9760003ef0 2020-01-26T15:38:00.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9754003790 con 0x7f9760003ef0 2020-01-26T15:38:00.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977affd700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:00.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f9773fff700 1 -- 172.21.15.170:0/3766951552 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9764033340 con 0x7f9760003ef0 2020-01-26T15:38:00.567 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:00.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 >> v1:172.21.15.170:6800/17396 conn(0x7f9760040d80 legacy=0x7f9760043290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:00.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 msgr2=0x7f9760004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:00.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f9764002f30 tx=0x7f9764010a80).stop 2020-01-26T15:38:00.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 shutdown_connections 2020-01-26T15:38:00.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 --2- 172.21.15.170:0/3766951552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9760003ef0 0x7f9760004da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:00.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 >> 172.21.15.170:0/3766951552 conn(0x7f977c098ea0 msgr2=0x7f977c09ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:00.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 shutdown_connections 2020-01-26T15:38:00.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:00.568+0000 7f977bfff700 1 -- 172.21.15.170:0/3766951552 wait complete. 2020-01-26T15:38:00.580 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:03.582 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:03.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.696+0000 7f000b2a3700 1 Processor -- start 2020-01-26T15:38:03.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.696+0000 7f000b2a3700 1 -- start start 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f00040a6870 0x7f000414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000405ea20 con 0x7f000405e5f0 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0004098000 con 0x7f000405edd0 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f000405e050 con 0x7f00040a6870 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000aaa2700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f000405edd0 0x7f000407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44212/0 (socket says 172.21.15.170:44212) 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000aaa2700 1 -- 172.21.15.170:0/1858385843 learned_addr learned my addr 172.21.15.170:0/1858385843 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:03.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000c505700 -1 --2- 172.21.15.170:0/1858385843 >> v2:172.21.15.170:6790/0 conn(0x7f00040a6870 0x7f000414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000c505700 1 --2- 172.21.15.170:0/1858385843 >> v2:172.21.15.170:6790/0 conn(0x7f00040a6870 0x7f000414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800640753 0 0) 0x7f0004098000 con 0x7f000405edd0 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003230 con 0x7f000405edd0 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376965892 0 0) 0x7f000405ea20 con 0x7f000405e5f0 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0004098000 con 0x7f000405e5f0 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 769042142 0 0) 0x7efff0003230 con 0x7f000405edd0 2020-01-26T15:38:03.703 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 >> v2:172.21.15.170:6790/0 conn(0x7f00040a6870 msgr2=0x7f000414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 --2- 172.21.15.170:0/1858385843 >> v2:172.21.15.170:6790/0 conn(0x7f00040a6870 0x7f000414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 >> v1:172.21.15.170:6789/0 conn(0x7f000405e5f0 legacy=0x7f0004149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040a6ca0 con 0x7f000405edd0 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0000001a90 con 0x7f000405edd0 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0000001d60 con 0x7f000405edd0 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f0009aa0700 1 -- 172.21.15.170:0/1858385843 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0000004930 con 0x7f000405edd0 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- 172.21.15.170:0/1858385843 >> v1:172.21.15.170:6791/0 conn(0x7f000405edd0 legacy=0x7f000407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:03.704 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- 172.21.15.170:0/1858385843 shutdown_connections 2020-01-26T15:38:03.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 --2- 172.21.15.170:0/1858385843 >> v2:172.21.15.170:6790/0 conn(0x7f00040a6870 0x7f000414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:03.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- 172.21.15.170:0/1858385843 >> 172.21.15.170:0/1858385843 conn(0x7f0004098e70 msgr2=0x7f00040a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:03.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- 172.21.15.170:0/1858385843 shutdown_connections 2020-01-26T15:38:03.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.700+0000 7f000b2a3700 1 -- 172.21.15.170:0/1858385843 wait complete. 2020-01-26T15:38:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 Processor -- start 2020-01-26T15:38:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 -- start start 2020-01-26T15:38:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f000409de40 0x7f000407d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f0004136cd0 0x7f0004139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040625a0 con 0x7f000407d590 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f000409e520 con 0x7f0004136cd0 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0004061af0 con 0x7f000409de40 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000c505700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f0004136cd0 0x7f0004139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000c505700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f0004136cd0 0x7f0004139110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000aaa2700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f000409de40 0x7f000407d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000a2a1700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f000407d590 0x7f00040608e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49092/0 (socket says 172.21.15.170:49092) 2020-01-26T15:38:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000aaa2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f000409de40 0x7f000407d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000a2a1700 1 -- 172.21.15.170:0/4047312665 learned_addr learned my addr 172.21.15.170:0/4047312665 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462912721 0 0) 0x7f00040625a0 con 0x7f000407d590 2020-01-26T15:38:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec003230 con 0x7f000407d590 2020-01-26T15:38:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 427855685 0 0) 0x7effec003230 con 0x7f000407d590 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f00040625a0 con 0x7f000407d590 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7efff4002940 con 0x7f000407d590 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3095696116 0 0) 0x7f00040625a0 con 0x7f000407d590 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 >> v2:172.21.15.170:6791/0 conn(0x7f000409de40 msgr2=0x7f000407d040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 --2- 172.21.15.170:0/4047312665 >> v2:172.21.15.170:6791/0 conn(0x7f000409de40 0x7f000407d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 >> v2:172.21.15.170:6790/0 conn(0x7f0004136cd0 msgr2=0x7f0004139110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:03.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 --2- 172.21.15.170:0/4047312665 >> v2:172.21.15.170:6790/0 conn(0x7f0004136cd0 0x7f0004139110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004060260 con 0x7f000407d590 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000407de00 con 0x7f000407d590 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040617f0 con 0x7f000407d590 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efff40015c0 con 0x7f000407d590 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.704+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7efff40019a0 con 0x7f000407d590 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.708+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004056600 con 0x7f000407d590 2020-01-26T15:38:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.708+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7efff4001ba0 con 0x7f000407d590 2020-01-26T15:38:03.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.708+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7efff404bb90 con 0x7f000407d590 2020-01-26T15:38:03.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.712+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7efff4030ff0 con 0x7f000407d590 2020-01-26T15:38:03.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.868+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f00040a3740 con 0x7f000407d590 2020-01-26T15:38:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.868+0000 7efffb7fe700 1 -- 172.21.15.170:0/4047312665 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7efff4001f30 con 0x7f000407d590 2020-01-26T15:38:03.868 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:03.869 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.868+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 >> v1:172.21.15.170:6800/17396 conn(0x7effec03e0a0 legacy=0x7effec0405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.868+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 >> v1:172.21.15.170:6790/0 conn(0x7f000407d590 legacy=0x7f00040608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.872+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 shutdown_connections 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.872+0000 7f000b2a3700 1 --2- 172.21.15.170:0/4047312665 >> v2:172.21.15.170:6790/0 conn(0x7f0004136cd0 0x7f0004139110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.872+0000 7f000b2a3700 1 --2- 172.21.15.170:0/4047312665 >> v2:172.21.15.170:6791/0 conn(0x7f000409de40 0x7f000407d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.872+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 >> 172.21.15.170:0/4047312665 conn(0x7f000405edd0 msgr2=0x7f00040a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.872+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 shutdown_connections 2020-01-26T15:38:03.870 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:03.872+0000 7f000b2a3700 1 -- 172.21.15.170:0/4047312665 wait complete. 2020-01-26T15:38:03.880 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:06.881 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:07.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 Processor -- start 2020-01-26T15:38:07.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- start start 2020-01-26T15:38:07.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fc05805edd0 0x7fc05805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:07.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc0580a6870 0x7fc05807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:07.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc058098000 con 0x7fc0580804d0 2020-01-26T15:38:07.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc05805e050 con 0x7fc05805edd0 2020-01-26T15:38:07.002 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580a6ca0 con 0x7fc0580a6870 2020-01-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc056ffd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc0580a6870 0x7fc05807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc056ffd700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc0580a6870 0x7fc05807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc05d625700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fc0580804d0 0x7fc0580247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49104/0 (socket says 172.21.15.170:49104) 2020-01-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc05d625700 1 -- 172.21.15.170:0/3195275956 learned_addr learned my addr 172.21.15.170:0/3195275956 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0577fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fc05805edd0 0x7fc05805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0577fe700 1 --2- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6790/0 conn(0x7fc05805edd0 0x7fc05805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:07.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824900817 0 0) 0x7fc058098000 con 0x7fc0580804d0 2020-01-26T15:38:07.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc040003230 con 0x7fc0580804d0 2020-01-26T15:38:07.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1212077828 0 0) 0x7fc040003230 con 0x7fc0580804d0 2020-01-26T15:38:07.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6791/0 conn(0x7fc0580a6870 msgr2=0x7fc05807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:07.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 --2- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6791/0 conn(0x7fc0580a6870 0x7fc05807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:07.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6790/0 conn(0x7fc05805edd0 msgr2=0x7fc05805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:07.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 --2- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6790/0 conn(0x7fc05805edd0 0x7fc05805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:07.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058024fb0 con 0x7fc0580804d0 2020-01-26T15:38:07.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc050001a90 con 0x7fc0580804d0 2020-01-26T15:38:07.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc050001e20 con 0x7fc0580804d0 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc0567fc700 1 -- 172.21.15.170:0/3195275956 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc050004930 con 0x7fc0580804d0 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- 172.21.15.170:0/3195275956 >> v1:172.21.15.170:6790/0 conn(0x7fc0580804d0 legacy=0x7fc0580247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- 172.21.15.170:0/3195275956 shutdown_connections 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 --2- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6790/0 conn(0x7fc05805edd0 0x7fc05805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 --2- 172.21.15.170:0/3195275956 >> v2:172.21.15.170:6791/0 conn(0x7fc0580a6870 0x7fc05807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- 172.21.15.170:0/3195275956 >> 172.21.15.170:0/3195275956 conn(0x7fc058098e70 msgr2=0x7fc0580a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:07.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- 172.21.15.170:0/3195275956 shutdown_connections 2020-01-26T15:38:07.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.000+0000 7fc057fff700 1 -- 172.21.15.170:0/3195275956 wait complete. 2020-01-26T15:38:07.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc057fff700 1 Processor -- start 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc057fff700 1 -- start start 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc057fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fc058060b00 0x7fc058061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc057fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05809e490 con 0x7fc05812fde0 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc057fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc058060360 con 0x7fc058135220 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc057fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc05809dc60 con 0x7fc058060b00 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc05d625700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fc058135220 0x7fc058137660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49110/0 (socket says 172.21.15.170:49110) 2020-01-26T15:38:07.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc0577fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fc058060b00 0x7fc058061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:07.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc05d625700 1 -- 172.21.15.170:0/3654568093 learned_addr learned my addr 172.21.15.170:0/3654568093 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:07.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc0577fe700 1 --2- 172.21.15.170:0/3654568093 >> v2:172.21.15.170:6790/0 conn(0x7fc058060b00 0x7fc058061fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:07.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249903010 0 0) 0x7fc058060360 con 0x7fc058135220 2020-01-26T15:38:07.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc038003230 con 0x7fc058135220 2020-01-26T15:38:07.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176730249 0 0) 0x7fc04c000e90 con 0x7fc05812fde0 2020-01-26T15:38:07.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc058060360 con 0x7fc05812fde0 2020-01-26T15:38:07.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2150160617 0 0) 0x7fc038003230 con 0x7fc058135220 2020-01-26T15:38:07.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc04c000e90 con 0x7fc058135220 2020-01-26T15:38:07.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc0500017a0 con 0x7fc058135220 2020-01-26T15:38:07.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4144432674 0 0) 0x7fc058060360 con 0x7fc05812fde0 2020-01-26T15:38:07.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc038003230 con 0x7fc05812fde0 2020-01-26T15:38:07.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc04c001800 con 0x7fc05812fde0 2020-01-26T15:38:07.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.004+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 >> v2:172.21.15.170:6790/0 conn(0x7fc058060b00 msgr2=0x7fc058061fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:07.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 --2- 172.21.15.170:0/3654568093 >> v2:172.21.15.170:6790/0 conn(0x7fc058060b00 0x7fc058061fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:07.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 >> v1:172.21.15.170:6790/0 conn(0x7fc058135220 legacy=0x7fc058137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 >> v1:172.21.15.170:6789/0 conn(0x7fc05812fde0 legacy=0x7fc058130210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc04c000e90 con 0x7fc038003d40 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc058060360 con 0x7fc038004f00 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05809dc60 con 0x7fc03800c000 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:07.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553462551 0 0) 0x7fc04c000e90 con 0x7fc038003d40 2020-01-26T15:38:07.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03800e990 con 0x7fc038003d40 2020-01-26T15:38:07.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146342260 0 0) 0x7fc058060360 con 0x7fc038004f00 2020-01-26T15:38:07.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c000e90 con 0x7fc038004f00 2020-01-26T15:38:07.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 -- 172.21.15.170:0/3654568093 >> v1:172.21.15.170:6791/0 conn(0x7fc038004f00 legacy=0x7fc038003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 -- 172.21.15.170:0/3654568093 >> v1:172.21.15.170:6790/0 conn(0x7fc038003d40 legacy=0x7fc03800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 -- 172.21.15.170:0/3654568093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fc05809d730 con 0x7fc03800c000 2020-01-26T15:38:07.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc058060f30 con 0x7fc03800c000 2020-01-26T15:38:07.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:07.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc058130bb0 con 0x7fc03800c000 2020-01-26T15:38:07.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc05000f780 con 0x7fc03800c000 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0500015b0 con 0x7fc03800c000 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc05000f980 con 0x7fc03800c000 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030003360 con 0x7fc03800c000 2020-01-26T15:38:07.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.008+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fc05004dd30 con 0x7fc03800c000 2020-01-26T15:38:07.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.016+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.016+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc050033ee0 con 0x7fc03800c000 2020-01-26T15:38:07.171 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.172+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc030003790 con 0x7fc03800c000 2020-01-26T15:38:07.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.172+0000 7fc05d625700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:07.172 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.172+0000 7fc03ffff700 1 -- 172.21.15.170:0/3654568093 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc050034140 con 0x7fc03800c000 2020-01-26T15:38:07.172 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:07.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 >> v1:172.21.15.170:6800/17396 conn(0x7fc0380485b0 legacy=0x7fc03804aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc05d625700 1 -- 172.21.15.170:0/3654568093 reap_dead start 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 msgr2=0x7fc03800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fc050004970 tx=0x7fc050011850).stop 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 shutdown_connections 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 --2- 172.21.15.170:0/3654568093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc03800c000 0x7fc03800e440 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 >> 172.21.15.170:0/3654568093 conn(0x7fc05805bdd0 msgr2=0x7fc0580a3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:07.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 shutdown_connections 2020-01-26T15:38:07.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:07.176+0000 7fc057fff700 1 -- 172.21.15.170:0/3654568093 wait complete. 2020-01-26T15:38:07.190 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:10.191 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 Processor -- start 2020-01-26T15:38:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 -- start start 2020-01-26T15:38:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2e2c05edd0 0x7f2e2c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c098000 con 0x7f2e2c149040 2020-01-26T15:38:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c05e050 con 0x7f2e2c0a6870 2020-01-26T15:38:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0a6ca0 con 0x7f2e2c05edd0 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e324ff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f2e2c0a6870 0x7f2e2c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44246/0 (socket says 172.21.15.170:44246) 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e324ff700 1 -- 172.21.15.170:0/1499889223 learned_addr learned my addr 172.21.15.170:0/1499889223 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e32d00700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2e2c05edd0 0x7f2e2c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e32d00700 1 --2- 172.21.15.170:0/1499889223 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c05edd0 0x7f2e2c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166423605 0 0) 0x7f2e2c05e050 con 0x7f2e2c0a6870 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e18003230 con 0x7f2e2c0a6870 2020-01-26T15:38:10.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103426769 0 0) 0x7f2e2c098000 con 0x7f2e2c149040 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e2c05e050 con 0x7f2e2c149040 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 722483211 0 0) 0x7f2e18003230 con 0x7f2e2c0a6870 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c05edd0 msgr2=0x7f2e2c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 --2- 172.21.15.170:0/1499889223 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c05edd0 0x7f2e2c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 >> v1:172.21.15.170:6790/0 conn(0x7f2e2c149040 legacy=0x7f2e2c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c14ecb0 con 0x7f2e2c0a6870 2020-01-26T15:38:10.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2e20001710 con 0x7f2e2c0a6870 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2e200019e0 con 0x7f2e2c0a6870 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e31cfe700 1 -- 172.21.15.170:0/1499889223 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2e200045b0 con 0x7f2e2c0a6870 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.312+0000 7f2e33501700 1 -- 172.21.15.170:0/1499889223 >> v1:172.21.15.170:6791/0 conn(0x7f2e2c0a6870 legacy=0x7f2e2c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- 172.21.15.170:0/1499889223 shutdown_connections 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 --2- 172.21.15.170:0/1499889223 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c05edd0 0x7f2e2c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- 172.21.15.170:0/1499889223 >> 172.21.15.170:0/1499889223 conn(0x7f2e2c098e70 msgr2=0x7f2e2c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:10.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- 172.21.15.170:0/1499889223 shutdown_connections 2020-01-26T15:38:10.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- 172.21.15.170:0/1499889223 wait complete. 2020-01-26T15:38:10.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 Processor -- start 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- start start 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2e2c1399d0 0x7f2e2c13be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c0a1b40 con 0x7f2e2c0a2270 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c0a36d0 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c099220 con 0x7f2e2c1399d0 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e324ff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f2e2c07c9e0 0x7f2e2c07ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44252/0 (socket says 172.21.15.170:44252) 2020-01-26T15:38:10.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e34763700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2e2c1399d0 0x7f2e2c13be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e324ff700 1 -- 172.21.15.170:0/3820166937 learned_addr learned my addr 172.21.15.170:0/3820166937 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e34763700 1 --2- 172.21.15.170:0/3820166937 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c1399d0 0x7f2e2c13be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230179665 0 0) 0x7f2e2c0a36d0 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e14003230 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389492204 0 0) 0x7f2e2c0a1b40 con 0x7f2e2c0a2270 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e2c0a36d0 con 0x7f2e2c0a2270 2020-01-26T15:38:10.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1685788566 0 0) 0x7f2e14003230 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e2c0a1b40 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2e20001420 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2170468115 0 0) 0x7f2e2c0a36d0 con 0x7f2e2c0a2270 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e14003230 con 0x7f2e2c0a2270 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2e280016a0 con 0x7f2e2c0a2270 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3459555956 0 0) 0x7f2e2c0a1b40 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c1399d0 msgr2=0x7f2e2c13be10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 --2- 172.21.15.170:0/3820166937 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c1399d0 0x7f2e2c13be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 >> v1:172.21.15.170:6790/0 conn(0x7f2e2c0a2270 legacy=0x7f2e2c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c09f090 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c0a3340 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c09e1c0 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2e20004880 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.316+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2e20004c20 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.320+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f2e20010660 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.320+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f2e2004ba00 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.320+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c056600 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.324+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f2e20030c60 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2e2c05cc60 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e1f7fe700 1 -- 172.21.15.170:0/3820166937 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f2e20030ec0 con 0x7f2e2c07c9e0 2020-01-26T15:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:10.479 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 >> v1:172.21.15.170:6800/17396 conn(0x7f2e1403e490 legacy=0x7f2e140409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:10.479 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 >> v1:172.21.15.170:6791/0 conn(0x7f2e2c07c9e0 legacy=0x7f2e2c07ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:10.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 shutdown_connections 2020-01-26T15:38:10.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 --2- 172.21.15.170:0/3820166937 >> v2:172.21.15.170:6791/0 conn(0x7f2e2c1399d0 0x7f2e2c13be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:10.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 >> 172.21.15.170:0/3820166937 conn(0x7f2e2c05efd0 msgr2=0x7f2e2c11ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:10.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 shutdown_connections 2020-01-26T15:38:10.490 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:10.480+0000 7f2e33501700 1 -- 172.21.15.170:0/3820166937 wait complete. 2020-01-26T15:38:10.491 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:13.492 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:13.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 Processor -- start 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 -- start start 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f000c05e5f0 0x7f000c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f000c149040 0x7f000c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0a6dc0 con 0x7f000c05edd0 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f000c05ea20 con 0x7f000c05e5f0 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0010b15700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f000c098000 con 0x7f000c149040 2020-01-26T15:38:13.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000b7fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f000c05e5f0 0x7f000c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0011d77700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f000c149040 0x7f000c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000bfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f000c05edd0 0x7f000c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52258/0 (socket says 172.21.15.170:52258) 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000bfff700 1 -- 172.21.15.170:0/1012453268 learned_addr learned my addr 172.21.15.170:0/1012453268 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f0011d77700 1 --2- 172.21.15.170:0/1012453268 >> v2:172.21.15.170:6791/0 conn(0x7f000c149040 0x7f000c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> v2:172.21.15.170:6790/0 conn(0x7f000c05e5f0 0x7f000c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380039379 0 0) 0x7f000c0a6dc0 con 0x7f000c05edd0 2020-01-26T15:38:13.618 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff8003230 con 0x7f000c05edd0 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 498531720 0 0) 0x7efff8003230 con 0x7f000c05edd0 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 >> v2:172.21.15.170:6791/0 conn(0x7f000c149040 msgr2=0x7f000c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 --2- 172.21.15.170:0/1012453268 >> v2:172.21.15.170:6791/0 conn(0x7f000c149040 0x7f000c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 >> v2:172.21.15.170:6790/0 conn(0x7f000c05e5f0 msgr2=0x7f000c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 --2- 172.21.15.170:0/1012453268 >> v2:172.21.15.170:6790/0 conn(0x7f000c05e5f0 0x7f000c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c05e050 con 0x7f000c05edd0 2020-01-26T15:38:13.619 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7efffc001710 con 0x7f000c05edd0 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 >> v1:172.21.15.170:6789/0 conn(0x7f000c05edd0 legacy=0x7f000c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7efff8003230 con 0x7efff8003860 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f000c0a6dc0 con 0x7efff800a310 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.608+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c05ea20 con 0x7efff80077d0 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910188542 0 0) 0x7f000c0a6dc0 con 0x7efff800a310 2020-01-26T15:38:13.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff800f310 con 0x7efff800a310 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679747807 0 0) 0x7efff8003230 con 0x7efff8003860 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c0a6dc0 con 0x7efff8003860 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 -- 172.21.15.170:0/1012453268 >> v1:172.21.15.170:6791/0 conn(0x7efff800a310 legacy=0x7efff800c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 -- 172.21.15.170:0/1012453268 >> v1:172.21.15.170:6790/0 conn(0x7efff8003860 legacy=0x7efff8003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0011d77700 1 -- 172.21.15.170:0/1012453268 reap_dead start 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 -- 172.21.15.170:0/1012453268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8054470 con 0x7efff80077d0 2020-01-26T15:38:13.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efff4008900 tx=0x7efff400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efff4008900 tx=0x7efff400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7efff4008900 tx=0x7efff400fe60).ready entity=mon.0 client_cookie=88d5bcb36d5abe4a server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7efff4008900 tx=0x7efff400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7efff4005de0 con 0x7efff80077d0 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7efff4008900 tx=0x7efff400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4008940 con 0x7efff80077d0 2020-01-26T15:38:13.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000b7fe700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7efff4008900 tx=0x7efff400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 -- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 msgr2=0x7efff8009c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f000affd700 1 -- 172.21.15.170:0/1012453268 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7efff4008d60 con 0x7efff80077d0 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7efff4008900 tx=0x7efff400fe60).stop 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 -- 172.21.15.170:0/1012453268 shutdown_connections 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 --2- 172.21.15.170:0/1012453268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efff80077d0 0x7efff8009c90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 -- 172.21.15.170:0/1012453268 >> 172.21.15.170:0/1012453268 conn(0x7f000c098e70 msgr2=0x7f000c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:13.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 -- 172.21.15.170:0/1012453268 shutdown_connections 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.612+0000 7f0010b15700 1 -- 172.21.15.170:0/1012453268 wait complete. 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 Processor -- start 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 -- start start 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f000c0a2630 0x7f000c09fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c133c30 con 0x7f000c079de0 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c09f8c0 con 0x7f000c09f490 2020-01-26T15:38:13.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f000c09e700 con 0x7f000c0a2630 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f000bfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f000c0a2630 0x7f000c09fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f000bfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f000c0a2630 0x7f000c09fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0011d77700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f000c079de0 0x7f000c13a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49150/0 (socket says 172.21.15.170:49150) 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f000b7fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f000c09f490 0x7f000c133430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44272/0 (socket says 172.21.15.170:44272) 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0011d77700 1 -- 172.21.15.170:0/1042210475 learned_addr learned my addr 172.21.15.170:0/1042210475 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263343701 0 0) 0x7f000c09f8c0 con 0x7f000c09f490 2020-01-26T15:38:13.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003230 con 0x7f000c09f490 2020-01-26T15:38:13.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135197420 0 0) 0x7f000c133c30 con 0x7f000c079de0 2020-01-26T15:38:13.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c09f8c0 con 0x7f000c079de0 2020-01-26T15:38:13.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2693866458 0 0) 0x7efff0003230 con 0x7f000c09f490 2020-01-26T15:38:13.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f000c133c30 con 0x7f000c09f490 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7efff4008680 con 0x7f000c09f490 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3554331650 0 0) 0x7f000c09f8c0 con 0x7f000c079de0 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efff0003230 con 0x7f000c079de0 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0004001a00 con 0x7f000c079de0 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 517291298 0 0) 0x7f000c133c30 con 0x7f000c09f490 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 >> v2:172.21.15.170:6790/0 conn(0x7f000c0a2630 msgr2=0x7f000c09fc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:13.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 --2- 172.21.15.170:0/1042210475 >> v2:172.21.15.170:6790/0 conn(0x7f000c0a2630 0x7f000c09fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:13.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 >> v1:172.21.15.170:6790/0 conn(0x7f000c079de0 legacy=0x7f000c13a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c09e150 con 0x7f000c09f490 2020-01-26T15:38:13.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c07a210 con 0x7f000c09f490 2020-01-26T15:38:13.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c07a790 con 0x7f000c09f490 2020-01-26T15:38:13.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efff4005c30 con 0x7f000c09f490 2020-01-26T15:38:13.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.616+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7efff40105a0 con 0x7f000c09f490 2020-01-26T15:38:13.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.620+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe4003360 con 0x7f000c09f490 2020-01-26T15:38:13.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.620+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7efff4010820 con 0x7f000c09f490 2020-01-26T15:38:13.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.620+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7efff404cdb0 con 0x7f000c09f490 2020-01-26T15:38:13.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.624+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7efff4032130 con 0x7f000c09f490 2020-01-26T15:38:13.777 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.776+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7effe40037d0 con 0x7f000c09f490 2020-01-26T15:38:13.778 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0008ff9700 1 -- 172.21.15.170:0/1042210475 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7efff4032390 con 0x7f000c09f490 2020-01-26T15:38:13.778 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:13.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 >> v1:172.21.15.170:6800/17396 conn(0x7efff003e3c0 legacy=0x7efff00408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 >> v1:172.21.15.170:6791/0 conn(0x7f000c09f490 legacy=0x7f000c133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:13.779 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 shutdown_connections 2020-01-26T15:38:13.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 --2- 172.21.15.170:0/1042210475 >> v2:172.21.15.170:6790/0 conn(0x7f000c0a2630 0x7f000c09fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:13.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 >> 172.21.15.170:0/1042210475 conn(0x7f000c0a5520 msgr2=0x7f000c0a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:13.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 shutdown_connections 2020-01-26T15:38:13.780 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:13.780+0000 7f0010b15700 1 -- 172.21.15.170:0/1042210475 wait complete. 2020-01-26T15:38:13.791 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:16.792 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2b59e700 1 Processor -- start 2020-01-26T15:38:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2b59e700 1 -- start start 2020-01-26T15:38:16.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2b59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c05ea20 con 0x7fdc2c05edd0 2020-01-26T15:38:16.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2b59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c098000 con 0x7fdc2c0a6870 2020-01-26T15:38:16.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2b59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c05e050 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2a59c700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fdc2c05e5f0 0x7fdc2c149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44280/0 (socket says 172.21.15.170:44280) 2020-01-26T15:38:16.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2ad9d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fdc2c05edd0 0x7fdc2c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52278/0 (socket says 172.21.15.170:52278) 2020-01-26T15:38:16.912 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2a59c700 1 -- 172.21.15.170:0/3762111632 learned_addr learned my addr 172.21.15.170:0/3762111632 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334617053 0 0) 0x7fdc2c098000 con 0x7fdc2c0a6870 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc18003230 con 0x7fdc2c0a6870 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918905817 0 0) 0x7fdc2c05e050 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc2c098000 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866943090 0 0) 0x7fdc2c05ea20 con 0x7fdc2c05edd0 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc2c05e050 con 0x7fdc2c05edd0 2020-01-26T15:38:16.913 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 53773694 0 0) 0x7fdc2c098000 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 >> v1:172.21.15.170:6790/0 conn(0x7fdc2c0a6870 legacy=0x7fdc2c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 >> v1:172.21.15.170:6789/0 conn(0x7fdc2c05edd0 legacy=0x7fdc2c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c0a6ca0 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fdc14001620 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdc14001820 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc29d9b700 1 -- 172.21.15.170:0/3762111632 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fdc14001c40 con 0x7fdc2c05e5f0 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.908+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3762111632 >> v1:172.21.15.170:6791/0 conn(0x7fdc2c05e5f0 legacy=0x7fdc2c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:16.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.912+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3762111632 shutdown_connections 2020-01-26T15:38:16.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.912+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3762111632 >> 172.21.15.170:0/3762111632 conn(0x7fdc2c098e70 msgr2=0x7fdc2c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:16.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.912+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3762111632 shutdown_connections 2020-01-26T15:38:16.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.912+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3762111632 wait complete. 2020-01-26T15:38:16.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.912+0000 7fdc2b59e700 1 Processor -- start 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.912+0000 7fdc2b59e700 1 -- start start 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fdc2c09e150 0x7fdc2c0a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fdc2c0a4b50 0x7fdc2c13acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c07d290 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c11f270 con 0x7fdc2c0a4b50 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c09e5f0 con 0x7fdc2c09e150 2020-01-26T15:38:16.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2a59c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fdc2c0a3d50 0x7fdc2c0a4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49160/0 (socket says 172.21.15.170:49160) 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2a59c700 1 -- 172.21.15.170:0/3359150437 learned_addr learned my addr 172.21.15.170:0/3359150437 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc30d80700 -1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6790/0 conn(0x7fdc2c0a4b50 0x7fdc2c13acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc30d80700 1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6790/0 conn(0x7fdc2c0a4b50 0x7fdc2c13acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2ad9d700 -1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6791/0 conn(0x7fdc2c09e150 0x7fdc2c0a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2ad9d700 1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6791/0 conn(0x7fdc2c09e150 0x7fdc2c0a25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261430581 0 0) 0x7fdc2c07d290 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc10003230 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 903844315 0 0) 0x7fdc10003230 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdc2c07d290 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fdc14001be0 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3596104244 0 0) 0x7fdc2c07d290 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6791/0 conn(0x7fdc2c09e150 msgr2=0x7fdc2c0a25a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6791/0 conn(0x7fdc2c09e150 0x7fdc2c0a25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6790/0 conn(0x7fdc2c0a4b50 msgr2=0x7fdc2c13acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:16.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6790/0 conn(0x7fdc2c0a4b50 0x7fdc2c13acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c11feb0 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c0a2af0 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c0a4f80 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdc14004970 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fdc14004b60 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04003360 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fdc14004de0 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.916+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7fdc1404baf0 con 0x7fdc2c0a3d50 2020-01-26T15:38:16.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:16.924+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fdc14031130 con 0x7fdc2c0a3d50 2020-01-26T15:38:17.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.076+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdc040037d0 con 0x7fdc2c0a3d50 2020-01-26T15:38:17.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.076+0000 7fdc237fe700 1 -- 172.21.15.170:0/3359150437 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fdc14031ce0 con 0x7fdc2c0a3d50 2020-01-26T15:38:17.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:17.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 >> v1:172.21.15.170:6800/17396 conn(0x7fdc1003e090 legacy=0x7fdc100405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:17.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 >> v1:172.21.15.170:6790/0 conn(0x7fdc2c0a3d50 legacy=0x7fdc2c0a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:17.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 shutdown_connections 2020-01-26T15:38:17.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6790/0 conn(0x7fdc2c0a4b50 0x7fdc2c13acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:17.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 --2- 172.21.15.170:0/3359150437 >> v2:172.21.15.170:6791/0 conn(0x7fdc2c09e150 0x7fdc2c0a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:17.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 >> 172.21.15.170:0/3359150437 conn(0x7fdc2c0247b0 msgr2=0x7fdc2c122e30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:17.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 shutdown_connections 2020-01-26T15:38:17.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:17.080+0000 7fdc2b59e700 1 -- 172.21.15.170:0/3359150437 wait complete. 2020-01-26T15:38:17.089 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:20.090 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:20.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 Processor -- start 2020-01-26T15:38:20.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 -- start start 2020-01-26T15:38:20.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2b2005edd0 0x7f2b2005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2b20149040 0x7f2b2014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b20098000 con 0x7f2b200a6870 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2005e050 con 0x7f2b2005edd0 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1ffff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2b200a6ca0 con 0x7f2b20149040 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b259c5700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2b20149040 0x7f2b2014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1f7fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2b2005edd0 0x7f2b2005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b259c5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2b20149040 0x7f2b2014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b1f7fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2b2005edd0 0x7f2b2005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b17fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2b200a6870 0x7f2b2007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52292/0 (socket says 172.21.15.170:52292) 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.212+0000 7f2b17fff700 1 -- 172.21.15.170:0/3101318233 learned_addr learned my addr 172.21.15.170:0/3101318233 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082207211 0 0) 0x7f2b20098000 con 0x7f2b200a6870 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b00003230 con 0x7f2b200a6870 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1073452547 0 0) 0x7f2b00003230 con 0x7f2b200a6870 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 >> v2:172.21.15.170:6791/0 conn(0x7f2b20149040 msgr2=0x7f2b2014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 --2- 172.21.15.170:0/3101318233 >> v2:172.21.15.170:6791/0 conn(0x7f2b20149040 0x7f2b2014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 >> v2:172.21.15.170:6790/0 conn(0x7f2b2005edd0 msgr2=0x7f2b2005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 --2- 172.21.15.170:0/3101318233 >> v2:172.21.15.170:6790/0 conn(0x7f2b2005edd0 0x7f2b2005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2014c9e0 con 0x7f2b200a6870 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2b08001710 con 0x7f2b200a6870 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 >> v1:172.21.15.170:6789/0 conn(0x7f2b200a6870 legacy=0x7f2b2007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 --2- 172.21.15.170:0/3101318233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0000b5a0 0x7f2b0000dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2b00003230 con 0x7f2b000077d0 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2b20098000 con 0x7f2b00003860 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2005e050 con 0x7f2b0000b5a0 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b259c5700 1 --2- 172.21.15.170:0/3101318233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0000b5a0 0x7f2b0000dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472812753 0 0) 0x7f2b00003230 con 0x7f2b000077d0 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b0000f300 con 0x7f2b000077d0 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408566755 0 0) 0x7f2b20098000 con 0x7f2b00003860 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b00003230 con 0x7f2b00003860 2020-01-26T15:38:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4007470679 0 0) 0x7f2b0000f300 con 0x7f2b000077d0 2020-01-26T15:38:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0000b5a0 msgr2=0x7f2b0000dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-26T15:38:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 --2- 172.21.15.170:0/3101318233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0000b5a0 0x7f2b0000dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 >> v1:172.21.15.170:6791/0 conn(0x7f2b00003860 legacy=0x7f2b00003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00054460 con 0x7f2b000077d0 2020-01-26T15:38:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2b08004760 con 0x7f2b000077d0 2020-01-26T15:38:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b259c5700 1 --2- 172.21.15.170:0/3101318233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0000b5a0 0x7f2b0000dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-26T15:38:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b259c5700 1 -- 172.21.15.170:0/3101318233 reap_dead start 2020-01-26T15:38:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2b08004a30 con 0x7f2b000077d0 2020-01-26T15:38:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1effd700 1 -- 172.21.15.170:0/3101318233 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2b08004e50 con 0x7f2b000077d0 2020-01-26T15:38:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1ffff700 1 -- 172.21.15.170:0/3101318233 >> v1:172.21.15.170:6790/0 conn(0x7f2b000077d0 legacy=0x7f2b00009ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1ffff700 1 -- 172.21.15.170:0/3101318233 shutdown_connections 2020-01-26T15:38:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1ffff700 1 -- 172.21.15.170:0/3101318233 >> 172.21.15.170:0/3101318233 conn(0x7f2b20098e70 msgr2=0x7f2b200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1ffff700 1 -- 172.21.15.170:0/3101318233 shutdown_connections 2020-01-26T15:38:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.216+0000 7f2b1ffff700 1 -- 172.21.15.170:0/3101318233 wait complete. 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 Processor -- start 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 -- start start 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2b201226f0 0x7f2b20133340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2b20133890 0x7f2b20133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b20122b20 con 0x7f2b20072b10 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2b201237c0 con 0x7f2b201226f0 2020-01-26T15:38:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1ffff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2012fd80 con 0x7f2b20133890 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b17fff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2b201226f0 0x7f2b20133340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b259c5700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2b20133890 0x7f2b20133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b17fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2b201226f0 0x7f2b20133340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b259c5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2b20133890 0x7f2b20133cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1f7fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2b20072b10 0x7f2b20122e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52304/0 (socket says 172.21.15.170:52304) 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1f7fe700 1 -- 172.21.15.170:0/2928389425 learned_addr learned my addr 172.21.15.170:0/2928389425 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056421269 0 0) 0x7f2b20122b20 con 0x7f2b20072b10 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af8003230 con 0x7f2b20072b10 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1498673348 0 0) 0x7f2af8003230 con 0x7f2b20072b10 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b20122b20 con 0x7f2b20072b10 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2b10001760 con 0x7f2b20072b10 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 >> v2:172.21.15.170:6791/0 conn(0x7f2b20133890 msgr2=0x7f2b20133cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 --2- 172.21.15.170:0/2928389425 >> v2:172.21.15.170:6791/0 conn(0x7f2b20133890 0x7f2b20133cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 >> v2:172.21.15.170:6790/0 conn(0x7f2b201226f0 msgr2=0x7f2b20133340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 --2- 172.21.15.170:0/2928389425 >> v2:172.21.15.170:6790/0 conn(0x7f2b201226f0 0x7f2b20133340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 >> v1:172.21.15.170:6789/0 conn(0x7f2b20072b10 legacy=0x7f2b20122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2af8003230 con 0x7f2af8003f40 2020-01-26T15:38:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2af800f320 con 0x7f2af8003a20 2020-01-26T15:38:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b201237c0 con 0x7f2af800b800 2020-01-26T15:38:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647301596 0 0) 0x7f2af800f320 con 0x7f2af8003a20 2020-01-26T15:38:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af800f550 con 0x7f2af8003a20 2020-01-26T15:38:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482557942 0 0) 0x7f2af8003230 con 0x7f2af8003f40 2020-01-26T15:38:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af800f320 con 0x7f2af8003f40 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.220+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2964803450 0 0) 0x7f2af800f550 con 0x7f2af8003a20 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2af8003230 con 0x7f2af8003a20 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2b10002370 con 0x7f2af8003a20 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 -- 172.21.15.170:0/2928389425 >> v1:172.21.15.170:6791/0 conn(0x7f2af8003a20 legacy=0x7f2af80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 -- 172.21.15.170:0/2928389425 >> v1:172.21.15.170:6790/0 conn(0x7f2af8003f40 legacy=0x7f2af8004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 -- 172.21.15.170:0/2928389425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2009e150 con 0x7f2af800b800 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2013a9c0 con 0x7f2af800b800 2020-01-26T15:38:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2013aec0 con 0x7f2af800b800 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 -- 172.21.15.170:0/2928389425 reap_dead start 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2b180124b0 con 0x7f2af800b800 2020-01-26T15:38:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b180126b0 con 0x7f2af800b800 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2b18012a50 con 0x7f2af800b800 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc003360 con 0x7f2af800b800 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f2b18012c50 con 0x7f2af800b800 2020-01-26T15:38:20.236 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.224+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f2b18001be0 con 0x7f2af800b800 2020-01-26T15:38:20.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.228+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.237 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.228+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f2b180337b0 con 0x7f2af800b800 2020-01-26T15:38:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.380+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2afc003790 con 0x7f2af800b800 2020-01-26T15:38:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b259c5700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1cff9700 1 -- 172.21.15.170:0/2928389425 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2b18033a10 con 0x7f2af800b800 2020-01-26T15:38:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 >> v1:172.21.15.170:6800/17396 conn(0x7f2af8040be0 legacy=0x7f2af80430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 msgr2=0x7f2af800dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f2b08001520 tx=0x7f2b18010e30).stop 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 shutdown_connections 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 --2- 172.21.15.170:0/2928389425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af800b800 0x7f2af800dc60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 >> 172.21.15.170:0/2928389425 conn(0x7f2b2005c140 msgr2=0x7f2b2007f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 shutdown_connections 2020-01-26T15:38:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:20.384+0000 7f2b1ffff700 1 -- 172.21.15.170:0/2928389425 wait complete. 2020-01-26T15:38:20.394 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:23.395 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:23.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.512+0000 7f1f98c11700 1 Processor -- start 2020-01-26T15:38:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.512+0000 7f1f98c11700 1 -- start start 2020-01-26T15:38:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.512+0000 7f1f98c11700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1f9405e5f0 0x7f1f940a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.512+0000 7f1f98c11700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1f94149040 0x7f1f9414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.512+0000 7f1f98c11700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f940a6dc0 con 0x7f1f9405edd0 2020-01-26T15:38:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9405ea20 con 0x7f1f94149040 2020-01-26T15:38:23.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1f94098000 con 0x7f1f9405e5f0 2020-01-26T15:38:23.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f937fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1f9405e5f0 0x7f1f940a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:23.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f93fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1f9405edd0 0x7f1f9407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52318/0 (socket says 172.21.15.170:52318) 2020-01-26T15:38:23.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f93fff700 1 -- 172.21.15.170:0/3791340454 learned_addr learned my addr 172.21.15.170:0/3791340454 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:23.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f99e73700 -1 --2- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6790/0 conn(0x7f1f94149040 0x7f1f9414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f937fe700 1 --2- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6791/0 conn(0x7f1f9405e5f0 0x7f1f940a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f99e73700 1 --2- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6790/0 conn(0x7f1f94149040 0x7f1f9414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506813362 0 0) 0x7f1f940a6dc0 con 0x7f1f9405edd0 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f7c003230 con 0x7f1f9405edd0 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2247005956 0 0) 0x7f1f7c003230 con 0x7f1f9405edd0 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6791/0 conn(0x7f1f9405e5f0 msgr2=0x7f1f940a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 --2- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6791/0 conn(0x7f1f9405e5f0 0x7f1f940a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:23.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6790/0 conn(0x7f1f94149040 msgr2=0x7f1f9414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 --2- 172.21.15.170:0/3791340454 >> v2:172.21.15.170:6790/0 conn(0x7f1f94149040 0x7f1f9414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9405e050 con 0x7f1f9405edd0 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f84001a90 con 0x7f1f9405edd0 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 >> v1:172.21.15.170:6789/0 conn(0x7f1f9405edd0 legacy=0x7f1f9407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 --2- 172.21.15.170:0/3791340454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f7c003860 0x7f1f7c003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1f7c003230 con 0x7f1f7c00a7f0 2020-01-26T15:38:23.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1f940a6dc0 con 0x7f1f7c0045a0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9405ea20 con 0x7f1f7c003860 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342527176 0 0) 0x7f1f940a6dc0 con 0x7f1f7c0045a0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f7c00e520 con 0x7f1f7c0045a0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521558997 0 0) 0x7f1f7c003230 con 0x7f1f7c00a7f0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f940a6dc0 con 0x7f1f7c00a7f0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f93fff700 1 --2- 172.21.15.170:0/3791340454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f7c003860 0x7f1f7c003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1019601565 0 0) 0x7f1f7c00e520 con 0x7f1f7c0045a0 2020-01-26T15:38:23.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f7c003860 msgr2=0x7f1f7c003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 --2- 172.21.15.170:0/3791340454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f7c003860 0x7f1f7c003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 >> v1:172.21.15.170:6790/0 conn(0x7f1f7c00a7f0 legacy=0x7f1f7c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f99e73700 1 -- 172.21.15.170:0/3791340454 reap_dead start 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c054470 con 0x7f1f7c0045a0 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f88001370 con 0x7f1f7c0045a0 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f93fff700 1 --2- 172.21.15.170:0/3791340454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f7c003860 0x7f1f7c003cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-26T15:38:23.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1f88001640 con 0x7f1f7c0045a0 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f92ffd700 1 -- 172.21.15.170:0/3791340454 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f88001a60 con 0x7f1f7c0045a0 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- 172.21.15.170:0/3791340454 >> v1:172.21.15.170:6791/0 conn(0x7f1f7c0045a0 legacy=0x7f1f7c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- 172.21.15.170:0/3791340454 shutdown_connections 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- 172.21.15.170:0/3791340454 >> 172.21.15.170:0/3791340454 conn(0x7f1f94098e70 msgr2=0x7f1f940a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- 172.21.15.170:0/3791340454 shutdown_connections 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.516+0000 7f1f98c11700 1 -- 172.21.15.170:0/3791340454 wait complete. 2020-01-26T15:38:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f98c11700 1 Processor -- start 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f98c11700 1 -- start start 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f98c11700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f940a16f0 con 0x7f1f9409fa00 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f98c11700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9409fe30 con 0x7f1f9409e200 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f98c11700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f94120ec0 con 0x7f1f940a12c0 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f99e73700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1f9409fa00 0x7f1f94139c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52328/0 (socket says 172.21.15.170:52328) 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f99e73700 1 -- 172.21.15.170:0/2065135638 learned_addr learned my addr 172.21.15.170:0/2065135638 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044561913 0 0) 0x7f1f9409fe30 con 0x7f1f9409e200 2020-01-26T15:38:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f74003230 con 0x7f1f9409e200 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951234661 0 0) 0x7f1f940a16f0 con 0x7f1f9409fa00 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f9409fe30 con 0x7f1f9409fa00 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293347084 0 0) 0x7f1f94120ec0 con 0x7f1f940a12c0 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f940a16f0 con 0x7f1f940a12c0 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3691335170 0 0) 0x7f1f74003230 con 0x7f1f9409e200 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f94120ec0 con 0x7f1f9409e200 2020-01-26T15:38:23.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f84001a90 con 0x7f1f9409e200 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1725466059 0 0) 0x7f1f940a16f0 con 0x7f1f940a12c0 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f74003230 con 0x7f1f940a12c0 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f880017f0 con 0x7f1f940a12c0 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3213711573 0 0) 0x7f1f9409fe30 con 0x7f1f9409fa00 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f940a16f0 con 0x7f1f9409fa00 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f8c001550 con 0x7f1f9409fa00 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 >> v1:172.21.15.170:6791/0 conn(0x7f1f940a12c0 legacy=0x7f1f94131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 >> v1:172.21.15.170:6790/0 conn(0x7f1f9409e200 legacy=0x7f1f94131660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 >> v1:172.21.15.170:6789/0 conn(0x7f1f9409fa00 legacy=0x7f1f94139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1f9409fe30 con 0x7f1f74003540 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1f740141e0 con 0x7f1f740087e0 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74015420 con 0x7f1f74010840 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776991155 0 0) 0x7f1f9409fe30 con 0x7f1f74003540 2020-01-26T15:38:23.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f740131d0 con 0x7f1f74003540 2020-01-26T15:38:23.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904745156 0 0) 0x7f1f740141e0 con 0x7f1f740087e0 2020-01-26T15:38:23.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f9409fe30 con 0x7f1f740087e0 2020-01-26T15:38:23.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1749157606 0 0) 0x7f1f740131d0 con 0x7f1f74003540 2020-01-26T15:38:23.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f740141e0 con 0x7f1f74003540 2020-01-26T15:38:23.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1f84005240 con 0x7f1f74003540 2020-01-26T15:38:23.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.520+0000 7f1f99e73700 1 -- 172.21.15.170:0/2065135638 >> v1:172.21.15.170:6791/0 conn(0x7f1f740087e0 legacy=0x7f1f7400ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 -- 172.21.15.170:0/2065135638 >> v1:172.21.15.170:6790/0 conn(0x7f1f74003540 legacy=0x7f1f74003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 -- 172.21.15.170:0/2065135638 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f1f940a04e0 con 0x7f1f74010840 2020-01-26T15:38:23.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f940a12c0 con 0x7f1f74010840 2020-01-26T15:38:23.550 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9409e200 con 0x7f1f74010840 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1f8c0104d0 con 0x7f1f74010840 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.551 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00c740 con 0x7f1f74010840 2020-01-26T15:38:23.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1f8c00c930 con 0x7f1f74010840 2020-01-26T15:38:23.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c003360 con 0x7f1f74010840 2020-01-26T15:38:23.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.524+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f1f8c04cbd0 con 0x7f1f74010840 2020-01-26T15:38:23.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.528+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.528+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f1f8c032d80 con 0x7f1f74010840 2020-01-26T15:38:23.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1f6c003790 con 0x7f1f74010840 2020-01-26T15:38:23.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f99e73700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:23.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f90ff9700 1 -- 172.21.15.170:0/2065135638 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1f8c032fe0 con 0x7f1f74010840 2020-01-26T15:38:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:23.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 >> v1:172.21.15.170:6800/17396 conn(0x7f1f7404d320 legacy=0x7f1f7404f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 msgr2=0x7f1f74012c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:23.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f98c11700 1 --2- 172.21.15.170:0/2065135638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f74010840 0x7f1f74012c80 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f1f8c000e00 tx=0x7f1f84001d10).stop 2020-01-26T15:38:23.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.680+0000 7f1f99e73700 1 -- 172.21.15.170:0/2065135638 reap_dead start 2020-01-26T15:38:23.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.684+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 shutdown_connections 2020-01-26T15:38:23.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.684+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 >> 172.21.15.170:0/2065135638 conn(0x7f1f94097a00 msgr2=0x7f1f940a4710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:23.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.684+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 shutdown_connections 2020-01-26T15:38:23.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:23.684+0000 7f1f98c11700 1 -- 172.21.15.170:0/2065135638 wait complete. 2020-01-26T15:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:26.694 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:26.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 Processor -- start 2020-01-26T15:38:26.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 -- start start 2020-01-26T15:38:26.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f295c0a5750 0x7f295c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:26.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f295c0a4b50 0x7f295c05ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:26.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c0a5b80 con 0x7f295c05efa0 2020-01-26T15:38:26.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f295c0a43f0 con 0x7f295c0a5750 2020-01-26T15:38:26.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f295c0a4f80 con 0x7f295c0a4b50 2020-01-26T15:38:26.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f2960f8b700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f295c05efa0 0x7f295c14ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44348/0 (socket says 172.21.15.170:44348) 2020-01-26T15:38:26.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f2960f8b700 1 -- 172.21.15.170:0/3599950605 learned_addr learned my addr 172.21.15.170:0/3599950605 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:26.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295b7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f295c0a4b50 0x7f295c05ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:26.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295bfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f295c0a5750 0x7f295c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:26.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295b7fe700 1 --2- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6791/0 conn(0x7f295c0a4b50 0x7f295c05ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:26.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295bfff700 1 --2- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6790/0 conn(0x7f295c0a5750 0x7f295c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:26.813 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715386416 0 0) 0x7f295c0a5b80 con 0x7f295c05efa0 2020-01-26T15:38:26.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2944003230 con 0x7f295c05efa0 2020-01-26T15:38:26.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3480816475 0 0) 0x7f2944003230 con 0x7f295c05efa0 2020-01-26T15:38:26.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6791/0 conn(0x7f295c0a4b50 msgr2=0x7f295c05ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:26.814 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 --2- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6791/0 conn(0x7f295c0a4b50 0x7f295c05ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:26.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6790/0 conn(0x7f295c0a5750 msgr2=0x7f295c0a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:26.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 --2- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6790/0 conn(0x7f295c0a5750 0x7f295c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:26.815 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c080440 con 0x7f295c05efa0 2020-01-26T15:38:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2954001a90 con 0x7f295c05efa0 2020-01-26T15:38:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2954001e20 con 0x7f295c05efa0 2020-01-26T15:38:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f295affd700 1 -- 172.21.15.170:0/3599950605 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2954004ae0 con 0x7f295c05efa0 2020-01-26T15:38:26.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.808+0000 7f29621ed700 1 -- 172.21.15.170:0/3599950605 >> v1:172.21.15.170:6791/0 conn(0x7f295c05efa0 legacy=0x7f295c14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- 172.21.15.170:0/3599950605 shutdown_connections 2020-01-26T15:38:26.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 --2- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6790/0 conn(0x7f295c0a5750 0x7f295c0a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:26.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 --2- 172.21.15.170:0/3599950605 >> v2:172.21.15.170:6791/0 conn(0x7f295c0a4b50 0x7f295c05ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:26.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- 172.21.15.170:0/3599950605 >> 172.21.15.170:0/3599950605 conn(0x7f295c05e050 msgr2=0x7f295c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:26.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- 172.21.15.170:0/3599950605 shutdown_connections 2020-01-26T15:38:26.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- 172.21.15.170:0/3599950605 wait complete. 2020-01-26T15:38:26.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 Processor -- start 2020-01-26T15:38:26.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- start start 2020-01-26T15:38:26.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f295c060560 0x7f295c07bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:26.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c0a2c30 con 0x7f295c0a1cb0 2020-01-26T15:38:26.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c060220 con 0x7f295c07c4b0 2020-01-26T15:38:26.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f29621ed700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f295c060990 con 0x7f295c060560 2020-01-26T15:38:26.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f2960f8b700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f295c07c4b0 0x7f295c138290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44354/0 (socket says 172.21.15.170:44354) 2020-01-26T15:38:26.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f295bfff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f295c0a1cb0 0x7f295c061340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52348/0 (socket says 172.21.15.170:52348) 2020-01-26T15:38:26.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f2960f8b700 1 -- 172.21.15.170:0/1096105361 learned_addr learned my addr 172.21.15.170:0/1096105361 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:26.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f295b7fe700 -1 --2- 172.21.15.170:0/1096105361 >> v2:172.21.15.170:6790/0 conn(0x7f295c060560 0x7f295c07bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:26.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> v2:172.21.15.170:6790/0 conn(0x7f295c060560 0x7f295c07bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:26.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592617815 0 0) 0x7f295c0a2c30 con 0x7f295c0a1cb0 2020-01-26T15:38:26.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c003230 con 0x7f295c0a1cb0 2020-01-26T15:38:26.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585579391 0 0) 0x7f295c060220 con 0x7f295c07c4b0 2020-01-26T15:38:26.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.812+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f295c0a2c30 con 0x7f295c07c4b0 2020-01-26T15:38:26.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3510280170 0 0) 0x7f293c003230 con 0x7f295c0a1cb0 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f295c060220 con 0x7f295c0a1cb0 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f294c001590 con 0x7f295c0a1cb0 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 >> v2:172.21.15.170:6790/0 conn(0x7f295c060560 msgr2=0x7f295c07bf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 --2- 172.21.15.170:0/1096105361 >> v2:172.21.15.170:6790/0 conn(0x7f295c060560 0x7f295c07bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 >> v1:172.21.15.170:6791/0 conn(0x7f295c07c4b0 legacy=0x7f295c138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 >> v1:172.21.15.170:6789/0 conn(0x7f295c0a1cb0 legacy=0x7f295c061340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.840 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f293c003230 con 0x7f293c00a7f0 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f293c00f4b0 con 0x7f293c004c90 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c010740 con 0x7f293c005120 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083955813 0 0) 0x7f293c003230 con 0x7f293c00a7f0 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c00f6e0 con 0x7f293c00a7f0 2020-01-26T15:38:26.841 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580978807 0 0) 0x7f293c00f4b0 con 0x7f293c004c90 2020-01-26T15:38:26.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c003230 con 0x7f293c004c90 2020-01-26T15:38:26.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 -- 172.21.15.170:0/1096105361 >> v1:172.21.15.170:6791/0 conn(0x7f293c004c90 legacy=0x7f293c003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 -- 172.21.15.170:0/1096105361 >> v1:172.21.15.170:6790/0 conn(0x7f293c00a7f0 legacy=0x7f293c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 -- 172.21.15.170:0/1096105361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c07c8e0 con 0x7f293c005120 2020-01-26T15:38:26.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c05f610 con 0x7f293c005120 2020-01-26T15:38:26.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c07c4b0 con 0x7f293c005120 2020-01-26T15:38:26.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:26.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2950005c30 con 0x7f293c005120 2020-01-26T15:38:26.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2950008900 con 0x7f293c005120 2020-01-26T15:38:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2950008ce0 con 0x7f293c005120 2020-01-26T15:38:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2934003360 con 0x7f293c005120 2020-01-26T15:38:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f29500121a0 con 0x7f293c005120 2020-01-26T15:38:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.816+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f295004cfa0 con 0x7f293c005120 2020-01-26T15:38:26.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.824+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.824+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f29500330d0 con 0x7f293c005120 2020-01-26T15:38:26.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.984+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2934003790 con 0x7f293c005120 2020-01-26T15:38:26.988 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.984+0000 7f295b7fe700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.984+0000 7f2958ff9700 1 -- 172.21.15.170:0/1096105361 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2950033330 con 0x7f293c005120 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 >> v1:172.21.15.170:6800/17396 conn(0x7f293c048800 legacy=0x7f293c04ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 msgr2=0x7f293c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 --2- 172.21.15.170:0/1096105361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293c005120 0x7f293c003d80 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f2950002f30 tx=0x7f2950010ab0).stop 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f2960f8b700 1 -- 172.21.15.170:0/1096105361 reap_dead start 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 shutdown_connections 2020-01-26T15:38:26.989 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 >> 172.21.15.170:0/1096105361 conn(0x7f295c05b390 msgr2=0x7f295c1226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:26.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 shutdown_connections 2020-01-26T15:38:26.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:26.988+0000 7f29621ed700 1 -- 172.21.15.170:0/1096105361 wait complete. 2020-01-26T15:38:26.990 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:26.998 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:29.999 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:30.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24ac328700 1 Processor -- start 2020-01-26T15:38:30.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24ac328700 1 -- start start 2020-01-26T15:38:30.118 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24ac328700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f24a4097100 0x7f24a4149040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:30.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24ac328700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a405f5a0 con 0x7f24a4149590 2020-01-26T15:38:30.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24ac328700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40a66f0 con 0x7f24a40a62c0 2020-01-26T15:38:30.119 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24ac328700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f24a4080730 con 0x7f24a4097100 2020-01-26T15:38:30.120 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24aa8c5700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f24a40a62c0 0x7f24a407ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49238/0 (socket says 172.21.15.170:49238) 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24aa8c5700 1 -- 172.21.15.170:0/2425204806 learned_addr learned my addr 172.21.15.170:0/2425204806 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24aa0c4700 -1 --2- 172.21.15.170:0/2425204806 >> v2:172.21.15.170:6790/0 conn(0x7f24a4097100 0x7f24a4149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24aa0c4700 1 --2- 172.21.15.170:0/2425204806 >> v2:172.21.15.170:6790/0 conn(0x7f24a4097100 0x7f24a4149040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529946061 0 0) 0x7f24a40a66f0 con 0x7f24a40a62c0 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c003230 con 0x7f24a40a62c0 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144315122 0 0) 0x7f24a405f5a0 con 0x7f24a4149590 2020-01-26T15:38:30.121 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a40a66f0 con 0x7f24a4149590 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3032580519 0 0) 0x7f248c003230 con 0x7f24a40a62c0 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 >> v2:172.21.15.170:6790/0 conn(0x7f24a4097100 msgr2=0x7f24a4149040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 --2- 172.21.15.170:0/2425204806 >> v2:172.21.15.170:6790/0 conn(0x7f24a4097100 0x7f24a4149040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 >> v1:172.21.15.170:6789/0 conn(0x7f24a4149590 legacy=0x7f24a414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.116+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a405e0e0 con 0x7f24a40a62c0 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f249c001a90 con 0x7f24a40a62c0 2020-01-26T15:38:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f249c001d60 con 0x7f24a40a62c0 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a98c3700 1 -- 172.21.15.170:0/2425204806 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f249c004930 con 0x7f24a40a62c0 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- 172.21.15.170:0/2425204806 >> v1:172.21.15.170:6790/0 conn(0x7f24a40a62c0 legacy=0x7f24a407ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- 172.21.15.170:0/2425204806 shutdown_connections 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 --2- 172.21.15.170:0/2425204806 >> v2:172.21.15.170:6790/0 conn(0x7f24a4097100 0x7f24a4149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- 172.21.15.170:0/2425204806 >> 172.21.15.170:0/2425204806 conn(0x7f24a4098e70 msgr2=0x7f24a40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- 172.21.15.170:0/2425204806 shutdown_connections 2020-01-26T15:38:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- 172.21.15.170:0/2425204806 wait complete. 2020-01-26T15:38:30.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 Processor -- start 2020-01-26T15:38:30.128 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- start start 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f24a4063b70 0x7f24a41236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a4063010 con 0x7f24a407d9f0 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40a5000 con 0x7f24a40a4190 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24ac328700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40a4af0 con 0x7f24a4063b70 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24aa8c5700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f24a4063b70 0x7f24a41236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24aa0c4700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f24a407d9f0 0x7f24a407de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52370/0 (socket says 172.21.15.170:52370) 2020-01-26T15:38:30.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24aa0c4700 1 -- 172.21.15.170:0/695061917 learned_addr learned my addr 172.21.15.170:0/695061917 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24aa8c5700 1 --2- 172.21.15.170:0/695061917 >> v2:172.21.15.170:6790/0 conn(0x7f24a4063b70 0x7f24a41236e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020124148 0 0) 0x7f24a40a5000 con 0x7f24a40a4190 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2484003230 con 0x7f24a40a4190 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139427968 0 0) 0x7f24a4063010 con 0x7f24a407d9f0 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a40a5000 con 0x7f24a407d9f0 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3567367604 0 0) 0x7f2484003230 con 0x7f24a40a4190 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24a4063010 con 0x7f24a40a4190 2020-01-26T15:38:30.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.120+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2494001850 con 0x7f24a40a4190 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1833436973 0 0) 0x7f24a4063010 con 0x7f24a40a4190 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 >> v2:172.21.15.170:6790/0 conn(0x7f24a4063b70 msgr2=0x7f24a41236e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 --2- 172.21.15.170:0/695061917 >> v2:172.21.15.170:6790/0 conn(0x7f24a4063b70 0x7f24a41236e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 >> v1:172.21.15.170:6789/0 conn(0x7f24a407d9f0 legacy=0x7f24a407de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4123c30 con 0x7f24a40a4190 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a4065b80 con 0x7f24a40a4190 2020-01-26T15:38:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40a45c0 con 0x7f24a40a4190 2020-01-26T15:38:30.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2494001bd0 con 0x7f24a40a4190 2020-01-26T15:38:30.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2494001ff0 con 0x7f24a40a4190 2020-01-26T15:38:30.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2480003360 con 0x7f24a40a4190 2020-01-26T15:38:30.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f2494002210 con 0x7f24a40a4190 2020-01-26T15:38:30.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.124+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f2494049290 con 0x7f24a40a4190 2020-01-26T15:38:30.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.128+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f24a4123c30 con 0x7f24a40a4190 2020-01-26T15:38:30.284 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.284+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f24800037d0 con 0x7f24a40a4190 2020-01-26T15:38:30.285 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24a37fe700 1 -- 172.21.15.170:0/695061917 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f249402e7d0 con 0x7f24a40a4190 2020-01-26T15:38:30.285 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 >> v1:172.21.15.170:6800/17396 conn(0x7f248403e140 legacy=0x7f2484040650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 >> v1:172.21.15.170:6790/0 conn(0x7f24a40a4190 legacy=0x7f24a4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 shutdown_connections 2020-01-26T15:38:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 --2- 172.21.15.170:0/695061917 >> v2:172.21.15.170:6790/0 conn(0x7f24a4063b70 0x7f24a41236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 >> 172.21.15.170:0/695061917 conn(0x7f24a40972b0 msgr2=0x7f24a407f040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 shutdown_connections 2020-01-26T15:38:30.288 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:30.288+0000 7f24ac328700 1 -- 172.21.15.170:0/695061917 wait complete. 2020-01-26T15:38:30.306 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:33.307 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 Processor -- start 2020-01-26T15:38:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- start start 2020-01-26T15:38:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f371805e5f0 0x7f37180a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37180a6dc0 con 0x7f3718149040 2020-01-26T15:38:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371805ea20 con 0x7f371805edd0 2020-01-26T15:38:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3718098000 con 0x7f371805e5f0 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371759e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f371805edd0 0x7f371807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49252/0 (socket says 172.21.15.170:49252) 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371759e700 1 -- 172.21.15.170:0/3402193451 learned_addr learned my addr 172.21.15.170:0/3402193451 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f3716d9d700 -1 --2- 172.21.15.170:0/3402193451 >> v2:172.21.15.170:6790/0 conn(0x7f371805e5f0 0x7f37180a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3402193451 >> v2:172.21.15.170:6790/0 conn(0x7f371805e5f0 0x7f37180a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529603251 0 0) 0x7f371805ea20 con 0x7f371805edd0 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc003230 con 0x7f371805edd0 2020-01-26T15:38:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812953458 0 0) 0x7f37180a6dc0 con 0x7f3718149040 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371805ea20 con 0x7f3718149040 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2583694047 0 0) 0x7f36fc003230 con 0x7f371805edd0 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 >> v2:172.21.15.170:6790/0 conn(0x7f371805e5f0 msgr2=0x7f37180a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 --2- 172.21.15.170:0/3402193451 >> v2:172.21.15.170:6790/0 conn(0x7f371805e5f0 0x7f37180a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 >> v1:172.21.15.170:6789/0 conn(0x7f3718149040 legacy=0x7f371814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371805e050 con 0x7f371805edd0 2020-01-26T15:38:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3708001710 con 0x7f371805edd0 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3708001960 con 0x7f371805edd0 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371659c700 1 -- 172.21.15.170:0/3402193451 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f37080045b0 con 0x7f371805edd0 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- 172.21.15.170:0/3402193451 >> v1:172.21.15.170:6790/0 conn(0x7f371805edd0 legacy=0x7f371807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- 172.21.15.170:0/3402193451 shutdown_connections 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 --2- 172.21.15.170:0/3402193451 >> v2:172.21.15.170:6790/0 conn(0x7f371805e5f0 0x7f37180a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- 172.21.15.170:0/3402193451 >> 172.21.15.170:0/3402193451 conn(0x7f3718098e70 msgr2=0x7f37180a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- 172.21.15.170:0/3402193451 shutdown_connections 2020-01-26T15:38:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.428+0000 7f371c8e6700 1 -- 172.21.15.170:0/3402193451 wait complete. 2020-01-26T15:38:33.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 Processor -- start 2020-01-26T15:38:33.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 -- start start 2020-01-26T15:38:33.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f3718122740 0x7f371809e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:33.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f37180a1820 0x7f37180a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:33.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371807b570 con 0x7f3718131190 2020-01-26T15:38:33.439 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f37180a0a50 con 0x7f37180a1820 2020-01-26T15:38:33.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371c8e6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f371807b7a0 con 0x7f3718122740 2020-01-26T15:38:33.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371d0e7700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3718131190 0x7f371807ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52386/0 (socket says 172.21.15.170:52386) 2020-01-26T15:38:33.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371d0e7700 1 -- 172.21.15.170:0/3104984386 learned_addr learned my addr 172.21.15.170:0/3104984386 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:33.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371759e700 -1 --2- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6791/0 conn(0x7f3718122740 0x7f371809e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:33.440 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f3716d9d700 -1 --2- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6790/0 conn(0x7f37180a1820 0x7f37180a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:33.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f371759e700 1 --2- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6791/0 conn(0x7f3718122740 0x7f371809e0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:33.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.432+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6790/0 conn(0x7f37180a1820 0x7f37180a1180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:33.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626999528 0 0) 0x7f371807b570 con 0x7f3718131190 2020-01-26T15:38:33.441 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f4003230 con 0x7f3718131190 2020-01-26T15:38:33.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 668627894 0 0) 0x7f36f4003230 con 0x7f3718131190 2020-01-26T15:38:33.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f371807b570 con 0x7f3718131190 2020-01-26T15:38:33.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3710001dd0 con 0x7f3718131190 2020-01-26T15:38:33.442 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6791/0 conn(0x7f3718122740 msgr2=0x7f371809e0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:33.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 --2- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6791/0 conn(0x7f3718122740 0x7f371809e0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:33.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6790/0 conn(0x7f37180a1820 msgr2=0x7f37180a1180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:33.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 --2- 172.21.15.170:0/3104984386 >> v2:172.21.15.170:6790/0 conn(0x7f37180a1820 0x7f37180a1180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:33.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 >> v1:172.21.15.170:6789/0 conn(0x7f3718131190 legacy=0x7f371807ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.443 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:33.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f36f4003230 con 0x7f36f4003a20 2020-01-26T15:38:33.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f36f400f450 con 0x7f36f400a7f0 2020-01-26T15:38:33.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180a0a50 con 0x7f36f4003eb0 2020-01-26T15:38:33.444 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:33.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937378248 0 0) 0x7f36f4003230 con 0x7f36f4003a20 2020-01-26T15:38:33.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f400e440 con 0x7f36f4003a20 2020-01-26T15:38:33.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 -- 172.21.15.170:0/3104984386 >> v1:172.21.15.170:6791/0 conn(0x7f36f400a7f0 legacy=0x7f36f400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.445 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 -- 172.21.15.170:0/3104984386 >> v1:172.21.15.170:6790/0 conn(0x7f36f4003a20 legacy=0x7f36f40045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2706156196 0 0) 0x7f36f400e440 con 0x7f36f4003a20 2020-01-26T15:38:33.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f371d0e7700 1 -- 172.21.15.170:0/3104984386 reap_dead start 2020-01-26T15:38:33.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 -- 172.21.15.170:0/3104984386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37181315c0 con 0x7f36f4003eb0 2020-01-26T15:38:33.446 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3718122740 con 0x7f36f4003eb0 2020-01-26T15:38:33.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3718131330 con 0x7f36f4003eb0 2020-01-26T15:38:33.447 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:33.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3708001960 con 0x7f36f4003eb0 2020-01-26T15:38:33.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.448 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704005760 con 0x7f36f4003eb0 2020-01-26T15:38:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3704005b00 con 0x7f36f4003eb0 2020-01-26T15:38:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8003360 con 0x7f36f4003eb0 2020-01-26T15:38:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.436+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.440+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f37040112c0 con 0x7f36f4003eb0 2020-01-26T15:38:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.440+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.440+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f370404cb00 con 0x7f36f4003eb0 2020-01-26T15:38:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.448+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.448+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f3704032bf0 con 0x7f36f4003eb0 2020-01-26T15:38:33.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.604+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f36f8003790 con 0x7f36f4003eb0 2020-01-26T15:38:33.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.604+0000 7f3716d9d700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:33.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.604+0000 7f370ffff700 1 -- 172.21.15.170:0/3104984386 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3704032e50 con 0x7f36f4003eb0 2020-01-26T15:38:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:33.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 >> v1:172.21.15.170:6800/17396 conn(0x7f36f4040a50 legacy=0x7f36f4042f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 msgr2=0x7f36f4004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:33.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f3708000ed0 tx=0x7f3708001b60).stop 2020-01-26T15:38:33.606 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 shutdown_connections 2020-01-26T15:38:33.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 --2- 172.21.15.170:0/3104984386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f4003eb0 0x7f36f4004da0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:33.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 >> 172.21.15.170:0/3104984386 conn(0x7f371805f0b0 msgr2=0x7f371807e720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:33.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 shutdown_connections 2020-01-26T15:38:33.607 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:33.608+0000 7f371c8e6700 1 -- 172.21.15.170:0/3104984386 wait complete. 2020-01-26T15:38:33.624 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:36.626 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:36.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 Processor -- start 2020-01-26T15:38:36.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 -- start start 2020-01-26T15:38:36.747 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f855805edd0 0x7f855805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f85580a6870 0x7f855807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8558098000 con 0x7f85580804d0 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f855805e050 con 0x7f85580a6870 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855e1b1700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f85580a6ca0 con 0x7f855805edd0 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855d1af700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f85580a6870 0x7f855807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855f413700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f85580804d0 0x7f85580247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49276/0 (socket says 172.21.15.170:49276) 2020-01-26T15:38:36.748 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855f413700 1 -- 172.21.15.170:0/3313678881 learned_addr learned my addr 172.21.15.170:0/3313678881 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855d1af700 1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6790/0 conn(0x7f85580a6870 0x7f855807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855d9b0700 -1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6791/0 conn(0x7f855805edd0 0x7f855805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855d9b0700 1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6791/0 conn(0x7f855805edd0 0x7f855805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607828005 0 0) 0x7f8558098000 con 0x7f85580804d0 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8544003230 con 0x7f85580804d0 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3662593687 0 0) 0x7f8544003230 con 0x7f85580804d0 2020-01-26T15:38:36.749 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6791/0 conn(0x7f855805edd0 msgr2=0x7f855805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6791/0 conn(0x7f855805edd0 0x7f855805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6790/0 conn(0x7f85580a6870 msgr2=0x7f855807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.744+0000 7f855c9ae700 1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6790/0 conn(0x7f85580a6870 0x7f855807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558024fb0 con 0x7f85580804d0 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8550001a90 con 0x7f85580804d0 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8550001e20 con 0x7f85580804d0 2020-01-26T15:38:36.750 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855c9ae700 1 -- 172.21.15.170:0/3313678881 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8550004ae0 con 0x7f85580804d0 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 -- 172.21.15.170:0/3313678881 >> v1:172.21.15.170:6790/0 conn(0x7f85580804d0 legacy=0x7f85580247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 -- 172.21.15.170:0/3313678881 shutdown_connections 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6791/0 conn(0x7f855805edd0 0x7f855805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 --2- 172.21.15.170:0/3313678881 >> v2:172.21.15.170:6790/0 conn(0x7f85580a6870 0x7f855807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 -- 172.21.15.170:0/3313678881 >> 172.21.15.170:0/3313678881 conn(0x7f8558098e70 msgr2=0x7f85580a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 -- 172.21.15.170:0/3313678881 shutdown_connections 2020-01-26T15:38:36.751 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.748+0000 7f855e1b1700 1 -- 172.21.15.170:0/3313678881 wait complete. 2020-01-26T15:38:36.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855e1b1700 1 Processor -- start 2020-01-26T15:38:36.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855e1b1700 1 -- start start 2020-01-26T15:38:36.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855e1b1700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855809c020 con 0x7f8558060e60 2020-01-26T15:38:36.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855e1b1700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8558062b20 con 0x7f855807c970 2020-01-26T15:38:36.756 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855e1b1700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8558061290 con 0x7f85580626f0 2020-01-26T15:38:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855f413700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f855807c970 0x7f8558138970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49282/0 (socket says 172.21.15.170:49282) 2020-01-26T15:38:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855d1af700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f85580626f0 0x7f855807c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44406/0 (socket says 172.21.15.170:44406) 2020-01-26T15:38:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855f413700 1 -- 172.21.15.170:0/3090652066 learned_addr learned my addr 172.21.15.170:0/3090652066 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663122123 0 0) 0x7f8558062b20 con 0x7f855807c970 2020-01-26T15:38:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540003230 con 0x7f855807c970 2020-01-26T15:38:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499766259 0 0) 0x7f8558061290 con 0x7f85580626f0 2020-01-26T15:38:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8558062b20 con 0x7f85580626f0 2020-01-26T15:38:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836221010 0 0) 0x7f855809c020 con 0x7f8558060e60 2020-01-26T15:38:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8558061290 con 0x7f8558060e60 2020-01-26T15:38:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 354984008 0 0) 0x7f8540003230 con 0x7f855807c970 2020-01-26T15:38:36.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f855809c020 con 0x7f855807c970 2020-01-26T15:38:36.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f85500017a0 con 0x7f855807c970 2020-01-26T15:38:36.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 873596039 0 0) 0x7f8558062b20 con 0x7f85580626f0 2020-01-26T15:38:36.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8540003230 con 0x7f85580626f0 2020-01-26T15:38:36.759 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1950393691 0 0) 0x7f8558061290 con 0x7f8558060e60 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8558062b20 con 0x7f8558060e60 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f85540015d0 con 0x7f85580626f0 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8548002590 con 0x7f8558060e60 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 >> v1:172.21.15.170:6791/0 conn(0x7f85580626f0 legacy=0x7f855807c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 >> v1:172.21.15.170:6790/0 conn(0x7f855807c970 legacy=0x7f8558138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 >> v1:172.21.15.170:6789/0 conn(0x7f8558060e60 legacy=0x7f8558061ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.760 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8558061290 con 0x7f854000b170 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8540004200 con 0x7f8540003540 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8540012ff0 con 0x7f85400087e0 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.752+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581282270 0 0) 0x7f8540004200 con 0x7f8540003540 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540010fd0 con 0x7f8540003540 2020-01-26T15:38:36.761 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442114404 0 0) 0x7f8558061290 con 0x7f854000b170 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 -- 172.21.15.170:0/3090652066 >> v1:172.21.15.170:6791/0 conn(0x7f8540003540 legacy=0x7f8540003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 -- 172.21.15.170:0/3090652066 >> v1:172.21.15.170:6790/0 conn(0x7f854000b170 legacy=0x7f854000d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 -- 172.21.15.170:0/3090652066 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f855809d9e0 con 0x7f85400087e0 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855809e7b0 con 0x7f85400087e0 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85580626f0 con 0x7f85400087e0 2020-01-26T15:38:36.762 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f855400edf0 con 0x7f85400087e0 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554011980 con 0x7f85400087e0 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8554011b70 con 0x7f85400087e0 2020-01-26T15:38:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8534003360 con 0x7f85400087e0 2020-01-26T15:38:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.756+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f855404d1f0 con 0x7f85400087e0 2020-01-26T15:38:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.764+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.764+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f85540333a0 con 0x7f85400087e0 2020-01-26T15:38:36.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8534003790 con 0x7f85400087e0 2020-01-26T15:38:36.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855d1af700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:36.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f854e7fc700 1 -- 172.21.15.170:0/3090652066 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8554033600 con 0x7f85400087e0 2020-01-26T15:38:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:36.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 >> v1:172.21.15.170:6800/17396 conn(0x7f854004b000 legacy=0x7f854004d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 msgr2=0x7f854000ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:36.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 --2- 172.21.15.170:0/3090652066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85400087e0 0x7f854000ac20 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f8554000ed0 tx=0x7f8554011370).stop 2020-01-26T15:38:36.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855f413700 1 -- 172.21.15.170:0/3090652066 reap_dead start 2020-01-26T15:38:36.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 shutdown_connections 2020-01-26T15:38:36.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 >> 172.21.15.170:0/3090652066 conn(0x7f8558098f70 msgr2=0x7f85580a0720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:36.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 shutdown_connections 2020-01-26T15:38:36.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:36.920+0000 7f855e1b1700 1 -- 172.21.15.170:0/3090652066 wait complete. 2020-01-26T15:38:36.931 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:39.933 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:40.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 Processor -- start 2020-01-26T15:38:40.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 -- start start 2020-01-26T15:38:40.054 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f79880a5750 0x7f79880a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f79880a4b50 0x7f798805ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79880a5b80 con 0x7f798805efa0 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f79880a43f0 con 0x7f79880a5750 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f79880a4f80 con 0x7f79880a4b50 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798db32700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f79880a4b50 0x7f798805ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798e333700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f79880a5750 0x7f79880a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:40.055 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798db32700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f79880a4b50 0x7f798805ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798eb34700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f798805efa0 0x7f798814ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49296/0 (socket says 172.21.15.170:49296) 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798eb34700 1 -- 172.21.15.170:0/2851719931 learned_addr learned my addr 172.21.15.170:0/2851719931 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798e333700 1 --2- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6790/0 conn(0x7f79880a5750 0x7f79880a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537305964 0 0) 0x7f79880a5b80 con 0x7f798805efa0 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7974003230 con 0x7f798805efa0 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2271530787 0 0) 0x7f7974003230 con 0x7f798805efa0 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6791/0 conn(0x7f79880a4b50 msgr2=0x7f798805ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:40.056 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 --2- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6791/0 conn(0x7f79880a4b50 0x7f798805ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6790/0 conn(0x7f79880a5750 msgr2=0x7f79880a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 --2- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6790/0 conn(0x7f79880a5750 0x7f79880a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988080440 con 0x7f798805efa0 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f7980001a90 con 0x7f798805efa0 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7980001e20 con 0x7f798805efa0 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798d331700 1 -- 172.21.15.170:0/2851719931 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f7980004ae0 con 0x7f798805efa0 2020-01-26T15:38:40.057 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.052+0000 7f798fd96700 1 -- 172.21.15.170:0/2851719931 >> v1:172.21.15.170:6790/0 conn(0x7f798805efa0 legacy=0x7f798814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- 172.21.15.170:0/2851719931 shutdown_connections 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 --2- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6790/0 conn(0x7f79880a5750 0x7f79880a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 --2- 172.21.15.170:0/2851719931 >> v2:172.21.15.170:6791/0 conn(0x7f79880a4b50 0x7f798805ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- 172.21.15.170:0/2851719931 >> 172.21.15.170:0/2851719931 conn(0x7f798805e050 msgr2=0x7f7988098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- 172.21.15.170:0/2851719931 shutdown_connections 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- 172.21.15.170:0/2851719931 wait complete. 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 Processor -- start 2020-01-26T15:38:40.058 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- start start 2020-01-26T15:38:40.060 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f79880a10c0 0x7f79880a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7988130710 0x7f7988137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798811e6b0 con 0x7f79880a2690 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f79880a64c0 con 0x7f79880a10c0 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798fd96700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f79880979c0 con 0x7f7988130710 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798eb34700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f7988130710 0x7f7988137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798e333700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f79880a10c0 0x7f79880a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:40.061 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798db32700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f79880a2690 0x7f798812ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49300/0 (socket says 172.21.15.170:49300) 2020-01-26T15:38:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798db32700 1 -- 172.21.15.170:0/2065008215 learned_addr learned my addr 172.21.15.170:0/2065008215 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798eb34700 1 --2- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6791/0 conn(0x7f7988130710 0x7f7988137630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f798e333700 1 --2- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6790/0 conn(0x7f79880a10c0 0x7f79880a2140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733465160 0 0) 0x7f798811e6b0 con 0x7f79880a2690 2020-01-26T15:38:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7970003230 con 0x7f79880a2690 2020-01-26T15:38:40.062 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 782316210 0 0) 0x7f7970003230 con 0x7f79880a2690 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f798811e6b0 con 0x7f79880a2690 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.056+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f7984002720 con 0x7f79880a2690 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3297673758 0 0) 0x7f798811e6b0 con 0x7f79880a2690 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6791/0 conn(0x7f7988130710 msgr2=0x7f7988137630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 --2- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6791/0 conn(0x7f7988130710 0x7f7988137630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6790/0 conn(0x7f79880a10c0 msgr2=0x7f79880a2140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:40.063 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 --2- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6790/0 conn(0x7f79880a10c0 0x7f79880a2140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79881202f0 con 0x7f79880a2690 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7988121840 con 0x7f79880a2690 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7988130b40 con 0x7f79880a2690 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7984000f10 con 0x7f79880a2690 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f79840012b0 con 0x7f79880a2690 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7964003360 con 0x7f79880a2690 2020-01-26T15:38:40.064 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f7984001530 con 0x7f79880a2690 2020-01-26T15:38:40.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.060+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f798404bc80 con 0x7f79880a2690 2020-01-26T15:38:40.065 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.068+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f7984031140 con 0x7f79880a2690 2020-01-26T15:38:40.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.220+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f79640037d0 con 0x7f79880a2690 2020-01-26T15:38:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f797effd700 1 -- 172.21.15.170:0/2065008215 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f798404a890 con 0x7f79880a2690 2020-01-26T15:38:40.221 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 >> v1:172.21.15.170:6800/17396 conn(0x7f7970040280 legacy=0x7f7970042790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 >> v1:172.21.15.170:6790/0 conn(0x7f79880a2690 legacy=0x7f798812ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 shutdown_connections 2020-01-26T15:38:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 --2- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6791/0 conn(0x7f7988130710 0x7f7988137630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 --2- 172.21.15.170:0/2065008215 >> v2:172.21.15.170:6790/0 conn(0x7f79880a10c0 0x7f79880a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 >> 172.21.15.170:0/2065008215 conn(0x7f7988095540 msgr2=0x7f79880a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 shutdown_connections 2020-01-26T15:38:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:40.224+0000 7f798fd96700 1 -- 172.21.15.170:0/2065008215 wait complete. 2020-01-26T15:38:40.234 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:43.234 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:43.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 Processor -- start 2020-01-26T15:38:43.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 -- start start 2020-01-26T15:38:43.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f0b3814a880 0x7f0b3814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:43.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380a5b80 con 0x7f0b380a5750 2020-01-26T15:38:43.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b38080440 con 0x7f0b38146c30 2020-01-26T15:38:43.368 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380a43f0 con 0x7f0b3814a880 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0b380a5750 0x7f0b380a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52430/0 (socket says 172.21.15.170:52430) 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 -- 172.21.15.170:0/4204738216 learned_addr learned my addr 172.21.15.170:0/4204738216 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3db70700 -1 --2- 172.21.15.170:0/4204738216 >> v2:172.21.15.170:6790/0 conn(0x7f0b3814a880 0x7f0b3814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3db70700 1 --2- 172.21.15.170:0/4204738216 >> v2:172.21.15.170:6790/0 conn(0x7f0b3814a880 0x7f0b3814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970750341 0 0) 0x7f0b380a5b80 con 0x7f0b380a5750 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b24003230 con 0x7f0b380a5750 2020-01-26T15:38:43.369 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122392191 0 0) 0x7f0b38080440 con 0x7f0b38146c30 2020-01-26T15:38:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b380a5b80 con 0x7f0b38146c30 2020-01-26T15:38:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 510554561 0 0) 0x7f0b24003230 con 0x7f0b380a5750 2020-01-26T15:38:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 >> v2:172.21.15.170:6790/0 conn(0x7f0b3814a880 msgr2=0x7f0b3814ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 --2- 172.21.15.170:0/4204738216 >> v2:172.21.15.170:6790/0 conn(0x7f0b3814a880 0x7f0b3814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 >> v1:172.21.15.170:6790/0 conn(0x7f0b38146c30 legacy=0x7f0b38149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380a4e00 con 0x7f0b380a5750 2020-01-26T15:38:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0b30001a90 con 0x7f0b380a5750 2020-01-26T15:38:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 >> v1:172.21.15.170:6789/0 conn(0x7f0b380a5750 legacy=0x7f0b380a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0b24003230 con 0x7f0b24003540 2020-01-26T15:38:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0b380a5b80 con 0x7f0b2400a7f0 2020-01-26T15:38:43.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380a43f0 con 0x7f0b24004b20 2020-01-26T15:38:43.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:43.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842244227 0 0) 0x7f0b24003230 con 0x7f0b24003540 2020-01-26T15:38:43.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 -- 172.21.15.170:0/4204738216 >> v1:172.21.15.170:6791/0 conn(0x7f0b2400a7f0 legacy=0x7f0b2400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.373 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 -- 172.21.15.170:0/4204738216 >> v1:172.21.15.170:6790/0 conn(0x7f0b24003540 legacy=0x7f0b24003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 -- 172.21.15.170:0/4204738216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240544d0 con 0x7f0b24004b20 2020-01-26T15:38:43.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b300018a0 tx=0x7f0b3000c590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.374 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b300018a0 tx=0x7f0b3000c590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f0b300018a0 tx=0x7f0b3000c590).ready entity=mon.0 client_cookie=c32837637dfb45ef server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:43.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0b300018a0 tx=0x7f0b3000c590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0b30012770 con 0x7f0b24004b20 2020-01-26T15:38:43.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0b300018a0 tx=0x7f0b3000c590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3d36f700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f0b300018a0 tx=0x7f0b3000c590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30012970 con 0x7f0b24004b20 2020-01-26T15:38:43.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b2ffff700 1 -- 172.21.15.170:0/4204738216 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0b30012d10 con 0x7f0b24004b20 2020-01-26T15:38:43.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 -- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 msgr2=0x7f0b24004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3edd2700 1 --2- 172.21.15.170:0/4204738216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b24004b20 0x7f0b24004f50 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f0b300018a0 tx=0x7f0b3000c590).stop 2020-01-26T15:38:43.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.360+0000 7f0b3db70700 1 -- 172.21.15.170:0/4204738216 reap_dead start 2020-01-26T15:38:43.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- 172.21.15.170:0/4204738216 shutdown_connections 2020-01-26T15:38:43.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- 172.21.15.170:0/4204738216 >> 172.21.15.170:0/4204738216 conn(0x7f0b3805e050 msgr2=0x7f0b38098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:43.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- 172.21.15.170:0/4204738216 shutdown_connections 2020-01-26T15:38:43.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- 172.21.15.170:0/4204738216 wait complete. 2020-01-26T15:38:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 Processor -- start 2020-01-26T15:38:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- start start 2020-01-26T15:38:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0b3811ed30 0x7f0b3811d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3811ea50 con 0x7f0b3811d840 2020-01-26T15:38:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3807fc90 con 0x7f0b3811e620 2020-01-26T15:38:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3edd2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380a4ab0 con 0x7f0b3811ed30 2020-01-26T15:38:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3db70700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0b3811d840 0x7f0b3807f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52446/0 (socket says 172.21.15.170:52446) 2020-01-26T15:38:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3db70700 1 -- 172.21.15.170:0/289460772 learned_addr learned my addr 172.21.15.170:0/289460772 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3cb6e700 -1 --2- 172.21.15.170:0/289460772 >> v2:172.21.15.170:6791/0 conn(0x7f0b3811ed30 0x7f0b3811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> v2:172.21.15.170:6791/0 conn(0x7f0b3811ed30 0x7f0b3811d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.364+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856985124 0 0) 0x7f0b380a5b80 con 0x7f0b3811d840 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b18003230 con 0x7f0b3811d840 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065673253 0 0) 0x7f0b3807fc90 con 0x7f0b3811e620 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b380a5b80 con 0x7f0b3811e620 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 143890902 0 0) 0x7f0b18003230 con 0x7f0b3811d840 2020-01-26T15:38:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b3807fc90 con 0x7f0b3811d840 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0b34001520 con 0x7f0b3811d840 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 >> v2:172.21.15.170:6791/0 conn(0x7f0b3811ed30 msgr2=0x7f0b3811d2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 --2- 172.21.15.170:0/289460772 >> v2:172.21.15.170:6791/0 conn(0x7f0b3811ed30 0x7f0b3811d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 >> v1:172.21.15.170:6790/0 conn(0x7f0b3811e620 legacy=0x7f0b3807e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 >> v1:172.21.15.170:6789/0 conn(0x7f0b3811d840 legacy=0x7f0b3807f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0b18003230 con 0x7f0b1800a7f0 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0b1800f450 con 0x7f0b18004c90 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380a4ab0 con 0x7f0b18005110 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733277607 0 0) 0x7f0b1800f450 con 0x7f0b18004c90 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1800e440 con 0x7f0b18004c90 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665666061 0 0) 0x7f0b18003230 con 0x7f0b1800a7f0 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1800f450 con 0x7f0b1800a7f0 2020-01-26T15:38:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 700374174 0 0) 0x7f0b1800e440 con 0x7f0b18004c90 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 -- 172.21.15.170:0/289460772 >> v1:172.21.15.170:6791/0 conn(0x7f0b18004c90 legacy=0x7f0b18003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 -- 172.21.15.170:0/289460772 >> v1:172.21.15.170:6790/0 conn(0x7f0b1800a7f0 legacy=0x7f0b1800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 -- 172.21.15.170:0/289460772 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3811f160 con 0x7f0b18005110 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3811e620 con 0x7f0b18005110 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3807e9a0 con 0x7f0b18005110 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0b300125c0 con 0x7f0b18005110 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2800c820 con 0x7f0b18005110 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0b2800cc40 con 0x7f0b18005110 2020-01-26T15:38:43.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b10003360 con 0x7f0b18005110 2020-01-26T15:38:43.386 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f0b280064c0 con 0x7f0b18005110 2020-01-26T15:38:43.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.368+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.372+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f0b2804c930 con 0x7f0b18005110 2020-01-26T15:38:43.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.376+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.387 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.376+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f0b280338f0 con 0x7f0b18005110 2020-01-26T15:38:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0b10003790 con 0x7f0b18005110 2020-01-26T15:38:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3cb6e700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b2dffb700 1 -- 172.21.15.170:0/289460772 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0b280316d0 con 0x7f0b18005110 2020-01-26T15:38:43.530 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:43.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 >> v1:172.21.15.170:6800/17396 conn(0x7f0b18048420 legacy=0x7f0b1804a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 msgr2=0x7f0b18003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:43.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3db70700 1 -- 172.21.15.170:0/289460772 reap_dead start 2020-01-26T15:38:43.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f0b3000bd00 tx=0x7f0b28010a50).stop 2020-01-26T15:38:43.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 shutdown_connections 2020-01-26T15:38:43.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 --2- 172.21.15.170:0/289460772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18005110 0x7f0b18003da0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:43.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 >> 172.21.15.170:0/289460772 conn(0x7f0b3805e050 msgr2=0x7f0b380a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:43.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 shutdown_connections 2020-01-26T15:38:43.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:43.532+0000 7f0b3edd2700 1 -- 172.21.15.170:0/289460772 wait complete. 2020-01-26T15:38:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:46.550 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:46.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 Processor -- start 2020-01-26T15:38:46.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- start start 2020-01-26T15:38:46.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f314c05edd0 0x7f314c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:46.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f314c149040 0x7f314c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:46.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c098000 con 0x7f314c0a6870 2020-01-26T15:38:46.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f314c05e050 con 0x7f314c05edd0 2020-01-26T15:38:46.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0a6ca0 con 0x7f314c149040 2020-01-26T15:38:46.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f31508c3700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f314c149040 0x7f314c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:46.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f31508c3700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f314c149040 0x7f314c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314a59c700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f314c0a6870 0x7f314c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44458/0 (socket says 172.21.15.170:44458) 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314a59c700 1 -- 172.21.15.170:0/1608690736 learned_addr learned my addr 172.21.15.170:0/1608690736 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314ad9d700 -1 --2- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6790/0 conn(0x7f314c05edd0 0x7f314c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314ad9d700 1 --2- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6790/0 conn(0x7f314c05edd0 0x7f314c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911329936 0 0) 0x7f314c098000 con 0x7f314c0a6870 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3138003230 con 0x7f314c0a6870 2020-01-26T15:38:46.670 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2398459622 0 0) 0x7f3138003230 con 0x7f314c0a6870 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6791/0 conn(0x7f314c149040 msgr2=0x7f314c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 --2- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6791/0 conn(0x7f314c149040 0x7f314c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6790/0 conn(0x7f314c05edd0 msgr2=0x7f314c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 --2- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6790/0 conn(0x7f314c05edd0 0x7f314c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c14c9e0 con 0x7f314c0a6870 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f313c001710 con 0x7f314c0a6870 2020-01-26T15:38:46.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f313c001910 con 0x7f314c0a6870 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f3149d9b700 1 -- 172.21.15.170:0/1608690736 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f313c0045b0 con 0x7f314c0a6870 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- 172.21.15.170:0/1608690736 >> v1:172.21.15.170:6791/0 conn(0x7f314c0a6870 legacy=0x7f314c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- 172.21.15.170:0/1608690736 shutdown_connections 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 --2- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6791/0 conn(0x7f314c149040 0x7f314c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 --2- 172.21.15.170:0/1608690736 >> v2:172.21.15.170:6790/0 conn(0x7f314c05edd0 0x7f314c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- 172.21.15.170:0/1608690736 >> 172.21.15.170:0/1608690736 conn(0x7f314c098e70 msgr2=0x7f314c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- 172.21.15.170:0/1608690736 shutdown_connections 2020-01-26T15:38:46.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.668+0000 7f314b59e700 1 -- 172.21.15.170:0/1608690736 wait complete. 2020-01-26T15:38:46.676 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314b59e700 1 Processor -- start 2020-01-26T15:38:46.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314b59e700 1 -- start start 2020-01-26T15:38:46.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314b59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f314c07e4f0 0x7f314c136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:46.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314b59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c09fbf0 con 0x7f314c1369d0 2020-01-26T15:38:46.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314b59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c099a00 con 0x7f314c123580 2020-01-26T15:38:46.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314b59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f314c09ed80 con 0x7f314c07e4f0 2020-01-26T15:38:46.677 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f31508c3700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f314c1369d0 0x7f314c138e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52466/0 (socket says 172.21.15.170:52466) 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314ad9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f314c123580 0x7f314c07dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49338/0 (socket says 172.21.15.170:49338) 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314a59c700 -1 --2- 172.21.15.170:0/1236492305 >> v2:172.21.15.170:6791/0 conn(0x7f314c07e4f0 0x7f314c136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f314a59c700 1 --2- 172.21.15.170:0/1236492305 >> v2:172.21.15.170:6791/0 conn(0x7f314c07e4f0 0x7f314c136480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.672+0000 7f31508c3700 1 -- 172.21.15.170:0/1236492305 learned_addr learned my addr 172.21.15.170:0/1236492305 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590340901 0 0) 0x7f314c099a00 con 0x7f314c123580 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3130003230 con 0x7f314c123580 2020-01-26T15:38:46.678 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212524037 0 0) 0x7f314c09fbf0 con 0x7f314c1369d0 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f314c099a00 con 0x7f314c1369d0 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3427459044 0 0) 0x7f3130003230 con 0x7f314c123580 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f314c09fbf0 con 0x7f314c123580 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f31340026f0 con 0x7f314c123580 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2019155574 0 0) 0x7f314c099a00 con 0x7f314c1369d0 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3130003230 con 0x7f314c1369d0 2020-01-26T15:38:46.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f31440019a0 con 0x7f314c1369d0 2020-01-26T15:38:46.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 >> v2:172.21.15.170:6791/0 conn(0x7f314c07e4f0 msgr2=0x7f314c136480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:46.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 --2- 172.21.15.170:0/1236492305 >> v2:172.21.15.170:6791/0 conn(0x7f314c07e4f0 0x7f314c136480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:46.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 >> v1:172.21.15.170:6790/0 conn(0x7f314c123580 legacy=0x7f314c07dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 >> v1:172.21.15.170:6789/0 conn(0x7f314c1369d0 legacy=0x7f314c138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 --2- 172.21.15.170:0/1236492305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f313000dc40 0x7f31300100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f314c099a00 con 0x7f3130004f00 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3130011780 con 0x7f3130009ff0 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c09ed80 con 0x7f313000dc40 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629529213 0 0) 0x7f3130011780 con 0x7f3130009ff0 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3130003540 con 0x7f3130009ff0 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31508c3700 1 --2- 172.21.15.170:0/1236492305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f313000dc40 0x7f31300100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:46.681 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365111038 0 0) 0x7f314c099a00 con 0x7f3130004f00 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3130011780 con 0x7f3130004f00 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2956808632 0 0) 0x7f3130003540 con 0x7f3130009ff0 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f314c099a00 con 0x7f3130009ff0 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f313c001aa0 con 0x7f3130009ff0 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3792096554 0 0) 0x7f314c099a00 con 0x7f3130009ff0 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f313000dc40 msgr2=0x7f31300100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 --2- 172.21.15.170:0/1236492305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f313000dc40 0x7f31300100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:46.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 >> v1:172.21.15.170:6790/0 conn(0x7f3130004f00 legacy=0x7f31300087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f314c099dc0 con 0x7f3130009ff0 2020-01-26T15:38:46.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c121800 con 0x7f3130009ff0 2020-01-26T15:38:46.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c0a4ce0 con 0x7f3130009ff0 2020-01-26T15:38:46.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.676+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f313c001190 con 0x7f3130009ff0 2020-01-26T15:38:46.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.680+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3124003360 con 0x7f3130009ff0 2020-01-26T15:38:46.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.680+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f313c00ffe0 con 0x7f3130009ff0 2020-01-26T15:38:46.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.680+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 7 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f313c04b330 con 0x7f3130009ff0 2020-01-26T15:38:46.685 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.684+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f313c0305f0 con 0x7f3130009ff0 2020-01-26T15:38:46.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.840+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f31240037d0 con 0x7f3130009ff0 2020-01-26T15:38:46.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.840+0000 7f31437fe700 1 -- 172.21.15.170:0/1236492305 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f313c030850 con 0x7f3130009ff0 2020-01-26T15:38:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:46.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 >> v1:172.21.15.170:6800/17396 conn(0x7f3130049190 legacy=0x7f313004b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 >> v1:172.21.15.170:6791/0 conn(0x7f3130009ff0 legacy=0x7f313000c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:46.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f31508c3700 1 -- 172.21.15.170:0/1236492305 reap_dead start 2020-01-26T15:38:46.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f31508c3700 1 -- 172.21.15.170:0/1236492305 reap_dead start 2020-01-26T15:38:46.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 shutdown_connections 2020-01-26T15:38:46.842 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 >> 172.21.15.170:0/1236492305 conn(0x7f314c099010 msgr2=0x7f314c07f110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:46.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 shutdown_connections 2020-01-26T15:38:46.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:46.844+0000 7f314b59e700 1 -- 172.21.15.170:0/1236492305 wait complete. 2020-01-26T15:38:46.856 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:49.858 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:49.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 Processor -- start 2020-01-26T15:38:49.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- start start 2020-01-26T15:38:49.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f75f005edd0 0x7f75f005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:49.981 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f75f0149040 0x7f75f014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f0098000 con 0x7f75f00a6870 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f75f005e050 con 0x7f75f0149040 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00a6ca0 con 0x7f75f005edd0 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ef7fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f75f005edd0 0x7f75f005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ef7fe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f75f005edd0 0x7f75f005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75eeffd700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f75f00a6870 0x7f75f007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49354/0 (socket says 172.21.15.170:49354) 2020-01-26T15:38:49.982 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75eeffd700 1 -- 172.21.15.170:0/79836585 learned_addr learned my addr 172.21.15.170:0/79836585 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75f571c700 -1 --2- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6790/0 conn(0x7f75f0149040 0x7f75f014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75f571c700 1 --2- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6790/0 conn(0x7f75f0149040 0x7f75f014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840826703 0 0) 0x7f75f0098000 con 0x7f75f00a6870 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d8003230 con 0x7f75f00a6870 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1933925237 0 0) 0x7f75d8003230 con 0x7f75f00a6870 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6791/0 conn(0x7f75f005edd0 msgr2=0x7f75f005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:49.983 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 --2- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6791/0 conn(0x7f75f005edd0 0x7f75f005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6790/0 conn(0x7f75f0149040 msgr2=0x7f75f014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 --2- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6790/0 conn(0x7f75f0149040 0x7f75f014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f014c9e0 con 0x7f75f00a6870 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f75e4001710 con 0x7f75f00a6870 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f75e4001aa0 con 0x7f75f00a6870 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- 172.21.15.170:0/79836585 >> v1:172.21.15.170:6790/0 conn(0x7f75f00a6870 legacy=0x7f75f007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:49.984 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75ee7fc700 1 -- 172.21.15.170:0/79836585 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f75e4004760 con 0x7f75f00a6870 2020-01-26T15:38:49.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- 172.21.15.170:0/79836585 shutdown_connections 2020-01-26T15:38:49.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 --2- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6790/0 conn(0x7f75f0149040 0x7f75f014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:49.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 --2- 172.21.15.170:0/79836585 >> v2:172.21.15.170:6791/0 conn(0x7f75f005edd0 0x7f75f005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:49.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.980+0000 7f75effff700 1 -- 172.21.15.170:0/79836585 >> 172.21.15.170:0/79836585 conn(0x7f75f0098e70 msgr2=0x7f75f00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:49.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.984+0000 7f75effff700 1 -- 172.21.15.170:0/79836585 shutdown_connections 2020-01-26T15:38:49.985 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.984+0000 7f75effff700 1 -- 172.21.15.170:0/79836585 wait complete. 2020-01-26T15:38:49.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.984+0000 7f75effff700 1 Processor -- start 2020-01-26T15:38:49.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.984+0000 7f75effff700 1 -- start start 2020-01-26T15:38:49.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f75f009b660 0x7f75f009ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f75f0079de0 0x7f75f00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f0099a00 con 0x7f75f00799b0 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f75f012fb20 con 0x7f75f0079de0 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00a43d0 con 0x7f75f009b660 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75f571c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f75f0079de0 0x7f75f00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f75f00799b0 0x7f75f00a2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52484/0 (socket says 172.21.15.170:52484) 2020-01-26T15:38:49.991 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 -- 172.21.15.170:0/44378855 learned_addr learned my addr 172.21.15.170:0/44378855 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:49.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75ef7fe700 -1 --2- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6791/0 conn(0x7f75f009b660 0x7f75f009ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:49.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75f571c700 1 --2- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6790/0 conn(0x7f75f0079de0 0x7f75f00a3750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:49.999 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75ef7fe700 1 --2- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6791/0 conn(0x7f75f009b660 0x7f75f009ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147746840 0 0) 0x7f75f0099a00 con 0x7f75f00799b0 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d0003230 con 0x7f75f00799b0 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2562294456 0 0) 0x7f75d0003230 con 0x7f75f00799b0 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75f0099a00 con 0x7f75f00799b0 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f75e4001420 con 0x7f75f00799b0 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6791/0 conn(0x7f75f009b660 msgr2=0x7f75f009ba90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:50.000 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 --2- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6791/0 conn(0x7f75f009b660 0x7f75f009ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:50.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6790/0 conn(0x7f75f0079de0 msgr2=0x7f75f00a3750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:50.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 --2- 172.21.15.170:0/44378855 >> v2:172.21.15.170:6790/0 conn(0x7f75f0079de0 0x7f75f00a3750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:50.001 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 >> v1:172.21.15.170:6789/0 conn(0x7f75f00799b0 legacy=0x7f75f00a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:50.004 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f75d0003230 con 0x7f75d0003a20 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f75d000f450 con 0x7f75d000a7f0 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f012fb20 con 0x7f75d0003e70 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755802487 0 0) 0x7f75d0003230 con 0x7f75d0003a20 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d000f680 con 0x7f75d0003a20 2020-01-26T15:38:50.005 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83656687 0 0) 0x7f75d000f450 con 0x7f75d000a7f0 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d0003230 con 0x7f75d000a7f0 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1273966332 0 0) 0x7f75d000f680 con 0x7f75d0003a20 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 -- 172.21.15.170:0/44378855 >> v1:172.21.15.170:6791/0 conn(0x7f75d000a7f0 legacy=0x7f75d000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 -- 172.21.15.170:0/44378855 >> v1:172.21.15.170:6790/0 conn(0x7f75d0003a20 legacy=0x7f75d00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 -- 172.21.15.170:0/44378855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00a4ef0 con 0x7f75d0003e70 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75f571c700 1 -- 172.21.15.170:0/44378855 reap_dead start 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f009a3b0 con 0x7f75d0003e70 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f00a49d0 con 0x7f75d0003e70 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f75e80019e0 con 0x7f75d0003e70 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4001230 con 0x7f75d0003e70 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f75e4012190 con 0x7f75d0003e70 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.988+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.992+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c8003360 con 0x7f75d0003e70 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.992+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f75e4012390 con 0x7f75d0003e70 2020-01-26T15:38:50.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.992+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.992+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f75e404d780 con 0x7f75d0003e70 2020-01-26T15:38:50.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.996+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:49.996+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f75e4033930 con 0x7f75d0003e70 2020-01-26T15:38:50.151 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.152+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f75c8003790 con 0x7f75d0003e70 2020-01-26T15:38:50.152 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.152+0000 7f75eeffd700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:50.152 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.152+0000 7f75d7fff700 1 -- 172.21.15.170:0/44378855 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f75e4033b90 con 0x7f75d0003e70 2020-01-26T15:38:50.152 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:50.153 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 >> v1:172.21.15.170:6800/17396 conn(0x7f75d0042ef0 legacy=0x7f75d0045400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 msgr2=0x7f75d0004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f75e80017f0 tx=0x7f75e8001be0).stop 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 shutdown_connections 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 --2- 172.21.15.170:0/44378855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75d0003e70 0x7f75d0004da0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 >> 172.21.15.170:0/44378855 conn(0x7f75f00a7870 msgr2=0x7f75f007f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 shutdown_connections 2020-01-26T15:38:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:50.156+0000 7f75effff700 1 -- 172.21.15.170:0/44378855 wait complete. 2020-01-26T15:38:50.165 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:53.166 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 Processor -- start 2020-01-26T15:38:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 -- start start 2020-01-26T15:38:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f66f00a6870 0x7f66f014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f005ea20 con 0x7f66f005e5f0 2020-01-26T15:38:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f0098000 con 0x7f66f005edd0 2020-01-26T15:38:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f66f005e050 con 0x7f66f00a6870 2020-01-26T15:38:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f66f005e5f0 0x7f66f0149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52496/0 (socket says 172.21.15.170:52496) 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 -- 172.21.15.170:0/704468973 learned_addr learned my addr 172.21.15.170:0/704468973 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66eed9d700 1 --1- 172.21.15.170:0/704468973 >> v1:172.21.15.170:6790/0 conn(0x7f66f005edd0 0x7f66f007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49374/0 (socket says 172.21.15.170:49374) 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66f4cea700 -1 --2- 172.21.15.170:0/704468973 >> v2:172.21.15.170:6791/0 conn(0x7f66f00a6870 0x7f66f014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66f4cea700 1 --2- 172.21.15.170:0/704468973 >> v2:172.21.15.170:6791/0 conn(0x7f66f00a6870 0x7f66f014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746400674 0 0) 0x7f66f005ea20 con 0x7f66f005e5f0 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc003230 con 0x7f66f005e5f0 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712116518 0 0) 0x7f66f0098000 con 0x7f66f005edd0 2020-01-26T15:38:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f005ea20 con 0x7f66f005edd0 2020-01-26T15:38:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1660302366 0 0) 0x7f66dc003230 con 0x7f66f005e5f0 2020-01-26T15:38:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 >> v2:172.21.15.170:6791/0 conn(0x7f66f00a6870 msgr2=0x7f66f014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 --2- 172.21.15.170:0/704468973 >> v2:172.21.15.170:6791/0 conn(0x7f66f00a6870 0x7f66f014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 >> v1:172.21.15.170:6790/0 conn(0x7f66f005edd0 legacy=0x7f66f007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00a6ca0 con 0x7f66f005e5f0 2020-01-26T15:38:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f66d8001710 con 0x7f66f005e5f0 2020-01-26T15:38:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 >> v1:172.21.15.170:6789/0 conn(0x7f66f005e5f0 legacy=0x7f66f0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f66dc003230 con 0x7f66dc004b50 2020-01-26T15:38:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f66f005ea20 con 0x7f66dc00a7f0 2020-01-26T15:38:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f005e050 con 0x7f66dc004f80 2020-01-26T15:38:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91429207 0 0) 0x7f66dc003230 con 0x7f66dc004b50 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f0098000 con 0x7f66dc004b50 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 -- 172.21.15.170:0/704468973 >> v1:172.21.15.170:6791/0 conn(0x7f66dc00a7f0 legacy=0x7f66dc00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831121524 0 0) 0x7f66f005ea20 con 0x7f66dc00a7f0 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 -- 172.21.15.170:0/704468973 >> v1:172.21.15.170:6790/0 conn(0x7f66dc004b50 legacy=0x7f66dc003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 -- 172.21.15.170:0/704468973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc054530 con 0x7f66dc004f80 2020-01-26T15:38:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66e0001d30 tx=0x7f66e0001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66e0001d30 tx=0x7f66e0001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f66e0001d30 tx=0x7f66e0001c70).ready entity=mon.0 client_cookie=b8cf0a98de4825fc server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66e0001d30 tx=0x7f66e0001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f66e00046a0 con 0x7f66dc004f80 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66e0001d30 tx=0x7f66e0001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66e7fff700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66e0001d30 tx=0x7f66e0001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e0001a00 con 0x7f66dc004f80 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ee59c700 1 -- 172.21.15.170:0/704468973 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f66d800ed60 con 0x7f66dc004f80 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 -- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 msgr2=0x7f66dc003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66ef59e700 1 --2- 172.21.15.170:0/704468973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66dc004f80 0x7f66dc003d40 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f66e0001d30 tx=0x7f66e0001c70).stop 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.288+0000 7f66f4cea700 1 -- 172.21.15.170:0/704468973 reap_dead start 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- 172.21.15.170:0/704468973 shutdown_connections 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- 172.21.15.170:0/704468973 >> 172.21.15.170:0/704468973 conn(0x7f66f0098e70 msgr2=0x7f66f00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- 172.21.15.170:0/704468973 shutdown_connections 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- 172.21.15.170:0/704468973 wait complete. 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 Processor -- start 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- start start 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f66f0121860 0x7f66f007d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f009e360 con 0x7f66f0121c90 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f0024dd0 con 0x7f66f00a06e0 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66ef59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f66f009de80 con 0x7f66f0121860 2020-01-26T15:38:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66f4cea700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f66f0121c90 0x7f66f013a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49388/0 (socket says 172.21.15.170:49388) 2020-01-26T15:38:53.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66f4cea700 1 -- 172.21.15.170:0/1164027523 learned_addr learned my addr 172.21.15.170:0/1164027523 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:53.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66eed9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f66f00a06e0 0x7f66f01208a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44510/0 (socket says 172.21.15.170:44510) 2020-01-26T15:38:53.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e7fff700 -1 --2- 172.21.15.170:0/1164027523 >> v2:172.21.15.170:6791/0 conn(0x7f66f0121860 0x7f66f007d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:38:53.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e7fff700 1 --2- 172.21.15.170:0/1164027523 >> v2:172.21.15.170:6791/0 conn(0x7f66f0121860 0x7f66f007d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:53.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544503236 0 0) 0x7f66f0024dd0 con 0x7f66f00a06e0 2020-01-26T15:38:53.305 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d4003230 con 0x7f66f00a06e0 2020-01-26T15:38:53.306 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550817766 0 0) 0x7f66f009e360 con 0x7f66f0121c90 2020-01-26T15:38:53.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f0024dd0 con 0x7f66f0121c90 2020-01-26T15:38:53.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3513474878 0 0) 0x7f66d4003230 con 0x7f66f00a06e0 2020-01-26T15:38:53.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.292+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66f009e360 con 0x7f66f00a06e0 2020-01-26T15:38:53.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f66e00019c0 con 0x7f66f00a06e0 2020-01-26T15:38:53.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1654439015 0 0) 0x7f66f0024dd0 con 0x7f66f0121c90 2020-01-26T15:38:53.307 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66d4003230 con 0x7f66f0121c90 2020-01-26T15:38:53.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f66e8001a00 con 0x7f66f0121c90 2020-01-26T15:38:53.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2116510132 0 0) 0x7f66f009e360 con 0x7f66f00a06e0 2020-01-26T15:38:53.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 >> v2:172.21.15.170:6791/0 conn(0x7f66f0121860 msgr2=0x7f66f007d040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:53.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 --2- 172.21.15.170:0/1164027523 >> v2:172.21.15.170:6791/0 conn(0x7f66f0121860 0x7f66f007d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:53.308 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 >> v1:172.21.15.170:6790/0 conn(0x7f66f0121c90 legacy=0x7f66f013a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00a0b10 con 0x7f66f00a06e0 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f005e930 con 0x7f66f00a06e0 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f007d7b0 con 0x7f66f00a06e0 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f66e0004950 con 0x7f66f00a06e0 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f66e0004d30 con 0x7f66f00a06e0 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c8003360 con 0x7f66f00a06e0 2020-01-26T15:38:53.309 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f66e0010770 con 0x7f66f00a06e0 2020-01-26T15:38:53.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.296+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f66e004bcb0 con 0x7f66f00a06e0 2020-01-26T15:38:53.310 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.300+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f66e0031290 con 0x7f66f00a06e0 2020-01-26T15:38:53.456 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f66c80037d0 con 0x7f66f00a06e0 2020-01-26T15:38:53.457 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66e77fe700 1 -- 172.21.15.170:0/1164027523 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f66e0031e40 con 0x7f66f00a06e0 2020-01-26T15:38:53.457 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 >> v1:172.21.15.170:6800/17396 conn(0x7f66d403e3a0 legacy=0x7f66d40408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 >> v1:172.21.15.170:6791/0 conn(0x7f66f00a06e0 legacy=0x7f66f01208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 shutdown_connections 2020-01-26T15:38:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 --2- 172.21.15.170:0/1164027523 >> v2:172.21.15.170:6791/0 conn(0x7f66f0121860 0x7f66f007d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 >> 172.21.15.170:0/1164027523 conn(0x7f66f0098e10 msgr2=0x7f66f00a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 shutdown_connections 2020-01-26T15:38:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:53.460+0000 7f66ef59e700 1 -- 172.21.15.170:0/1164027523 wait complete. 2020-01-26T15:38:53.475 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:56.476 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:56.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1955442700 1 Processor -- start 2020-01-26T15:38:56.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1955442700 1 -- start start 2020-01-26T15:38:56.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1955442700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f19500a6870 0x7f195014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:56.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1955442700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195005ea20 con 0x7f195005edd0 2020-01-26T15:38:56.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1955442700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950098000 con 0x7f195005e5f0 2020-01-26T15:38:56.598 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1955442700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f195005e050 con 0x7f19500a6870 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1954c41700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f195005edd0 0x7f195007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52516/0 (socket says 172.21.15.170:52516) 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f1954c41700 1 -- 172.21.15.170:0/2732624280 learned_addr learned my addr 172.21.15.170:0/2732624280 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f19566a4700 -1 --2- 172.21.15.170:0/2732624280 >> v2:172.21.15.170:6790/0 conn(0x7f19500a6870 0x7f195014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.592+0000 7f19566a4700 1 --2- 172.21.15.170:0/2732624280 >> v2:172.21.15.170:6790/0 conn(0x7f19500a6870 0x7f195014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268121278 0 0) 0x7f1950098000 con 0x7f195005e5f0 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1938003230 con 0x7f195005e5f0 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52580056 0 0) 0x7f195005ea20 con 0x7f195005edd0 2020-01-26T15:38:56.599 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1950098000 con 0x7f195005edd0 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1109582554 0 0) 0x7f1950098000 con 0x7f195005edd0 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 >> v2:172.21.15.170:6790/0 conn(0x7f19500a6870 msgr2=0x7f195014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 --2- 172.21.15.170:0/2732624280 >> v2:172.21.15.170:6790/0 conn(0x7f19500a6870 0x7f195014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 >> v1:172.21.15.170:6791/0 conn(0x7f195005e5f0 legacy=0x7f1950149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19500a6ca0 con 0x7f195005edd0 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1940001a70 con 0x7f195005edd0 2020-01-26T15:38:56.600 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 >> v1:172.21.15.170:6789/0 conn(0x7f195005edd0 legacy=0x7f195007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1950098000 con 0x7f19380045a0 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1938003230 con 0x7f193800a7f0 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195005e050 con 0x7f1938003af0 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623699093 0 0) 0x7f1950098000 con 0x7f19380045a0 2020-01-26T15:38:56.601 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195005ea20 con 0x7f19380045a0 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204601599 0 0) 0x7f1938003230 con 0x7f193800a7f0 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 -- 172.21.15.170:0/2732624280 >> v1:172.21.15.170:6791/0 conn(0x7f193800a7f0 legacy=0x7f193800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 -- 172.21.15.170:0/2732624280 >> v1:172.21.15.170:6790/0 conn(0x7f19380045a0 legacy=0x7f19380049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 -- 172.21.15.170:0/2732624280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938054560 con 0x7f1938003af0 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1940001360 tx=0x7f194000c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1940001360 tx=0x7f194000c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.602 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f1940001360 tx=0x7f194000c510).ready entity=mon.0 client_cookie=73a02a5b61facfcc server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f1940001360 tx=0x7f194000c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f194000e4c0 con 0x7f1938003af0 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f1940001360 tx=0x7f194000c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000e6c0 con 0x7f1938003af0 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1954c41700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f1940001360 tx=0x7f194000c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f194f7fe700 1 -- 172.21.15.170:0/2732624280 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f19400100b0 con 0x7f1938003af0 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1955442700 1 -- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 msgr2=0x7f1938003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.603 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1955442700 1 --2- 172.21.15.170:0/2732624280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1938003af0 0x7f1938003f20 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f1940001360 tx=0x7f194000c510).stop 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f19566a4700 1 -- 172.21.15.170:0/2732624280 reap_dead start 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1955442700 1 -- 172.21.15.170:0/2732624280 shutdown_connections 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1955442700 1 -- 172.21.15.170:0/2732624280 >> 172.21.15.170:0/2732624280 conn(0x7f1950098e70 msgr2=0x7f19500a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1955442700 1 -- 172.21.15.170:0/2732624280 shutdown_connections 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.596+0000 7f1955442700 1 -- 172.21.15.170:0/2732624280 wait complete. 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1955442700 1 Processor -- start 2020-01-26T15:38:56.604 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1955442700 1 -- start start 2020-01-26T15:38:56.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1955442700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f195007d1f0 0x7f195013bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:56.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1955442700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195009e0f0 con 0x7f195007cdc0 2020-01-26T15:38:56.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1955442700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195009e8f0 con 0x7f19500a27c0 2020-01-26T15:38:56.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1955442700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f195007d620 con 0x7f195007d1f0 2020-01-26T15:38:56.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1954c41700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f195007cdc0 0x7f19500a1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52530/0 (socket says 172.21.15.170:52530) 2020-01-26T15:38:56.611 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194ffff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f19500a27c0 0x7f19501383a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44530/0 (socket says 172.21.15.170:44530) 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f1954c41700 1 -- 172.21.15.170:0/1021093064 learned_addr learned my addr 172.21.15.170:0/1021093064 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f19566a4700 -1 --2- 172.21.15.170:0/1021093064 >> v2:172.21.15.170:6790/0 conn(0x7f195007d1f0 0x7f195013bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f19566a4700 1 --2- 172.21.15.170:0/1021093064 >> v2:172.21.15.170:6790/0 conn(0x7f195007d1f0 0x7f195013bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977317774 0 0) 0x7f195009e0f0 con 0x7f195007cdc0 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1930003230 con 0x7f195007cdc0 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898058611 0 0) 0x7f195009e8f0 con 0x7f19500a27c0 2020-01-26T15:38:56.612 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195009e0f0 con 0x7f19500a27c0 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4041320820 0 0) 0x7f1930003230 con 0x7f195007cdc0 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f195009e8f0 con 0x7f195007cdc0 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f19400100b0 con 0x7f195007cdc0 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 >> v2:172.21.15.170:6790/0 conn(0x7f195007d1f0 msgr2=0x7f195013bbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 --2- 172.21.15.170:0/1021093064 >> v2:172.21.15.170:6790/0 conn(0x7f195007d1f0 0x7f195013bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 >> v1:172.21.15.170:6791/0 conn(0x7f19500a27c0 legacy=0x7f19501383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.613 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.600+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 >> v1:172.21.15.170:6789/0 conn(0x7f195007cdc0 legacy=0x7f19500a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f195009e0f0 con 0x7f193000a7f0 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1930003230 con 0x7f1930005120 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195007d620 con 0x7f1930004c90 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901026842 0 0) 0x7f195009e0f0 con 0x7f193000a7f0 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193000e440 con 0x7f193000a7f0 2020-01-26T15:38:56.614 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315351703 0 0) 0x7f1930003230 con 0x7f1930005120 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195009e0f0 con 0x7f1930005120 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 -- 172.21.15.170:0/1021093064 >> v1:172.21.15.170:6791/0 conn(0x7f1930005120 legacy=0x7f1930003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 -- 172.21.15.170:0/1021093064 >> v1:172.21.15.170:6790/0 conn(0x7f193000a7f0 legacy=0x7f193000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 -- 172.21.15.170:0/1021093064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950097990 con 0x7f1930004c90 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195011ec30 con 0x7f1930004c90 2020-01-26T15:38:56.615 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1950122b50 con 0x7f1930004c90 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1940010850 con 0x7f1930004c90 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940010a50 con 0x7f1930004c90 2020-01-26T15:38:56.616 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1940004ae0 con 0x7f1930004c90 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928003360 con 0x7f1930004c90 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1940004ce0 con 0x7f1930004c90 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.604+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f194004e260 con 0x7f1930004c90 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.608+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.617 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.608+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f1940051de0 con 0x7f1930004c90 2020-01-26T15:38:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1928003790 con 0x7f1930004c90 2020-01-26T15:38:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1954c41700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f194d7fa700 1 -- 172.21.15.170:0/1021093064 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1940032060 con 0x7f1930004c90 2020-01-26T15:38:56.765 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:38:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 >> v1:172.21.15.170:6800/17396 conn(0x7f1930048170 legacy=0x7f193004a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 msgr2=0x7f1930003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 --2- 172.21.15.170:0/1021093064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1930004c90 0x7f1930003540 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f1940002200 tx=0x7f19400103c0).stop 2020-01-26T15:38:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f19566a4700 1 -- 172.21.15.170:0/1021093064 reap_dead start 2020-01-26T15:38:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f19566a4700 1 -- 172.21.15.170:0/1021093064 reap_dead start 2020-01-26T15:38:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 shutdown_connections 2020-01-26T15:38:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 >> 172.21.15.170:0/1021093064 conn(0x7f195005edd0 msgr2=0x7f195007f190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 shutdown_connections 2020-01-26T15:38:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:56.768+0000 7f1955442700 1 -- 172.21.15.170:0/1021093064 wait complete. 2020-01-26T15:38:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:38:59.785 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:38:59.906 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8d631700 1 Processor -- start 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8d631700 1 -- start start 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8d631700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3c8805e5f0 0x7f3c880a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8d631700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880a6dc0 con 0x7f3c88149040 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8d631700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8805ea20 con 0x7f3c8805edd0 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8d631700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3c88098000 con 0x7f3c8805e5f0 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8ce30700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f3c8805edd0 0x7f3c8807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44544/0 (socket says 172.21.15.170:44544) 2020-01-26T15:38:59.907 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c8ce30700 1 -- 172.21.15.170:0/2393090459 learned_addr learned my addr 172.21.15.170:0/2393090459 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c87fff700 -1 --2- 172.21.15.170:0/2393090459 >> v2:172.21.15.170:6790/0 conn(0x7f3c8805e5f0 0x7f3c880a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c87fff700 1 --2- 172.21.15.170:0/2393090459 >> v2:172.21.15.170:6790/0 conn(0x7f3c8805e5f0 0x7f3c880a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.904+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571264314 0 0) 0x7f3c8805ea20 con 0x7f3c8805edd0 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c70003230 con 0x7f3c8805edd0 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546235827 0 0) 0x7f3c880a6dc0 con 0x7f3c88149040 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8805ea20 con 0x7f3c88149040 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 140630246 0 0) 0x7f3c8805ea20 con 0x7f3c88149040 2020-01-26T15:38:59.908 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 >> v2:172.21.15.170:6790/0 conn(0x7f3c8805e5f0 msgr2=0x7f3c880a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:38:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 --2- 172.21.15.170:0/2393090459 >> v2:172.21.15.170:6790/0 conn(0x7f3c8805e5f0 0x7f3c880a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 >> v1:172.21.15.170:6791/0 conn(0x7f3c8805edd0 legacy=0x7f3c8807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8805e050 con 0x7f3c88149040 2020-01-26T15:38:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3c80001a70 con 0x7f3c88149040 2020-01-26T15:38:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3c80001d40 con 0x7f3c88149040 2020-01-26T15:38:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c877fe700 1 -- 172.21.15.170:0/2393090459 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3c800021a0 con 0x7f3c88149040 2020-01-26T15:38:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 -- 172.21.15.170:0/2393090459 >> v1:172.21.15.170:6790/0 conn(0x7f3c88149040 legacy=0x7f3c8814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 -- 172.21.15.170:0/2393090459 shutdown_connections 2020-01-26T15:38:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 --2- 172.21.15.170:0/2393090459 >> v2:172.21.15.170:6790/0 conn(0x7f3c8805e5f0 0x7f3c880a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:38:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 -- 172.21.15.170:0/2393090459 >> 172.21.15.170:0/2393090459 conn(0x7f3c88098e70 msgr2=0x7f3c880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:38:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 -- 172.21.15.170:0/2393090459 shutdown_connections 2020-01-26T15:38:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 -- 172.21.15.170:0/2393090459 wait complete. 2020-01-26T15:38:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 Processor -- start 2020-01-26T15:38:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.908+0000 7f3c8d631700 1 -- start start 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8d631700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3c880a12a0 0x7f3c8809fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8d631700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8806f910 con 0x7f3c880a0360 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8d631700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c88122600 con 0x7f3c8812d6a0 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8d631700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880a16d0 con 0x7f3c880a12a0 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3c880a12a0 0x7f3c8809fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f3c880a12a0 0x7f3c8809fe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:38:59.915 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c87fff700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3c880a0360 0x7f3c8812cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52550/0 (socket says 172.21.15.170:52550) 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c87fff700 1 -- 172.21.15.170:0/2201852996 learned_addr learned my addr 172.21.15.170:0/2201852996 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291565339 0 0) 0x7f3c8806f910 con 0x7f3c880a0360 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c68003230 con 0x7f3c880a0360 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093496313 0 0) 0x7f3c88122600 con 0x7f3c8812d6a0 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8806f910 con 0x7f3c8812d6a0 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1395916567 0 0) 0x7f3c68003230 con 0x7f3c880a0360 2020-01-26T15:38:59.916 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3c88122600 con 0x7f3c880a0360 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3c7c002780 con 0x7f3c880a0360 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 >> v2:172.21.15.170:6790/0 conn(0x7f3c880a12a0 msgr2=0x7f3c8809fe10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 --2- 172.21.15.170:0/2201852996 >> v2:172.21.15.170:6790/0 conn(0x7f3c880a12a0 0x7f3c8809fe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 >> v1:172.21.15.170:6790/0 conn(0x7f3c8812d6a0 legacy=0x7f3c881373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 >> v1:172.21.15.170:6789/0 conn(0x7f3c880a0360 legacy=0x7f3c8812cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:38:59.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3c8806f910 con 0x7f3c680050c0 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3c68003230 con 0x7f3c6800ca00 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68012670 con 0x7f3c68004c90 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812650791 0 0) 0x7f3c8806f910 con 0x7f3c680050c0 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c68010650 con 0x7f3c680050c0 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334889852 0 0) 0x7f3c68003230 con 0x7f3c6800ca00 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8806f910 con 0x7f3c6800ca00 2020-01-26T15:38:59.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 -- 172.21.15.170:0/2201852996 >> v1:172.21.15.170:6791/0 conn(0x7f3c6800ca00 legacy=0x7f3c6800ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 -- 172.21.15.170:0/2201852996 >> v1:172.21.15.170:6790/0 conn(0x7f3c680050c0 legacy=0x7f3c68005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 -- 172.21.15.170:0/2201852996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88122b40 con 0x7f3c68004c90 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c880a1940 con 0x7f3c68004c90 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:38:59.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.912+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8812d6a0 con 0x7f3c68004c90 2020-01-26T15:38:59.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3c7800b4e0 con 0x7f3c68004c90 2020-01-26T15:38:59.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800b6e0 con 0x7f3c68004c90 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3c7800ba80 con 0x7f3c68004c90 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c60003360 con 0x7f3c68004c90 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f3c7800bc80 con 0x7f3c68004c90 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.916+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f3c7804d220 con 0x7f3c68004c90 2020-01-26T15:38:59.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.924+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:38:59.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:38:59.924+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f3c78033350 con 0x7f3c68004c90 2020-01-26T15:39:00.073 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3c60003790 con 0x7f3c68004c90 2020-01-26T15:39:00.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8ce30700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:00.074 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c857fa700 1 -- 172.21.15.170:0/2201852996 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3c780335b0 con 0x7f3c68004c90 2020-01-26T15:39:00.074 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:00.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 >> v1:172.21.15.170:6800/17396 conn(0x7f3c6804a5d0 legacy=0x7f3c6804cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:00.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 msgr2=0x7f3c680057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:00.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8e893700 1 -- 172.21.15.170:0/2201852996 reap_dead start 2020-01-26T15:39:00.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f3c780011d0 tx=0x7f3c78010960).stop 2020-01-26T15:39:00.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 shutdown_connections 2020-01-26T15:39:00.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 --2- 172.21.15.170:0/2201852996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c68004c90 0x7f3c680057c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:00.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 >> 172.21.15.170:0/2201852996 conn(0x7f3c8805c180 msgr2=0x7f3c8807f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:00.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 shutdown_connections 2020-01-26T15:39:00.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:00.076+0000 7f3c8d631700 1 -- 172.21.15.170:0/2201852996 wait complete. 2020-01-26T15:39:00.086 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:03.087 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 Processor -- start 2020-01-26T15:39:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 -- start start 2020-01-26T15:39:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f123805e5f0 0x7f12380a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1238149040 0x7f123814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380a6dc0 con 0x7f123805edd0 2020-01-26T15:39:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f123805ea20 con 0x7f1238149040 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123c927700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1238098000 con 0x7f123805e5f0 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123d128700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1238149040 0x7f123814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123759e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f123805edd0 0x7f123807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44564/0 (socket says 172.21.15.170:44564) 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f1236d9d700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f123805e5f0 0x7f12380a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123759e700 1 -- 172.21.15.170:0/3536268388 learned_addr learned my addr 172.21.15.170:0/3536268388 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f1236d9d700 1 --2- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6791/0 conn(0x7f123805e5f0 0x7f12380a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123d128700 1 --2- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6790/0 conn(0x7f1238149040 0x7f123814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130557046 0 0) 0x7f12380a6dc0 con 0x7f123805edd0 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003230 con 0x7f123805edd0 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4166387570 0 0) 0x7f1220003230 con 0x7f123805edd0 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6791/0 conn(0x7f123805e5f0 msgr2=0x7f12380a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 --2- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6791/0 conn(0x7f123805e5f0 0x7f12380a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6790/0 conn(0x7f1238149040 msgr2=0x7f123814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 --2- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6790/0 conn(0x7f1238149040 0x7f123814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123805e050 con 0x7f123805edd0 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.208+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1228001710 con 0x7f123805edd0 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1228001aa0 con 0x7f123805edd0 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123659c700 1 -- 172.21.15.170:0/3536268388 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1228004760 con 0x7f123805edd0 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 -- 172.21.15.170:0/3536268388 >> v1:172.21.15.170:6791/0 conn(0x7f123805edd0 legacy=0x7f123807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 -- 172.21.15.170:0/3536268388 shutdown_connections 2020-01-26T15:39:03.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 --2- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6790/0 conn(0x7f1238149040 0x7f123814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:03.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 --2- 172.21.15.170:0/3536268388 >> v2:172.21.15.170:6791/0 conn(0x7f123805e5f0 0x7f12380a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:03.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 -- 172.21.15.170:0/3536268388 >> 172.21.15.170:0/3536268388 conn(0x7f1238098e70 msgr2=0x7f12380a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:03.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 -- 172.21.15.170:0/3536268388 shutdown_connections 2020-01-26T15:39:03.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 -- 172.21.15.170:0/3536268388 wait complete. 2020-01-26T15:39:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 Processor -- start 2020-01-26T15:39:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.212+0000 7f123c927700 1 -- start start 2020-01-26T15:39:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f12380a3520 0x7f1238122160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380a4090 con 0x7f12380a44c0 2020-01-26T15:39:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1238121c50 con 0x7f12381226b0 2020-01-26T15:39:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f123805eea0 con 0x7f12380a3520 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123759e700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f12380a44c0 0x7f1238099b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49446/0 (socket says 172.21.15.170:49446) 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123759e700 1 -- 172.21.15.170:0/2066534965 learned_addr learned my addr 172.21.15.170:0/2066534965 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f1236d9d700 -1 --2- 172.21.15.170:0/2066534965 >> v2:172.21.15.170:6791/0 conn(0x7f12380a3520 0x7f1238122160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f1236d9d700 1 --2- 172.21.15.170:0/2066534965 >> v2:172.21.15.170:6791/0 conn(0x7f12380a3520 0x7f1238122160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236656832 0 0) 0x7f12380a4090 con 0x7f12380a44c0 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1218003230 con 0x7f12380a44c0 2020-01-26T15:39:03.218 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631037462 0 0) 0x7f1238121c50 con 0x7f12381226b0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12380a4090 con 0x7f12381226b0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1254541340 0 0) 0x7f1218003230 con 0x7f12380a44c0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1238121c50 con 0x7f12380a44c0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2502440730 0 0) 0x7f12380a4090 con 0x7f12381226b0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1218003230 con 0x7f12381226b0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1228001420 con 0x7f12380a44c0 2020-01-26T15:39:03.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1230002980 con 0x7f12381226b0 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4129642099 0 0) 0x7f1238121c50 con 0x7f12380a44c0 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 >> v2:172.21.15.170:6791/0 conn(0x7f12380a3520 msgr2=0x7f1238122160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 --2- 172.21.15.170:0/2066534965 >> v2:172.21.15.170:6791/0 conn(0x7f12380a3520 0x7f1238122160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 >> v1:172.21.15.170:6791/0 conn(0x7f12381226b0 legacy=0x7f1238137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380a2390 con 0x7f12380a44c0 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1238122ae0 con 0x7f12380a44c0 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1238122fb0 con 0x7f12380a44c0 2020-01-26T15:39:03.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f12280049b0 con 0x7f12380a44c0 2020-01-26T15:39:03.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1228004d50 con 0x7f12380a44c0 2020-01-26T15:39:03.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.216+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12380a42c0 con 0x7f12380a44c0 2020-01-26T15:39:03.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.220+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f1228010790 con 0x7f12380a44c0 2020-01-26T15:39:03.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.220+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f122804bab0 con 0x7f12380a44c0 2020-01-26T15:39:03.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.224+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1228031090 con 0x7f12380a44c0 2020-01-26T15:39:03.380 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1238056600 con 0x7f12380a44c0 2020-01-26T15:39:03.381 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f121ffff700 1 -- 172.21.15.170:0/2066534965 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f1228031c40 con 0x7f12380a44c0 2020-01-26T15:39:03.381 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:03.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 >> v1:172.21.15.170:6800/17396 conn(0x7f121803e450 legacy=0x7f1218040960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:03.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 >> v1:172.21.15.170:6790/0 conn(0x7f12380a44c0 legacy=0x7f1238099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:03.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 shutdown_connections 2020-01-26T15:39:03.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 --2- 172.21.15.170:0/2066534965 >> v2:172.21.15.170:6791/0 conn(0x7f12380a3520 0x7f1238122160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:03.383 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 >> 172.21.15.170:0/2066534965 conn(0x7f123805c110 msgr2=0x7f1238097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:03.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 shutdown_connections 2020-01-26T15:39:03.384 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:03.384+0000 7f123c927700 1 -- 172.21.15.170:0/2066534965 wait complete. 2020-01-26T15:39:03.398 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:06.399 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:06.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc625ec6700 1 Processor -- start 2020-01-26T15:39:06.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc625ec6700 1 -- start start 2020-01-26T15:39:06.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc625ec6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc62005e5f0 0x7fc6200a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:06.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc625ec6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6200a6dc0 con 0x7fc62005edd0 2020-01-26T15:39:06.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc625ec6700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62005ea20 con 0x7fc620149040 2020-01-26T15:39:06.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc625ec6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc620098000 con 0x7fc62005e5f0 2020-01-26T15:39:06.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc6256c5700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fc62005edd0 0x7fc62007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49452/0 (socket says 172.21.15.170:49452) 2020-01-26T15:39:06.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc6256c5700 1 -- 172.21.15.170:0/2054017666 learned_addr learned my addr 172.21.15.170:0/2054017666 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc624ec4700 -1 --2- 172.21.15.170:0/2054017666 >> v2:172.21.15.170:6791/0 conn(0x7fc62005e5f0 0x7fc6200a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.516+0000 7fc624ec4700 1 --2- 172.21.15.170:0/2054017666 >> v2:172.21.15.170:6791/0 conn(0x7fc62005e5f0 0x7fc6200a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423779445 0 0) 0x7fc62005ea20 con 0x7fc620149040 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc60c003230 con 0x7fc620149040 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482026072 0 0) 0x7fc6200a6dc0 con 0x7fc62005edd0 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc62005ea20 con 0x7fc62005edd0 2020-01-26T15:39:06.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 59854219 0 0) 0x7fc60c003230 con 0x7fc620149040 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 >> v2:172.21.15.170:6791/0 conn(0x7fc62005e5f0 msgr2=0x7fc6200a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 --2- 172.21.15.170:0/2054017666 >> v2:172.21.15.170:6791/0 conn(0x7fc62005e5f0 0x7fc6200a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 >> v1:172.21.15.170:6790/0 conn(0x7fc62005edd0 legacy=0x7fc62007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62005e050 con 0x7fc620149040 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc618001710 con 0x7fc620149040 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc6180019e0 con 0x7fc620149040 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc617fff700 1 -- 172.21.15.170:0/2054017666 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc618001ec0 con 0x7fc620149040 2020-01-26T15:39:06.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc625ec6700 1 -- 172.21.15.170:0/2054017666 >> v1:172.21.15.170:6791/0 conn(0x7fc620149040 legacy=0x7fc62014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc625ec6700 1 -- 172.21.15.170:0/2054017666 shutdown_connections 2020-01-26T15:39:06.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc625ec6700 1 --2- 172.21.15.170:0/2054017666 >> v2:172.21.15.170:6791/0 conn(0x7fc62005e5f0 0x7fc6200a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:06.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc625ec6700 1 -- 172.21.15.170:0/2054017666 >> 172.21.15.170:0/2054017666 conn(0x7fc620098e70 msgr2=0x7fc6200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:06.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc625ec6700 1 -- 172.21.15.170:0/2054017666 shutdown_connections 2020-01-26T15:39:06.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.520+0000 7fc625ec6700 1 -- 172.21.15.170:0/2054017666 wait complete. 2020-01-26T15:39:06.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc625ec6700 1 Processor -- start 2020-01-26T15:39:06.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc625ec6700 1 -- start start 2020-01-26T15:39:06.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc625ec6700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc620137b50 0x7fc620139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:06.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc625ec6700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc620131900 con 0x7fc6201314d0 2020-01-26T15:39:06.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc625ec6700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc620121000 con 0x7fc620120bd0 2020-01-26T15:39:06.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc625ec6700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc6200991a0 con 0x7fc620137b50 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc624ec4700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fc620120bd0 0x7fc620024fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49460/0 (socket says 172.21.15.170:49460) 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc624ec4700 1 -- 172.21.15.170:0/1720154808 learned_addr learned my addr 172.21.15.170:0/1720154808 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc627128700 -1 --2- 172.21.15.170:0/1720154808 >> v2:172.21.15.170:6791/0 conn(0x7fc620137b50 0x7fc620139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc627128700 1 --2- 172.21.15.170:0/1720154808 >> v2:172.21.15.170:6791/0 conn(0x7fc620137b50 0x7fc620139f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089980830 0 0) 0x7fc620131900 con 0x7fc6201314d0 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc600003230 con 0x7fc6201314d0 2020-01-26T15:39:06.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922413836 0 0) 0x7fc620121000 con 0x7fc620120bd0 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc620131900 con 0x7fc620120bd0 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1688015798 0 0) 0x7fc600003230 con 0x7fc6201314d0 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc620121000 con 0x7fc6201314d0 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.524+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc61c001b10 con 0x7fc6201314d0 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 >> v2:172.21.15.170:6791/0 conn(0x7fc620137b50 msgr2=0x7fc620139f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 --2- 172.21.15.170:0/1720154808 >> v2:172.21.15.170:6791/0 conn(0x7fc620137b50 0x7fc620139f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 >> v1:172.21.15.170:6790/0 conn(0x7fc620120bd0 legacy=0x7fc620024fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 >> v1:172.21.15.170:6789/0 conn(0x7fc6201314d0 legacy=0x7fc6200247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc620131900 con 0x7fc60000a7f0 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc600003230 con 0x7fc6000050c0 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6200991a0 con 0x7fc600004c90 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595274801 0 0) 0x7fc620131900 con 0x7fc60000a7f0 2020-01-26T15:39:06.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc60000e440 con 0x7fc60000a7f0 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766487071 0 0) 0x7fc600003230 con 0x7fc6000050c0 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc620131900 con 0x7fc6000050c0 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 -- 172.21.15.170:0/1720154808 >> v1:172.21.15.170:6791/0 conn(0x7fc6000050c0 legacy=0x7fc600003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 -- 172.21.15.170:0/1720154808 >> v1:172.21.15.170:6790/0 conn(0x7fc60000a7f0 legacy=0x7fc60000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 -- 172.21.15.170:0/1720154808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6201207a0 con 0x7fc600004c90 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6200a11c0 con 0x7fc600004c90 2020-01-26T15:39:06.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc620120bd0 con 0x7fc600004c90 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc61c005cc0 con 0x7fc600004c90 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00e160 con 0x7fc600004c90 2020-01-26T15:39:06.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc61c00e5c0 con 0x7fc600004c90 2020-01-26T15:39:06.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.528+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.532+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8003360 con 0x7fc600004c90 2020-01-26T15:39:06.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.532+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc61c00e890 con 0x7fc600004c90 2020-01-26T15:39:06.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.532+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.532+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fc61c04dfb0 con 0x7fc600004c90 2020-01-26T15:39:06.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.536+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.536+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc61c0340e0 con 0x7fc600004c90 2020-01-26T15:39:06.689 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc5f8003790 con 0x7fc600004c90 2020-01-26T15:39:06.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc6256c5700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:06.690 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc615ffb700 1 -- 172.21.15.170:0/1720154808 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc61c034340 con 0x7fc600004c90 2020-01-26T15:39:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:06.691 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 >> v1:172.21.15.170:6800/17396 conn(0x7fc600048210 legacy=0x7fc60004a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 msgr2=0x7fc600003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc627128700 1 -- 172.21.15.170:0/1720154808 reap_dead start 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fc61c001440 tx=0x7fc61c011820).stop 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 shutdown_connections 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 --2- 172.21.15.170:0/1720154808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600004c90 0x7fc600003540 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 >> 172.21.15.170:0/1720154808 conn(0x7fc62007f500 msgr2=0x7fc62007e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:06.692 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 shutdown_connections 2020-01-26T15:39:06.693 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:06.692+0000 7fc625ec6700 1 -- 172.21.15.170:0/1720154808 wait complete. 2020-01-26T15:39:06.703 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:09.704 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:09.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 Processor -- start 2020-01-26T15:39:09.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 -- start start 2020-01-26T15:39:09.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1e9005edd0 0x7f1e9005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:09.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e90098000 con 0x7f1e900a6870 2020-01-26T15:39:09.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9005e050 con 0x7f1e90149040 2020-01-26T15:39:09.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1e900a6ca0 con 0x7f1e9005edd0 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96094700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1e900a6870 0x7f1e9007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52596/0 (socket says 172.21.15.170:52596) 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1e9005edd0 0x7f1e9005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96094700 1 -- 172.21.15.170:0/1484439415 learned_addr learned my addr 172.21.15.170:0/1484439415 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e982f8700 1 --1- 172.21.15.170:0/1484439415 >> v1:172.21.15.170:6791/0 conn(0x7f1e90149040 0x7f1e9014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44600/0 (socket says 172.21.15.170:44600) 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> v2:172.21.15.170:6791/0 conn(0x7f1e9005edd0 0x7f1e9005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538130251 0 0) 0x7f1e90098000 con 0x7f1e900a6870 2020-01-26T15:39:09.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e7c003230 con 0x7f1e900a6870 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546064455 0 0) 0x7f1e9005e050 con 0x7f1e90149040 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e90098000 con 0x7f1e90149040 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3750852694 0 0) 0x7f1e7c003230 con 0x7f1e900a6870 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 >> v2:172.21.15.170:6791/0 conn(0x7f1e9005edd0 msgr2=0x7f1e9005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 --2- 172.21.15.170:0/1484439415 >> v2:172.21.15.170:6791/0 conn(0x7f1e9005edd0 0x7f1e9005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 >> v1:172.21.15.170:6791/0 conn(0x7f1e90149040 legacy=0x7f1e9014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9014ecb0 con 0x7f1e900a6870 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1e88001710 con 0x7f1e900a6870 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 >> v1:172.21.15.170:6789/0 conn(0x7f1e900a6870 legacy=0x7f1e9007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1e7c003230 con 0x7f1e7c00a7f0 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1e9005e050 con 0x7f1e7c003540 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900a6ca0 con 0x7f1e7c004b20 2020-01-26T15:39:09.828 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796842889 0 0) 0x7f1e9005e050 con 0x7f1e7c003540 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e7c00e440 con 0x7f1e7c003540 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360801337 0 0) 0x7f1e7c003230 con 0x7f1e7c00a7f0 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 -- 172.21.15.170:0/1484439415 >> v1:172.21.15.170:6791/0 conn(0x7f1e7c003540 legacy=0x7f1e7c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 -- 172.21.15.170:0/1484439415 >> v1:172.21.15.170:6790/0 conn(0x7f1e7c00a7f0 legacy=0x7f1e7c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 -- 172.21.15.170:0/1484439415 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9014ecb0 con 0x7f1e7c004b20 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e80008c80 tx=0x7f1e800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:09.829 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e80008c80 tx=0x7f1e800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f1e80008c80 tx=0x7f1e800101e0).ready entity=mon.0 client_cookie=d956f2cad1637f1b server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f1e80008c80 tx=0x7f1e800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1e80010af0 con 0x7f1e7c004b20 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f1e80008c80 tx=0x7f1e800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e96895700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f1e80008c80 tx=0x7f1e800101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80010cf0 con 0x7f1e7c004b20 2020-01-26T15:39:09.830 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e95893700 1 -- 172.21.15.170:0/1484439415 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1e80011270 con 0x7f1e7c004b20 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 -- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 msgr2=0x7f1e7c004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e97096700 1 --2- 172.21.15.170:0/1484439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e7c004b20 0x7f1e7c004f70 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f1e80008c80 tx=0x7f1e800101e0).stop 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.824+0000 7f1e982f8700 1 -- 172.21.15.170:0/1484439415 reap_dead start 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- 172.21.15.170:0/1484439415 shutdown_connections 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- 172.21.15.170:0/1484439415 >> 172.21.15.170:0/1484439415 conn(0x7f1e90098e70 msgr2=0x7f1e900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- 172.21.15.170:0/1484439415 shutdown_connections 2020-01-26T15:39:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- 172.21.15.170:0/1484439415 wait complete. 2020-01-26T15:39:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 Processor -- start 2020-01-26T15:39:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- start start 2020-01-26T15:39:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1e90079c60 0x7f1e9007ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f1e9007ef90 0x7f1e900789a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e901209a0 con 0x7f1e90078ef0 2020-01-26T15:39:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9011e4b0 con 0x7f1e9007ef90 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e97096700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9011e750 con 0x7f1e90079c60 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e96895700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f1e90079c60 0x7f1e9007ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e982f8700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f1e90078ef0 0x7f1e901311e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49488/0 (socket says 172.21.15.170:49488) 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e982f8700 1 -- 172.21.15.170:0/2396595640 learned_addr learned my addr 172.21.15.170:0/2396595640 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e96094700 -1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6790/0 conn(0x7f1e9007ef90 0x7f1e900789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e96895700 1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6791/0 conn(0x7f1e90079c60 0x7f1e9007ea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.828+0000 7f1e96094700 1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6790/0 conn(0x7f1e9007ef90 0x7f1e900789a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:09.836 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541547242 0 0) 0x7f1e901209a0 con 0x7f1e90078ef0 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e74003230 con 0x7f1e90078ef0 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1563097034 0 0) 0x7f1e74003230 con 0x7f1e90078ef0 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e901209a0 con 0x7f1e90078ef0 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1e780018d0 con 0x7f1e90078ef0 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1295871465 0 0) 0x7f1e901209a0 con 0x7f1e90078ef0 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6791/0 conn(0x7f1e90079c60 msgr2=0x7f1e9007ea40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:09.837 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6791/0 conn(0x7f1e90079c60 0x7f1e9007ea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6790/0 conn(0x7f1e9007ef90 msgr2=0x7f1e900789a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6790/0 conn(0x7f1e9007ef90 0x7f1e900789a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9005bdd0 con 0x7f1e90078ef0 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9007a090 con 0x7f1e90078ef0 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e90122b50 con 0x7f1e90078ef0 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1e78001c60 con 0x7f1e90078ef0 2020-01-26T15:39:09.838 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1e78004950 con 0x7f1e90078ef0 2020-01-26T15:39:09.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68003360 con 0x7f1e90078ef0 2020-01-26T15:39:09.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f1e78010390 con 0x7f1e90078ef0 2020-01-26T15:39:09.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.832+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f1e7804b890 con 0x7f1e90078ef0 2020-01-26T15:39:09.839 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.840+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1e78030af0 con 0x7f1e90078ef0 2020-01-26T15:39:09.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.992+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e680037d0 con 0x7f1e90078ef0 2020-01-26T15:39:09.990 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.992+0000 7f1e8f7fe700 1 -- 172.21.15.170:0/2396595640 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f1e78030d50 con 0x7f1e90078ef0 2020-01-26T15:39:09.991 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:09.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 >> v1:172.21.15.170:6800/17396 conn(0x7f1e7403e040 legacy=0x7f1e74040550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 >> v1:172.21.15.170:6790/0 conn(0x7f1e90078ef0 legacy=0x7f1e901311e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:09.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 shutdown_connections 2020-01-26T15:39:09.992 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6791/0 conn(0x7f1e90079c60 0x7f1e9007ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:09.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 --2- 172.21.15.170:0/2396595640 >> v2:172.21.15.170:6790/0 conn(0x7f1e9007ef90 0x7f1e900789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:09.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 >> 172.21.15.170:0/2396595640 conn(0x7f1e9005c150 msgr2=0x7f1e900a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:09.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 shutdown_connections 2020-01-26T15:39:09.993 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:09.996+0000 7f1e97096700 1 -- 172.21.15.170:0/2396595640 wait complete. 2020-01-26T15:39:10.008 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:13.010 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:13.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 Processor -- start 2020-01-26T15:39:13.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- start start 2020-01-26T15:39:13.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f696805e5f0 0x7f69680a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:13.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69680a6dc0 con 0x7f6968149040 2020-01-26T15:39:13.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696805ea20 con 0x7f696805edd0 2020-01-26T15:39:13.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6968098000 con 0x7f696805e5f0 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f696805e5f0 0x7f69680a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696ec70700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f696805edd0 0x7f696807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49494/0 (socket says 172.21.15.170:49494) 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696ec70700 1 -- 172.21.15.170:0/295953571 learned_addr learned my addr 172.21.15.170:0/295953571 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> v2:172.21.15.170:6791/0 conn(0x7f696805e5f0 0x7f69680a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943176274 0 0) 0x7f69680a6dc0 con 0x7f6968149040 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6954003230 con 0x7f6968149040 2020-01-26T15:39:13.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773015955 0 0) 0x7f696805ea20 con 0x7f696805edd0 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69680a6dc0 con 0x7f696805edd0 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3071010886 0 0) 0x7f6954003230 con 0x7f6968149040 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 >> v2:172.21.15.170:6791/0 conn(0x7f696805e5f0 msgr2=0x7f69680a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 --2- 172.21.15.170:0/295953571 >> v2:172.21.15.170:6791/0 conn(0x7f696805e5f0 0x7f69680a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 >> v1:172.21.15.170:6790/0 conn(0x7f696805edd0 legacy=0x7f696807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696805e050 con 0x7f6968149040 2020-01-26T15:39:13.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6960001710 con 0x7f6968149040 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 >> v1:172.21.15.170:6789/0 conn(0x7f6968149040 legacy=0x7f696814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6954003230 con 0x7f695400a7f0 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f69680a6dc0 con 0x7f6954004b20 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6968098000 con 0x7f6954004f70 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 -- 172.21.15.170:0/295953571 >> v1:172.21.15.170:6791/0 conn(0x7f6954004b20 legacy=0x7f6954003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 -- 172.21.15.170:0/295953571 >> v1:172.21.15.170:6790/0 conn(0x7f695400a7f0 legacy=0x7f695400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 -- 172.21.15.170:0/295953571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540544d0 con 0x7f6954004f70 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6964008c80 tx=0x7f69640101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6964008c80 tx=0x7f69640101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f6964008c80 tx=0x7f69640101e0).ready entity=mon.0 client_cookie=997283b9f484aab5 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f6964008c80 tx=0x7f69640101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6964010af0 con 0x7f6954004f70 2020-01-26T15:39:13.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f6964008c80 tx=0x7f69640101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696e46f700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f6964008c80 tx=0x7f69640101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964010cf0 con 0x7f6954004f70 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696dc6e700 1 -- 172.21.15.170:0/295953571 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6964011270 con 0x7f6954004f70 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 msgr2=0x7f6954003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 --2- 172.21.15.170:0/295953571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6954004f70 0x7f6954003d40 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f6964008c80 tx=0x7f69640101e0).stop 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f69706d3700 1 -- 172.21.15.170:0/295953571 reap_dead start 2020-01-26T15:39:13.134 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- 172.21.15.170:0/295953571 shutdown_connections 2020-01-26T15:39:13.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.127+0000 7f696f471700 1 -- 172.21.15.170:0/295953571 >> 172.21.15.170:0/295953571 conn(0x7f6968098e70 msgr2=0x7f69680a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:13.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 -- 172.21.15.170:0/295953571 shutdown_connections 2020-01-26T15:39:13.135 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 -- 172.21.15.170:0/295953571 wait complete. 2020-01-26T15:39:13.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 Processor -- start 2020-01-26T15:39:13.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 -- start start 2020-01-26T15:39:13.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f696807dc00 0x7f696809db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:13.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696809d4c0 con 0x7f696809bb40 2020-01-26T15:39:13.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6968065890 con 0x7f6968135960 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696f471700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f69680971e0 con 0x7f696807dc00 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696ec70700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f696807dc00 0x7f696809db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696ec70700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f696807dc00 0x7f696809db60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f69706d3700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f6968135960 0x7f6968137da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44636/0 (socket says 172.21.15.170:44636) 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f69706d3700 1 -- 172.21.15.170:0/1069365669 learned_addr learned my addr 172.21.15.170:0/1069365669 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f696e46f700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f696809bb40 0x7f696809bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52632/0 (socket says 172.21.15.170:52632) 2020-01-26T15:39:13.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377026669 0 0) 0x7f696809d4c0 con 0x7f696809bb40 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6950003230 con 0x7f696809bb40 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780038929 0 0) 0x7f6968065890 con 0x7f6968135960 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f696809d4c0 con 0x7f6968135960 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 112328784 0 0) 0x7f6950003230 con 0x7f696809bb40 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6968065890 con 0x7f696809bb40 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.131+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6964008a00 con 0x7f696809bb40 2020-01-26T15:39:13.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 >> v2:172.21.15.170:6791/0 conn(0x7f696807dc00 msgr2=0x7f696809db60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 --2- 172.21.15.170:0/1069365669 >> v2:172.21.15.170:6791/0 conn(0x7f696807dc00 0x7f696809db60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 >> v1:172.21.15.170:6791/0 conn(0x7f6968135960 legacy=0x7f6968137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 >> v1:172.21.15.170:6789/0 conn(0x7f696809bb40 legacy=0x7f696809bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f696809d4c0 con 0x7f69500050c0 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6950003230 con 0x7f695000a7f0 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69680971e0 con 0x7f6950004c90 2020-01-26T15:39:13.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773250136 0 0) 0x7f696809d4c0 con 0x7f69500050c0 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f695000e440 con 0x7f69500050c0 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024717928 0 0) 0x7f6950003230 con 0x7f695000a7f0 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 -- 172.21.15.170:0/1069365669 >> v1:172.21.15.170:6791/0 conn(0x7f695000a7f0 legacy=0x7f695000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 -- 172.21.15.170:0/1069365669 >> v1:172.21.15.170:6790/0 conn(0x7f69500050c0 legacy=0x7f6950003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 -- 172.21.15.170:0/1069365669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696807f5b0 con 0x7f6950004c90 2020-01-26T15:39:13.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696809d060 con 0x7f6950004c90 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696809e0b0 con 0x7f6950004c90 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f695c00cae0 con 0x7f6950004c90 2020-01-26T15:39:13.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00cce0 con 0x7f6950004c90 2020-01-26T15:39:13.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f695c004760 con 0x7f6950004c90 2020-01-26T15:39:13.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6968056600 con 0x7f6950004c90 2020-01-26T15:39:13.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f695c0049f0 con 0x7f6950004c90 2020-01-26T15:39:13.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.135+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f695c04d090 con 0x7f6950004c90 2020-01-26T15:39:13.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.143+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.146 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.143+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f695c013060 con 0x7f6950004c90 2020-01-26T15:39:13.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f696805cc60 con 0x7f6950004c90 2020-01-26T15:39:13.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696ec70700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:13.361 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f695b7fe700 1 -- 172.21.15.170:0/1069365669 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f695c0334a0 con 0x7f6950004c90 2020-01-26T15:39:13.362 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 >> v1:172.21.15.170:6800/17396 conn(0x7f6950048140 legacy=0x7f695004a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 msgr2=0x7f6950003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f69706d3700 1 -- 172.21.15.170:0/1069365669 reap_dead start 2020-01-26T15:39:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f695c000e50 tx=0x7f695c00c5a0).stop 2020-01-26T15:39:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 shutdown_connections 2020-01-26T15:39:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 --2- 172.21.15.170:0/1069365669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6950004c90 0x7f6950003540 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 >> 172.21.15.170:0/1069365669 conn(0x7f696805edd0 msgr2=0x7f69680a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 shutdown_connections 2020-01-26T15:39:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:13.363+0000 7f696f471700 1 -- 172.21.15.170:0/1069365669 wait complete. 2020-01-26T15:39:13.374 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:16.375 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:16.501 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.498+0000 7f8d6b816700 1 Processor -- start 2020-01-26T15:39:16.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.498+0000 7f8d6b816700 1 -- start start 2020-01-26T15:39:16.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d6414a880 0x7f8d6414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:16.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d640a5b80 con 0x7f8d640a5750 2020-01-26T15:39:16.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64080440 con 0x7f8d64146c30 2020-01-26T15:39:16.502 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8d640a43f0 con 0x7f8d6414a880 2020-01-26T15:39:16.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f8d64146c30 0x7f8d64149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44646/0 (socket says 172.21.15.170:44646) 2020-01-26T15:39:16.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 -- 172.21.15.170:0/1691386274 learned_addr learned my addr 172.21.15.170:0/1691386274 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:16.503 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6a5b4700 -1 --2- 172.21.15.170:0/1691386274 >> v2:172.21.15.170:6790/0 conn(0x7f8d6414a880 0x7f8d6414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:16.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/1691386274 >> v2:172.21.15.170:6790/0 conn(0x7f8d6414a880 0x7f8d6414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:16.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834274207 0 0) 0x7f8d640a5b80 con 0x7f8d640a5750 2020-01-26T15:39:16.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d50003230 con 0x7f8d640a5750 2020-01-26T15:39:16.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831767523 0 0) 0x7f8d64080440 con 0x7f8d64146c30 2020-01-26T15:39:16.504 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d640a5b80 con 0x7f8d64146c30 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2831777018 0 0) 0x7f8d50003230 con 0x7f8d640a5750 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 >> v2:172.21.15.170:6790/0 conn(0x7f8d6414a880 msgr2=0x7f8d6414ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 --2- 172.21.15.170:0/1691386274 >> v2:172.21.15.170:6790/0 conn(0x7f8d6414a880 0x7f8d6414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 >> v1:172.21.15.170:6791/0 conn(0x7f8d64146c30 legacy=0x7f8d64149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640a4e00 con 0x7f8d640a5750 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8d5c001710 con 0x7f8d640a5750 2020-01-26T15:39:16.505 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 >> v1:172.21.15.170:6789/0 conn(0x7f8d640a5750 legacy=0x7f8d640a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8d50003230 con 0x7f8d50004b20 2020-01-26T15:39:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8d640a5b80 con 0x7f8d5000a7f0 2020-01-26T15:39:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640a43f0 con 0x7f8d50004f70 2020-01-26T15:39:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:16.506 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327444587 0 0) 0x7f8d640a5b80 con 0x7f8d5000a7f0 2020-01-26T15:39:16.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d64080440 con 0x7f8d5000a7f0 2020-01-26T15:39:16.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291836533 0 0) 0x7f8d50003230 con 0x7f8d50004b20 2020-01-26T15:39:16.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d640a5b80 con 0x7f8d50004b20 2020-01-26T15:39:16.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 -- 172.21.15.170:0/1691386274 >> v1:172.21.15.170:6791/0 conn(0x7f8d5000a7f0 legacy=0x7f8d5000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 65351923 0 0) 0x7f8d64080440 con 0x7f8d5000a7f0 2020-01-26T15:39:16.507 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 -- 172.21.15.170:0/1691386274 >> v1:172.21.15.170:6790/0 conn(0x7f8d50004b20 legacy=0x7f8d50003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 -- 172.21.15.170:0/1691386274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500544d0 con 0x7f8d50004f70 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).ready entity=mon.0 client_cookie=78d3c9ac4d6d558c server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8d4c001400 con 0x7f8d50004f70 2020-01-26T15:39:16.508 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d695b2700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5400cc40 con 0x7f8d50004f70 2020-01-26T15:39:16.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d68db1700 1 -- 172.21.15.170:0/1691386274 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8d540112d0 con 0x7f8d50004f70 2020-01-26T15:39:16.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 msgr2=0x7f8d50003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.509 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 --2- 172.21.15.170:0/1691386274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d50004f70 0x7f8d50003d40 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f8d4c001210 tx=0x7f8d5400c5f0).stop 2020-01-26T15:39:16.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6a5b4700 1 -- 172.21.15.170:0/1691386274 reap_dead start 2020-01-26T15:39:16.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- 172.21.15.170:0/1691386274 shutdown_connections 2020-01-26T15:39:16.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- 172.21.15.170:0/1691386274 >> 172.21.15.170:0/1691386274 conn(0x7f8d6405e050 msgr2=0x7f8d64098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:16.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- 172.21.15.170:0/1691386274 shutdown_connections 2020-01-26T15:39:16.510 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.502+0000 7f8d6b816700 1 -- 172.21.15.170:0/1691386274 wait complete. 2020-01-26T15:39:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 Processor -- start 2020-01-26T15:39:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 -- start start 2020-01-26T15:39:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d64060e20 0x7f8d6412cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8d64062170 0x7f8d640628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64062e40 con 0x7f8d6412a190 2020-01-26T15:39:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6412d310 con 0x7f8d64060e20 2020-01-26T15:39:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6b816700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8d64120ce0 con 0x7f8d64062170 2020-01-26T15:39:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d695b2700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8d64062170 0x7f8d640628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d69db3700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d64060e20 0x7f8d6412cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d69db3700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d64060e20 0x7f8d6412cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6a5b4700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8d6412a190 0x7f8d64130120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52658/0 (socket says 172.21.15.170:52658) 2020-01-26T15:39:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6a5b4700 1 -- 172.21.15.170:0/451762296 learned_addr learned my addr 172.21.15.170:0/451762296 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d695b2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8d64062170 0x7f8d640628f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449383647 0 0) 0x7f8d64062e40 con 0x7f8d6412a190 2020-01-26T15:39:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d48003230 con 0x7f8d6412a190 2020-01-26T15:39:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1057583415 0 0) 0x7f8d48003230 con 0x7f8d6412a190 2020-01-26T15:39:16.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d64062e40 con 0x7f8d6412a190 2020-01-26T15:39:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8d4c000e90 con 0x7f8d6412a190 2020-01-26T15:39:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 >> v2:172.21.15.170:6791/0 conn(0x7f8d64062170 msgr2=0x7f8d640628f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 --2- 172.21.15.170:0/451762296 >> v2:172.21.15.170:6791/0 conn(0x7f8d64062170 0x7f8d640628f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 >> v2:172.21.15.170:6790/0 conn(0x7f8d64060e20 msgr2=0x7f8d6412cbe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 --2- 172.21.15.170:0/451762296 >> v2:172.21.15.170:6790/0 conn(0x7f8d64060e20 0x7f8d6412cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 >> v1:172.21.15.170:6789/0 conn(0x7f8d6412a190 legacy=0x7f8d64130120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8d48003230 con 0x7f8d48003a20 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8d480114a0 con 0x7f8d48003f40 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6412d310 con 0x7f8d4800da10 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670461091 0 0) 0x7f8d480114a0 con 0x7f8d48003f40 2020-01-26T15:39:16.532 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d48010490 con 0x7f8d48003f40 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487387262 0 0) 0x7f8d48003230 con 0x7f8d48003a20 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.506+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d480114a0 con 0x7f8d48003a20 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 -- 172.21.15.170:0/451762296 >> v1:172.21.15.170:6791/0 conn(0x7f8d48003f40 legacy=0x7f8d48004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 -- 172.21.15.170:0/451762296 >> v1:172.21.15.170:6790/0 conn(0x7f8d48003a20 legacy=0x7f8d480045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 -- 172.21.15.170:0/451762296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64060260 con 0x7f8d4800da10 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d640625a0 con 0x7f8d4800da10 2020-01-26T15:39:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6412a5c0 con 0x7f8d4800da10 2020-01-26T15:39:16.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 -- 172.21.15.170:0/451762296 reap_dead start 2020-01-26T15:39:16.534 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:16.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d64056600 con 0x7f8d4800da10 2020-01-26T15:39:16.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.535 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8d4c011990 con 0x7f8d4800da10 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c011b90 con 0x7f8d4800da10 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8d4c00c8a0 con 0x7f8d4800da10 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8d4c00caa0 con 0x7f8d4800da10 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.510+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f8d4c04d690 con 0x7f8d4800da10 2020-01-26T15:39:16.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.518+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.537 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.518+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8d4c0337e0 con 0x7f8d4800da10 2020-01-26T15:39:16.668 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.670+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8d6405cc60 con 0x7f8d4800da10 2020-01-26T15:39:16.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.670+0000 7f8d6a5b4700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:16.669 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.670+0000 7f8d627fc700 1 -- 172.21.15.170:0/451762296 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8d4c033a40 con 0x7f8d4800da10 2020-01-26T15:39:16.669 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:16.671 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 >> v1:172.21.15.170:6800/17396 conn(0x7f8d48042e00 legacy=0x7f8d48045310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 msgr2=0x7f8d4800fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:16.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f8d4c002b80 tx=0x7f8d4c011340).stop 2020-01-26T15:39:16.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 shutdown_connections 2020-01-26T15:39:16.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 --2- 172.21.15.170:0/451762296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d4800da10 0x7f8d4800fe70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:16.672 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 >> 172.21.15.170:0/451762296 conn(0x7f8d640a6ea0 msgr2=0x7f8d640a1200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:16.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 shutdown_connections 2020-01-26T15:39:16.673 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:16.674+0000 7f8d6b816700 1 -- 172.21.15.170:0/451762296 wait complete. 2020-01-26T15:39:16.681 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:19.683 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:19.806 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.801+0000 7f4f248e2700 1 Processor -- start 2020-01-26T15:39:19.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.801+0000 7f4f248e2700 1 -- start start 2020-01-26T15:39:19.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2005ea20 con 0x7f4f200a6870 2020-01-26T15:39:19.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f20098000 con 0x7f4f2005e5f0 2020-01-26T15:39:19.807 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2005e050 con 0x7f4f2005edd0 2020-01-26T15:39:19.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1f59e700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f4f2005edd0 0x7f4f2007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44672/0 (socket says 172.21.15.170:44672) 2020-01-26T15:39:19.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1f59e700 1 -- 172.21.15.170:0/455258100 learned_addr learned my addr 172.21.15.170:0/455258100 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:19.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152048493 0 0) 0x7f4f2005e050 con 0x7f4f2005edd0 2020-01-26T15:39:19.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f08003230 con 0x7f4f2005edd0 2020-01-26T15:39:19.808 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221386535 0 0) 0x7f4f20098000 con 0x7f4f2005e5f0 2020-01-26T15:39:19.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f2005e050 con 0x7f4f2005e5f0 2020-01-26T15:39:19.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869226209 0 0) 0x7f4f2005ea20 con 0x7f4f200a6870 2020-01-26T15:39:19.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f20098000 con 0x7f4f200a6870 2020-01-26T15:39:19.809 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1658892290 0 0) 0x7f4f08003230 con 0x7f4f2005edd0 2020-01-26T15:39:19.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 >> v1:172.21.15.170:6790/0 conn(0x7f4f2005e5f0 legacy=0x7f4f20149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:19.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 >> v1:172.21.15.170:6789/0 conn(0x7f4f200a6870 legacy=0x7f4f2014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:19.810 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200a6ca0 con 0x7f4f2005edd0 2020-01-26T15:39:19.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4f18001a90 con 0x7f4f2005edd0 2020-01-26T15:39:19.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4f18001d60 con 0x7f4f2005edd0 2020-01-26T15:39:19.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f1e59c700 1 -- 172.21.15.170:0/455258100 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4f18004930 con 0x7f4f2005edd0 2020-01-26T15:39:19.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- 172.21.15.170:0/455258100 >> v1:172.21.15.170:6791/0 conn(0x7f4f2005edd0 legacy=0x7f4f2007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:19.811 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- 172.21.15.170:0/455258100 shutdown_connections 2020-01-26T15:39:19.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- 172.21.15.170:0/455258100 >> 172.21.15.170:0/455258100 conn(0x7f4f20098e70 msgr2=0x7f4f200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:19.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- 172.21.15.170:0/455258100 shutdown_connections 2020-01-26T15:39:19.812 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.805+0000 7f4f248e2700 1 -- 172.21.15.170:0/455258100 wait complete. 2020-01-26T15:39:19.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f248e2700 1 Processor -- start 2020-01-26T15:39:19.816 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f248e2700 1 -- start start 2020-01-26T15:39:19.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f248e2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f4f2013ffd0 0x7f4f201539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:19.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f248e2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2007c160 con 0x7f4f20140400 2020-01-26T15:39:19.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f248e2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2007b1d0 con 0x7f4f20153ef0 2020-01-26T15:39:19.817 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f248e2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4f200a1160 con 0x7f4f2013ffd0 2020-01-26T15:39:19.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f1f59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f4f2013ffd0 0x7f4f201539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:19.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f1f59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f4f2013ffd0 0x7f4f201539a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:19.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f1ed9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f4f20140400 0x7f4f20144170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49554/0 (socket says 172.21.15.170:49554) 2020-01-26T15:39:19.818 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f1ed9d700 1 -- 172.21.15.170:0/1667189127 learned_addr learned my addr 172.21.15.170:0/1667189127 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:19.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732662499 0 0) 0x7f4f2007c160 con 0x7f4f20140400 2020-01-26T15:39:19.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f00003230 con 0x7f4f20140400 2020-01-26T15:39:19.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321603869 0 0) 0x7f4f2007b1d0 con 0x7f4f20153ef0 2020-01-26T15:39:19.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f2007c160 con 0x7f4f20153ef0 2020-01-26T15:39:19.819 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 610080053 0 0) 0x7f4f00003230 con 0x7f4f20140400 2020-01-26T15:39:19.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.809+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f2007b1d0 con 0x7f4f20140400 2020-01-26T15:39:19.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4f14001990 con 0x7f4f20140400 2020-01-26T15:39:19.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3999811301 0 0) 0x7f4f2007c160 con 0x7f4f20153ef0 2020-01-26T15:39:19.820 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f00003230 con 0x7f4f20153ef0 2020-01-26T15:39:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4f100018f0 con 0x7f4f20153ef0 2020-01-26T15:39:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1884386779 0 0) 0x7f4f2007b1d0 con 0x7f4f20140400 2020-01-26T15:39:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 >> v2:172.21.15.170:6791/0 conn(0x7f4f2013ffd0 msgr2=0x7f4f201539a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 --2- 172.21.15.170:0/1667189127 >> v2:172.21.15.170:6791/0 conn(0x7f4f2013ffd0 0x7f4f201539a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 >> v1:172.21.15.170:6791/0 conn(0x7f4f20153ef0 legacy=0x7f4f20144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200a3fe0 con 0x7f4f20140400 2020-01-26T15:39:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f20154320 con 0x7f4f20140400 2020-01-26T15:39:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f20141070 con 0x7f4f20140400 2020-01-26T15:39:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4f14002010 con 0x7f4f20140400 2020-01-26T15:39:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4f14002430 con 0x7f4f20140400 2020-01-26T15:39:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f4f14002630 con 0x7f4f20140400 2020-01-26T15:39:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f20056600 con 0x7f4f20140400 2020-01-26T15:39:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.813+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f4f1404ba50 con 0x7f4f20140400 2020-01-26T15:39:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.817+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f4f14030f50 con 0x7f4f20140400 2020-01-26T15:39:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.969+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f2007bed0 con 0x7f4f20140400 2020-01-26T15:39:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.969+0000 7f4f07fff700 1 -- 172.21.15.170:0/1667189127 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f4f1404a6a0 con 0x7f4f20140400 2020-01-26T15:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 >> v1:172.21.15.170:6800/17396 conn(0x7f4f0003e490 legacy=0x7f4f000409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 >> v1:172.21.15.170:6790/0 conn(0x7f4f20140400 legacy=0x7f4f20144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 shutdown_connections 2020-01-26T15:39:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 --2- 172.21.15.170:0/1667189127 >> v2:172.21.15.170:6791/0 conn(0x7f4f2013ffd0 0x7f4f201539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 >> 172.21.15.170:0/1667189127 conn(0x7f4f200a7870 msgr2=0x7f4f2007dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 shutdown_connections 2020-01-26T15:39:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:19.973+0000 7f4f248e2700 1 -- 172.21.15.170:0/1667189127 wait complete. 2020-01-26T15:39:19.981 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:22.982 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:23.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 Processor -- start 2020-01-26T15:39:23.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- start start 2020-01-26T15:39:23.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f45d405edd0 0x7f45d405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:23.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4098000 con 0x7f45d40a6870 2020-01-26T15:39:23.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d405e050 con 0x7f45d4149040 2020-01-26T15:39:23.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f45d40a6ca0 con 0x7f45d405edd0 2020-01-26T15:39:23.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9564700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f45d405edd0 0x7f45d405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:23.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45dafc7700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f45d4149040 0x7f45d414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44688/0 (socket says 172.21.15.170:44688) 2020-01-26T15:39:23.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d8d63700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f45d40a6870 0x7f45d407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52688/0 (socket says 172.21.15.170:52688) 2020-01-26T15:39:23.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9564700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f45d405edd0 0x7f45d405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45dafc7700 1 -- 172.21.15.170:0/56487426 learned_addr learned my addr 172.21.15.170:0/56487426 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544140921 0 0) 0x7f45d405e050 con 0x7f45d4149040 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c0003230 con 0x7f45d4149040 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557189379 0 0) 0x7f45d4098000 con 0x7f45d40a6870 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d405e050 con 0x7f45d40a6870 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2783799961 0 0) 0x7f45c0003230 con 0x7f45d4149040 2020-01-26T15:39:23.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 >> v2:172.21.15.170:6790/0 conn(0x7f45d405edd0 msgr2=0x7f45d405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 --2- 172.21.15.170:0/56487426 >> v2:172.21.15.170:6790/0 conn(0x7f45d405edd0 0x7f45d405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 >> v1:172.21.15.170:6789/0 conn(0x7f45d40a6870 legacy=0x7f45d407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d414ecb0 con 0x7f45d4149040 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f45cc001a90 con 0x7f45d4149040 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f45cc001d60 con 0x7f45d4149040 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45cbfff700 1 -- 172.21.15.170:0/56487426 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f45cc004930 con 0x7f45d4149040 2020-01-26T15:39:23.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- 172.21.15.170:0/56487426 >> v1:172.21.15.170:6791/0 conn(0x7f45d4149040 legacy=0x7f45d414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- 172.21.15.170:0/56487426 shutdown_connections 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 --2- 172.21.15.170:0/56487426 >> v2:172.21.15.170:6790/0 conn(0x7f45d405edd0 0x7f45d405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- 172.21.15.170:0/56487426 >> 172.21.15.170:0/56487426 conn(0x7f45d4098e70 msgr2=0x7f45d40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- 172.21.15.170:0/56487426 shutdown_connections 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.101+0000 7f45d9d65700 1 -- 172.21.15.170:0/56487426 wait complete. 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 Processor -- start 2020-01-26T15:39:23.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 -- start start 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4122ff0 con 0x7f45d4122bc0 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4070a50 con 0x7f45d4122790 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d40a1340 con 0x7f45d4122110 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45dafc7700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f45d4122bc0 0x7f45d407d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52692/0 (socket says 172.21.15.170:52692) 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9564700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f45d4122110 0x7f45d406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44692/0 (socket says 172.21.15.170:44692) 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45dafc7700 1 -- 172.21.15.170:0/1980517228 learned_addr learned my addr 172.21.15.170:0/1980517228 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:23.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928016204 0 0) 0x7f45d4122ff0 con 0x7f45d4122bc0 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003230 con 0x7f45d4122bc0 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390362378 0 0) 0x7f45d4070a50 con 0x7f45d4122790 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d4122ff0 con 0x7f45d4122790 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042177892 0 0) 0x7f45d40a1340 con 0x7f45d4122110 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d4070a50 con 0x7f45d4122110 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3380655688 0 0) 0x7f45d4122ff0 con 0x7f45d4122790 2020-01-26T15:39:23.112 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45d40a1340 con 0x7f45d4122790 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f45c4001850 con 0x7f45d4122790 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 432128654 0 0) 0x7f45d40a1340 con 0x7f45d4122790 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 >> v1:172.21.15.170:6791/0 conn(0x7f45d4122110 legacy=0x7f45d406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 >> v1:172.21.15.170:6789/0 conn(0x7f45d4122bc0 legacy=0x7f45d407d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d413d920 con 0x7f45d4122790 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d413a8f0 con 0x7f45d4122790 2020-01-26T15:39:23.113 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d413ae40 con 0x7f45d4122790 2020-01-26T15:39:23.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f45c40044f0 con 0x7f45d4122790 2020-01-26T15:39:23.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.105+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f45c4004950 con 0x7f45d4122790 2020-01-26T15:39:23.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.109+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f45c4004bd0 con 0x7f45d4122790 2020-01-26T15:39:23.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.109+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac003360 con 0x7f45d4122790 2020-01-26T15:39:23.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.109+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f45c404b990 con 0x7f45d4122790 2020-01-26T15:39:23.114 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.113+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f45c4030eb0 con 0x7f45d4122790 2020-01-26T15:39:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f45ac0037d0 con 0x7f45d4122790 2020-01-26T15:39:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45c9ffb700 1 -- 172.21.15.170:0/1980517228 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f45c404a5a0 con 0x7f45d4122790 2020-01-26T15:39:23.264 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 >> v1:172.21.15.170:6800/17396 conn(0x7f45b403e4a0 legacy=0x7f45b40409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 >> v1:172.21.15.170:6790/0 conn(0x7f45d4122790 legacy=0x7f45d407c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 shutdown_connections 2020-01-26T15:39:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 >> 172.21.15.170:0/1980517228 conn(0x7f45d405c180 msgr2=0x7f45d40a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 shutdown_connections 2020-01-26T15:39:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:23.265+0000 7f45d9d65700 1 -- 172.21.15.170:0/1980517228 wait complete. 2020-01-26T15:39:23.278 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:26.279 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:26.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 Processor -- start 2020-01-26T15:39:26.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 -- start start 2020-01-26T15:39:26.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f59dc05edd0 0x7f59dc05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f59dc149040 0x7f59dc14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc098000 con 0x7f59dc0a6870 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc05e050 con 0x7f59dc05edd0 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e0dd5700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0a6ca0 con 0x7f59dc149040 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59dbfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f59dc05edd0 0x7f59dc05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59dbfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f59dc05edd0 0x7f59dc05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:26.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e2037700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f59dc149040 0x7f59dc14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59e2037700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f59dc149040 0x7f59dc14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59db7fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f59dc0a6870 0x7f59dc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52700/0 (socket says 172.21.15.170:52700) 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59db7fe700 1 -- 172.21.15.170:0/1450284420 learned_addr learned my addr 172.21.15.170:0/1450284420 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109404186 0 0) 0x7f59dc098000 con 0x7f59dc0a6870 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.396+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c8003230 con 0x7f59dc0a6870 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 827441871 0 0) 0x7f59c8003230 con 0x7f59dc0a6870 2020-01-26T15:39:26.417 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 >> v2:172.21.15.170:6791/0 conn(0x7f59dc149040 msgr2=0x7f59dc14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 --2- 172.21.15.170:0/1450284420 >> v2:172.21.15.170:6791/0 conn(0x7f59dc149040 0x7f59dc14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 >> v2:172.21.15.170:6790/0 conn(0x7f59dc05edd0 msgr2=0x7f59dc05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 --2- 172.21.15.170:0/1450284420 >> v2:172.21.15.170:6790/0 conn(0x7f59dc05edd0 0x7f59dc05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc14c9e0 con 0x7f59dc0a6870 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f59c4001710 con 0x7f59dc0a6870 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 >> v1:172.21.15.170:6789/0 conn(0x7f59dc0a6870 legacy=0x7f59dc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:26.418 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f59c8003230 con 0x7f59c8003860 2020-01-26T15:39:26.419 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f59dc098000 con 0x7f59c80077d0 2020-01-26T15:39:26.419 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc05e050 con 0x7f59c800b5a0 2020-01-26T15:39:26.419 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:26.419 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454367681 0 0) 0x7f59dc098000 con 0x7f59c80077d0 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c800e2d0 con 0x7f59c80077d0 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 -- 172.21.15.170:0/1450284420 >> v1:172.21.15.170:6791/0 conn(0x7f59c80077d0 legacy=0x7f59c8009ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2077234444 0 0) 0x7f59c800e2d0 con 0x7f59c80077d0 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 -- 172.21.15.170:0/1450284420 >> v1:172.21.15.170:6790/0 conn(0x7f59c8003860 legacy=0x7f59c8003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 -- 172.21.15.170:0/1450284420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8054460 con 0x7f59c800b5a0 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59cc000f20 tx=0x7f59cc005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 -- 172.21.15.170:0/1450284420 reap_dead start 2020-01-26T15:39:26.420 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59cc000f20 tx=0x7f59cc005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.421 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f59cc000f20 tx=0x7f59cc005620).ready entity=mon.0 client_cookie=805a0e312f4d7c5d server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:26.421 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f59cc000f20 tx=0x7f59cc005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.421 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f59c4004760 con 0x7f59c800b5a0 2020-01-26T15:39:26.421 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f59cc000f20 tx=0x7f59cc005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.421 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e2037700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f59cc000f20 tx=0x7f59cc005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.421 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4005bd0 con 0x7f59c800b5a0 2020-01-26T15:39:26.422 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59daffd700 1 -- 172.21.15.170:0/1450284420 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f59d4010950 con 0x7f59c800b5a0 2020-01-26T15:39:26.422 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 -- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 msgr2=0x7f59c800dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.422 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f59cc000f20 tx=0x7f59cc005620).stop 2020-01-26T15:39:26.422 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 -- 172.21.15.170:0/1450284420 shutdown_connections 2020-01-26T15:39:26.422 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 --2- 172.21.15.170:0/1450284420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c800b5a0 0x7f59c800dab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:26.422 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 -- 172.21.15.170:0/1450284420 >> 172.21.15.170:0/1450284420 conn(0x7f59dc098e70 msgr2=0x7f59dc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 -- 172.21.15.170:0/1450284420 shutdown_connections 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.400+0000 7f59e0dd5700 1 -- 172.21.15.170:0/1450284420 wait complete. 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 Processor -- start 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 -- start start 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f59dc11ed60 0x7f59dc1201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0a6f30 con 0x7f59dc12dae0 2020-01-26T15:39:26.423 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc07a3e0 con 0x7f59dc12d6b0 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0a3fe0 con 0x7f59dc11ed60 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59dbfff700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f59dc11ed60 0x7f59dc1201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f59dc12dae0 0x7f59dc1380c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52712/0 (socket says 172.21.15.170:52712) 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 -- 172.21.15.170:0/3950888168 learned_addr learned my addr 172.21.15.170:0/3950888168 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59dbfff700 1 --2- 172.21.15.170:0/3950888168 >> v2:172.21.15.170:6790/0 conn(0x7f59dc11ed60 0x7f59dc1201e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133586928 0 0) 0x7f59dc0a6f30 con 0x7f59dc12dae0 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c0003230 con 0x7f59dc12dae0 2020-01-26T15:39:26.424 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357247710 0 0) 0x7f59dc07a3e0 con 0x7f59dc12d6b0 2020-01-26T15:39:26.425 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59dc0a6f30 con 0x7f59dc12d6b0 2020-01-26T15:39:26.425 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4050232001 0 0) 0x7f59c0003230 con 0x7f59dc12dae0 2020-01-26T15:39:26.425 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59dc07a3e0 con 0x7f59dc12dae0 2020-01-26T15:39:26.425 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f59d4010950 con 0x7f59dc12dae0 2020-01-26T15:39:26.425 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 >> v2:172.21.15.170:6790/0 conn(0x7f59dc11ed60 msgr2=0x7f59dc1201e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:26.425 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 --2- 172.21.15.170:0/3950888168 >> v2:172.21.15.170:6790/0 conn(0x7f59dc11ed60 0x7f59dc1201e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:26.426 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 >> v1:172.21.15.170:6790/0 conn(0x7f59dc12d6b0 legacy=0x7f59dc079be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.426 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 >> v1:172.21.15.170:6789/0 conn(0x7f59dc12dae0 legacy=0x7f59dc1380c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.426 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:26.426 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f59dc0a6f30 con 0x7f59c00040a0 2020-01-26T15:39:26.426 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f59c0003230 con 0x7f59c0003c10 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0a3fe0 con 0x7f59c000b860 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535994277 0 0) 0x7f59c0003230 con 0x7f59c0003c10 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c000e320 con 0x7f59c0003c10 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 -- 172.21.15.170:0/3950888168 >> v1:172.21.15.170:6791/0 conn(0x7f59c0003c10 legacy=0x7f59c00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 -- 172.21.15.170:0/3950888168 >> v1:172.21.15.170:6790/0 conn(0x7f59c00040a0 legacy=0x7f59c0004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 -- 172.21.15.170:0/3950888168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0a1270 con 0x7f59c000b860 2020-01-26T15:39:26.427 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc0a4e30 con 0x7f59c000b860 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc12d6b0 con 0x7f59c000b860 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.404+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f59d4011630 con 0x7f59c000b860 2020-01-26T15:39:26.428 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.429 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.429 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4011830 con 0x7f59c000b860 2020-01-26T15:39:26.429 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f59d4011c50 con 0x7f59c000b860 2020-01-26T15:39:26.429 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b4003360 con 0x7f59c000b860 2020-01-26T15:39:26.429 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.430 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f59d400a240 con 0x7f59c000b860 2020-01-26T15:39:26.430 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.430 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.408+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f59d404dfa0 con 0x7f59c000b860 2020-01-26T15:39:26.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.412+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.412+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f59dc0a4e30 con 0x7f59c000b860 2020-01-26T15:39:26.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.572+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f59b40036b0 con 0x7f59c000b860 2020-01-26T15:39:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.572+0000 7f59e2037700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:26.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.572+0000 7f59d8ff9700 1 -- 172.21.15.170:0/3950888168 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f59d4034390 con 0x7f59c000b860 2020-01-26T15:39:26.575 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:26.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 >> v1:172.21.15.170:6800/17396 conn(0x7f59c00481d0 legacy=0x7f59c004a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 msgr2=0x7f59c000dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:26.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 --2- 172.21.15.170:0/3950888168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c000b860 0x7f59c000dd50 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f59d40032f0 tx=0x7f59d400f9f0).stop 2020-01-26T15:39:26.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e2037700 1 -- 172.21.15.170:0/3950888168 reap_dead start 2020-01-26T15:39:26.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e2037700 1 -- 172.21.15.170:0/3950888168 reap_dead start 2020-01-26T15:39:26.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 shutdown_connections 2020-01-26T15:39:26.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 >> 172.21.15.170:0/3950888168 conn(0x7f59dc0a67d0 msgr2=0x7f59dc07f150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:26.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 shutdown_connections 2020-01-26T15:39:26.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:26.576+0000 7f59e0dd5700 1 -- 172.21.15.170:0/3950888168 wait complete. 2020-01-26T15:39:26.588 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:29.589 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.703+0000 7f8d97fff700 1 Processor -- start 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.703+0000 7f8d97fff700 1 -- start start 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d9805edd0 0x7f8d9805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8d98149040 0x7f8d9814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d98098000 con 0x7f8d980a6870 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9805e050 con 0x7f8d9805edd0 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980a6ca0 con 0x7f8d98149040 2020-01-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d977fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d9805edd0 0x7f8d9805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d977fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d9805edd0 0x7f8d9805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d9d60a700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f8d98149040 0x7f8d9814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d96ffd700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f8d980a6870 0x7f8d9807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49602/0 (socket says 172.21.15.170:49602) 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d96ffd700 1 -- 172.21.15.170:0/967055396 learned_addr learned my addr 172.21.15.170:0/967055396 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d9d60a700 1 --2- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6791/0 conn(0x7f8d98149040 0x7f8d9814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898023806 0 0) 0x7f8d98098000 con 0x7f8d980a6870 2020-01-26T15:39:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d80003230 con 0x7f8d980a6870 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 489284743 0 0) 0x7f8d80003230 con 0x7f8d980a6870 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6791/0 conn(0x7f8d98149040 msgr2=0x7f8d9814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 --2- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6791/0 conn(0x7f8d98149040 0x7f8d9814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6790/0 conn(0x7f8d9805edd0 msgr2=0x7f8d9805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 --2- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6790/0 conn(0x7f8d9805edd0 0x7f8d9805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9814c9e0 con 0x7f8d980a6870 2020-01-26T15:39:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8d8c001710 con 0x7f8d980a6870 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8d8c001aa0 con 0x7f8d980a6870 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d967fc700 1 -- 172.21.15.170:0/967055396 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8d8c004760 con 0x7f8d980a6870 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- 172.21.15.170:0/967055396 >> v1:172.21.15.170:6790/0 conn(0x7f8d980a6870 legacy=0x7f8d9807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- 172.21.15.170:0/967055396 shutdown_connections 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 --2- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6791/0 conn(0x7f8d98149040 0x7f8d9814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 --2- 172.21.15.170:0/967055396 >> v2:172.21.15.170:6790/0 conn(0x7f8d9805edd0 0x7f8d9805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- 172.21.15.170:0/967055396 >> 172.21.15.170:0/967055396 conn(0x7f8d98098e70 msgr2=0x7f8d980a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- 172.21.15.170:0/967055396 shutdown_connections 2020-01-26T15:39:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- 172.21.15.170:0/967055396 wait complete. 2020-01-26T15:39:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 Processor -- start 2020-01-26T15:39:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.707+0000 7f8d97fff700 1 -- start start 2020-01-26T15:39:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d97fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d9809f3f0 0x7f8d9809dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d97fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d98133ce0 con 0x7f8d9811fa40 2020-01-26T15:39:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d97fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9813c480 con 0x7f8d98122ba0 2020-01-26T15:39:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d97fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8d98133f10 con 0x7f8d9809f3f0 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d9809f3f0 0x7f8d9809dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f8d9809f3f0 0x7f8d9809dfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d9d60a700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f8d98122ba0 0x7f8d981334e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49608/0 (socket says 172.21.15.170:49608) 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d9d60a700 1 -- 172.21.15.170:0/1114484368 learned_addr learned my addr 172.21.15.170:0/1114484368 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422126141 0 0) 0x7f8d9813c480 con 0x7f8d98122ba0 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d78003230 con 0x7f8d98122ba0 2020-01-26T15:39:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092914238 0 0) 0x7f8d98133ce0 con 0x7f8d9811fa40 2020-01-26T15:39:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d9813c480 con 0x7f8d9811fa40 2020-01-26T15:39:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2151321130 0 0) 0x7f8d78003230 con 0x7f8d98122ba0 2020-01-26T15:39:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d98133ce0 con 0x7f8d98122ba0 2020-01-26T15:39:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8d90001620 con 0x7f8d98122ba0 2020-01-26T15:39:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3544883069 0 0) 0x7f8d9813c480 con 0x7f8d9811fa40 2020-01-26T15:39:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d78003230 con 0x7f8d9811fa40 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f8d8c004720 con 0x7f8d9811fa40 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 >> v2:172.21.15.170:6790/0 conn(0x7f8d9809f3f0 msgr2=0x7f8d9809dfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 --2- 172.21.15.170:0/1114484368 >> v2:172.21.15.170:6790/0 conn(0x7f8d9809f3f0 0x7f8d9809dfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 >> v1:172.21.15.170:6790/0 conn(0x7f8d98122ba0 legacy=0x7f8d981334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 >> v1:172.21.15.170:6789/0 conn(0x7f8d9811fa40 legacy=0x7f8d9811e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8d9813c480 con 0x7f8d78003ec0 2020-01-26T15:39:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8d780042f0 con 0x7f8d78003a90 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98133f10 con 0x7f8d78004f00 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763217041 0 0) 0x7f8d780042f0 con 0x7f8d78003a90 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7800e810 con 0x7f8d78003a90 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 -- 172.21.15.170:0/1114484368 >> v1:172.21.15.170:6791/0 conn(0x7f8d78003a90 legacy=0x7f8d780097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121795101 0 0) 0x7f8d9813c480 con 0x7f8d78003ec0 2020-01-26T15:39:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 -- 172.21.15.170:0/1114484368 >> v1:172.21.15.170:6790/0 conn(0x7f8d78003ec0 legacy=0x7f8d7800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 -- 172.21.15.170:0/1114484368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f8d9809e6b0 con 0x7f8d78004f00 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d98122ba0 con 0x7f8d78004f00 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d981334e0 con 0x7f8d78004f00 2020-01-26T15:39:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8d88011660 con 0x7f8d78004f00 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.711+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d88011860 con 0x7f8d78004f00 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.715+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.715+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d70003360 con 0x7f8d78004f00 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.715+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8d88011a50 con 0x7f8d78004f00 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.715+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.715+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f8d8804d0a0 con 0x7f8d78004f00 2020-01-26T15:39:29.729 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.719+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.729 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.719+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8d88033250 con 0x7f8d78004f00 2020-01-26T15:39:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8d70003790 con 0x7f8d78004f00 2020-01-26T15:39:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d977fe700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:29.878 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d7ffff700 1 -- 172.21.15.170:0/1114484368 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8d880334b0 con 0x7f8d78004f00 2020-01-26T15:39:29.878 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:29.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 >> v1:172.21.15.170:6800/17396 conn(0x7f8d78048690 legacy=0x7f8d7804aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 msgr2=0x7f8d78003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:29.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d9d60a700 1 -- 172.21.15.170:0/1114484368 reap_dead start 2020-01-26T15:39:29.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f8d880032b0 tx=0x7f8d88010e60).stop 2020-01-26T15:39:29.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 shutdown_connections 2020-01-26T15:39:29.880 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 --2- 172.21.15.170:0/1114484368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d78004f00 0x7f8d78003540 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:29.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 >> 172.21.15.170:0/1114484368 conn(0x7f8d9805c0f0 msgr2=0x7f8d980247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:29.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 shutdown_connections 2020-01-26T15:39:29.881 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:29.875+0000 7f8d97fff700 1 -- 172.21.15.170:0/1114484368 wait complete. 2020-01-26T15:39:29.890 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:32.891 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:33.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 Processor -- start 2020-01-26T15:39:33.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 -- start start 2020-01-26T15:39:33.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fbcfc05e5f0 0x7fbcfc0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:33.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fbcfc149040 0x7fbcfc14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:33.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc0a6dc0 con 0x7fbcfc05edd0 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc05ea20 con 0x7fbcfc05e5f0 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfb59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc098000 con 0x7fbcfc149040 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbd00ce9700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fbcfc149040 0x7fbcfc14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfa59c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fbcfc05e5f0 0x7fbcfc0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfad9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fbcfc05edd0 0x7fbcfc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44746/0 (socket says 172.21.15.170:44746) 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfad9d700 1 -- 172.21.15.170:0/1251157297 learned_addr learned my addr 172.21.15.170:0/1251157297 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:33.015 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbd00ce9700 1 --2- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6791/0 conn(0x7fbcfc149040 0x7fbcfc14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcfa59c700 1 --2- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc05e5f0 0x7fbcfc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728675648 0 0) 0x7fbcfc0a6dc0 con 0x7fbcfc05edd0 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce8003230 con 0x7fbcfc05edd0 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3297744252 0 0) 0x7fbce8003230 con 0x7fbcfc05edd0 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6791/0 conn(0x7fbcfc149040 msgr2=0x7fbcfc14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 --2- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6791/0 conn(0x7fbcfc149040 0x7fbcfc14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc05e5f0 msgr2=0x7fbcfc0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:33.016 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 --2- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc05e5f0 0x7fbcfc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:33.017 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc05e050 con 0x7fbcfc05edd0 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.007+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbcec001710 con 0x7fbcfc05edd0 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbcec001aa0 con 0x7fbcfc05edd0 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcf9d9b700 1 -- 172.21.15.170:0/1251157297 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbcec004760 con 0x7fbcfc05edd0 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 -- 172.21.15.170:0/1251157297 >> v1:172.21.15.170:6791/0 conn(0x7fbcfc05edd0 legacy=0x7fbcfc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 -- 172.21.15.170:0/1251157297 shutdown_connections 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 --2- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6791/0 conn(0x7fbcfc149040 0x7fbcfc14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 --2- 172.21.15.170:0/1251157297 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc05e5f0 0x7fbcfc0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 -- 172.21.15.170:0/1251157297 >> 172.21.15.170:0/1251157297 conn(0x7fbcfc098e70 msgr2=0x7fbcfc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 -- 172.21.15.170:0/1251157297 shutdown_connections 2020-01-26T15:39:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 -- 172.21.15.170:0/1251157297 wait complete. 2020-01-26T15:39:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.011+0000 7fbcfb59e700 1 Processor -- start 2020-01-26T15:39:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfb59e700 1 -- start start 2020-01-26T15:39:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfb59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fbcfc123b60 0x7fbcfc1362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfb59e700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc0a4720 con 0x7fbcfc136810 2020-01-26T15:39:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfb59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc07dc00 con 0x7fbcfc123730 2020-01-26T15:39:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfb59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc0a41d0 con 0x7fbcfc123b60 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfa59c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fbcfc123b60 0x7fbcfc1362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfad9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fbcfc123730 0x7fbcfc07ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44752/0 (socket says 172.21.15.170:44752) 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfad9d700 1 -- 172.21.15.170:0/3789863760 learned_addr learned my addr 172.21.15.170:0/3789863760 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfa59c700 1 --2- 172.21.15.170:0/3789863760 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc123b60 0x7fbcfc1362c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736251339 0 0) 0x7fbcfc07dc00 con 0x7fbcfc123730 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce0003230 con 0x7fbcfc123730 2020-01-26T15:39:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880935858 0 0) 0x7fbcfc0a4720 con 0x7fbcfc136810 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc07dc00 con 0x7fbcfc136810 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2021173831 0 0) 0x7fbce0003230 con 0x7fbcfc123730 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbcfc0a4720 con 0x7fbcfc123730 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbcec001420 con 0x7fbcfc123730 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1902832702 0 0) 0x7fbcfc07dc00 con 0x7fbcfc136810 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbce0003230 con 0x7fbcfc136810 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fbcf4002980 con 0x7fbcfc136810 2020-01-26T15:39:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc123b60 msgr2=0x7fbcfc1362c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 --2- 172.21.15.170:0/3789863760 >> v2:172.21.15.170:6790/0 conn(0x7fbcfc123b60 0x7fbcfc1362c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 >> v1:172.21.15.170:6791/0 conn(0x7fbcfc123730 legacy=0x7fbcfc07ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 >> v1:172.21.15.170:6789/0 conn(0x7fbcfc136810 legacy=0x7fbcfc138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbcfc0a4720 con 0x7fbce0004f20 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbcfc07dc00 con 0x7fbce0004af0 2020-01-26T15:39:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc0a41d0 con 0x7fbce0003ec0 2020-01-26T15:39:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535618746 0 0) 0x7fbcfc07dc00 con 0x7fbce0004af0 2020-01-26T15:39:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce000e810 con 0x7fbce0004af0 2020-01-26T15:39:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298389498 0 0) 0x7fbcfc0a4720 con 0x7fbce0004f20 2020-01-26T15:39:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc07dc00 con 0x7fbce0004f20 2020-01-26T15:39:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.015+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1966446791 0 0) 0x7fbce000e810 con 0x7fbce0004af0 2020-01-26T15:39:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 -- 172.21.15.170:0/3789863760 >> v1:172.21.15.170:6791/0 conn(0x7fbce0004af0 legacy=0x7fbce00097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 -- 172.21.15.170:0/3789863760 >> v1:172.21.15.170:6790/0 conn(0x7fbce0004f20 legacy=0x7fbce000d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 -- 172.21.15.170:0/3789863760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fbcfc09fb40 con 0x7fbce0003ec0 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc123f90 con 0x7fbce0003ec0 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc099e30 con 0x7fbce0003ec0 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbce40015a0 con 0x7fbce0003ec0 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec001230 con 0x7fbce0003ec0 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd4003360 con 0x7fbce0003ec0 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fbcec0049b0 con 0x7fbce0003ec0 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.019+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fbcec04d350 con 0x7fbce0003ec0 2020-01-26T15:39:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.027+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.027+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fbcec033500 con 0x7fbce0003ec0 2020-01-26T15:39:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbcd40036b0 con 0x7fbce0003ec0 2020-01-26T15:39:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfad9d700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcf37fe700 1 -- 172.21.15.170:0/3789863760 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fbcec033760 con 0x7fbce0003ec0 2020-01-26T15:39:33.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 >> v1:172.21.15.170:6800/17396 conn(0x7fbce0048600 legacy=0x7fbce004ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbd00ce9700 1 -- 172.21.15.170:0/3789863760 reap_dead start 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 msgr2=0x7fbce00045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fbce40017e0 tx=0x7fbcec0114e0).stop 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 shutdown_connections 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 --2- 172.21.15.170:0/3789863760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce0003ec0 0x7fbce00045a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 >> 172.21.15.170:0/3789863760 conn(0x7fbcfc0a1150 msgr2=0x7fbcfc024bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 shutdown_connections 2020-01-26T15:39:33.184 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:33.179+0000 7fbcfb59e700 1 -- 172.21.15.170:0/3789863760 wait complete. 2020-01-26T15:39:33.194 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:36.198 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:36.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 Processor -- start 2020-01-26T15:39:36.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 -- start start 2020-01-26T15:39:36.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ffb7405e5f0 0x7ffb740a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb740a6dc0 con 0x7ffb7405edd0 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7405ea20 con 0x7ffb74149040 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ffb74098000 con 0x7ffb7405e5f0 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79908700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ffb7405e5f0 0x7ffb740a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79908700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ffb7405e5f0 0x7ffb740a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7bb6c700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ffb74149040 0x7ffb7414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44770/0 (socket says 172.21.15.170:44770) 2020-01-26T15:39:36.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a109700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ffb7405edd0 0x7ffb7407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49640/0 (socket says 172.21.15.170:49640) 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7bb6c700 1 -- 172.21.15.170:0/3584882469 learned_addr learned my addr 172.21.15.170:0/3584882469 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944609563 0 0) 0x7ffb7405ea20 con 0x7ffb74149040 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb60003230 con 0x7ffb74149040 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009374774 0 0) 0x7ffb740a6dc0 con 0x7ffb7405edd0 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb7405ea20 con 0x7ffb7405edd0 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1484680805 0 0) 0x7ffb60003230 con 0x7ffb74149040 2020-01-26T15:39:36.319 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 >> v2:172.21.15.170:6790/0 conn(0x7ffb7405e5f0 msgr2=0x7ffb740a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 --2- 172.21.15.170:0/3584882469 >> v2:172.21.15.170:6790/0 conn(0x7ffb7405e5f0 0x7ffb740a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 >> v1:172.21.15.170:6790/0 conn(0x7ffb7405edd0 legacy=0x7ffb7407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7405e050 con 0x7ffb74149040 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ffb6c001a90 con 0x7ffb74149040 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ffb6c001ce0 con 0x7ffb74149040 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb79107700 1 -- 172.21.15.170:0/3584882469 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ffb6c004930 con 0x7ffb74149040 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.314+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3584882469 >> v1:172.21.15.170:6791/0 conn(0x7ffb74149040 legacy=0x7ffb7414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3584882469 shutdown_connections 2020-01-26T15:39:36.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 --2- 172.21.15.170:0/3584882469 >> v2:172.21.15.170:6790/0 conn(0x7ffb7405e5f0 0x7ffb740a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:36.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3584882469 >> 172.21.15.170:0/3584882469 conn(0x7ffb74098e70 msgr2=0x7ffb740a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:36.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3584882469 shutdown_connections 2020-01-26T15:39:36.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3584882469 wait complete. 2020-01-26T15:39:36.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 Processor -- start 2020-01-26T15:39:36.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- start start 2020-01-26T15:39:36.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ffb74136ae0 0x7ffb74138f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:36.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb740a34a0 con 0x7ffb74078bb0 2020-01-26T15:39:36.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb741204a0 con 0x7ffb740a3070 2020-01-26T15:39:36.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a90a700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ffb740a3b70 con 0x7ffb74136ae0 2020-01-26T15:39:36.326 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7bb6c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ffb74136ae0 0x7ffb74138f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:36.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a109700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ffb74078bb0 0x7ffb74130720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52770/0 (socket says 172.21.15.170:52770) 2020-01-26T15:39:36.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7a109700 1 -- 172.21.15.170:0/3765086986 learned_addr learned my addr 172.21.15.170:0/3765086986 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:36.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb79908700 1 --1- 172.21.15.170:0/3765086986 >> v1:172.21.15.170:6790/0 conn(0x7ffb740a3070 0x7ffb74130f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49648/0 (socket says 172.21.15.170:49648) 2020-01-26T15:39:36.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> v2:172.21.15.170:6790/0 conn(0x7ffb74136ae0 0x7ffb74138f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:36.327 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658627254 0 0) 0x7ffb740a34a0 con 0x7ffb74078bb0 2020-01-26T15:39:36.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003230 con 0x7ffb74078bb0 2020-01-26T15:39:36.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082502231 0 0) 0x7ffb741204a0 con 0x7ffb740a3070 2020-01-26T15:39:36.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb740a34a0 con 0x7ffb740a3070 2020-01-26T15:39:36.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2601313009 0 0) 0x7ffb740a34a0 con 0x7ffb740a3070 2020-01-26T15:39:36.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffb741204a0 con 0x7ffb740a3070 2020-01-26T15:39:36.328 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.318+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ffb700016a0 con 0x7ffb740a3070 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2236810732 0 0) 0x7ffb5c003230 con 0x7ffb74078bb0 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffb740a34a0 con 0x7ffb74078bb0 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ffb680018f0 con 0x7ffb74078bb0 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 >> v2:172.21.15.170:6790/0 conn(0x7ffb74136ae0 msgr2=0x7ffb74138f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 --2- 172.21.15.170:0/3765086986 >> v2:172.21.15.170:6790/0 conn(0x7ffb74136ae0 0x7ffb74138f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 >> v1:172.21.15.170:6790/0 conn(0x7ffb740a3070 legacy=0x7ffb74130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.329 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 >> v1:172.21.15.170:6789/0 conn(0x7ffb74078bb0 legacy=0x7ffb74130720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ffb5c003230 con 0x7ffb5c003ec0 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ffb5c00f9a0 con 0x7ffb5c004da0 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740a3b70 con 0x7ffb5c00c000 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767484529 0 0) 0x7ffb5c003230 con 0x7ffb5c003ec0 2020-01-26T15:39:36.330 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c00fbd0 con 0x7ffb5c003ec0 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911501943 0 0) 0x7ffb5c00f9a0 con 0x7ffb5c004da0 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003230 con 0x7ffb5c004da0 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 -- 172.21.15.170:0/3765086986 >> v1:172.21.15.170:6791/0 conn(0x7ffb5c004da0 legacy=0x7ffb5c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 -- 172.21.15.170:0/3765086986 >> v1:172.21.15.170:6790/0 conn(0x7ffb5c003ec0 legacy=0x7ffb5c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 -- 172.21.15.170:0/3765086986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7ffb740a7d10 con 0x7ffb5c00c000 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb740a7ae0 con 0x7ffb5c00c000 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.331 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb74121590 con 0x7ffb5c00c000 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ffb6c00caa0 con 0x7ffb5c00c000 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00cca0 con 0x7ffb5c00c000 2020-01-26T15:39:36.332 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb50003360 con 0x7ffb5c00c000 2020-01-26T15:39:36.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.322+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ffb6c004870 con 0x7ffb5c00c000 2020-01-26T15:39:36.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.326+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ffb6c04cf30 con 0x7ffb5c00c000 2020-01-26T15:39:36.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.330+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.330+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ffb6c033080 con 0x7ffb5c00c000 2020-01-26T15:39:36.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb50003790 con 0x7ffb5c00c000 2020-01-26T15:39:36.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7bb6c700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:36.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb66ffd700 1 -- 172.21.15.170:0/3765086986 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ffb6c0332e0 con 0x7ffb5c00c000 2020-01-26T15:39:36.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:36.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 >> v1:172.21.15.170:6800/17396 conn(0x7ffb5c04abd0 legacy=0x7ffb5c04d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 msgr2=0x7ffb5c00e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:36.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7bb6c700 1 -- 172.21.15.170:0/3765086986 reap_dead start 2020-01-26T15:39:36.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7ffb6c001550 tx=0x7ffb6c010dc0).stop 2020-01-26T15:39:36.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 shutdown_connections 2020-01-26T15:39:36.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 --2- 172.21.15.170:0/3765086986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c00c000 0x7ffb5c00e440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:36.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 >> 172.21.15.170:0/3765086986 conn(0x7ffb74097b10 msgr2=0x7ffb740a4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:36.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 shutdown_connections 2020-01-26T15:39:36.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:36.486+0000 7ffb7a90a700 1 -- 172.21.15.170:0/3765086986 wait complete. 2020-01-26T15:39:36.499 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:39.500 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:39.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 Processor -- start 2020-01-26T15:39:39.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 -- start start 2020-01-26T15:39:39.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f643805edd0 0x7f643805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:39.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f64380a6870 0x7f643807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:39.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6438098000 con 0x7f64380804d0 2020-01-26T15:39:39.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f643805e050 con 0x7f643805edd0 2020-01-26T15:39:39.627 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643759e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f64380a6ca0 con 0x7f64380a6870 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f6436d9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f643805edd0 0x7f643805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f6436d9d700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f643805edd0 0x7f643805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643cb7c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f64380804d0 0x7f64380247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49664/0 (socket says 172.21.15.170:49664) 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643cb7c700 1 -- 172.21.15.170:0/3042233953 learned_addr learned my addr 172.21.15.170:0/3042233953 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643659c700 -1 --2- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6791/0 conn(0x7f64380a6870 0x7f643807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.618+0000 7f643659c700 1 --2- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6791/0 conn(0x7f64380a6870 0x7f643807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:39.628 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684496777 0 0) 0x7f6438098000 con 0x7f64380804d0 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6420003230 con 0x7f64380804d0 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3578479161 0 0) 0x7f6420003230 con 0x7f64380804d0 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6791/0 conn(0x7f64380a6870 msgr2=0x7f643807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 --2- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6791/0 conn(0x7f64380a6870 0x7f643807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6790/0 conn(0x7f643805edd0 msgr2=0x7f643805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 --2- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6790/0 conn(0x7f643805edd0 0x7f643805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:39.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438024fb0 con 0x7f64380804d0 2020-01-26T15:39:39.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6430001710 con 0x7f64380804d0 2020-01-26T15:39:39.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6430001aa0 con 0x7f64380804d0 2020-01-26T15:39:39.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 -- 172.21.15.170:0/3042233953 >> v1:172.21.15.170:6790/0 conn(0x7f64380804d0 legacy=0x7f64380247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:39.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f6435d9b700 1 -- 172.21.15.170:0/3042233953 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6430004760 con 0x7f64380804d0 2020-01-26T15:39:39.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 -- 172.21.15.170:0/3042233953 shutdown_connections 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 --2- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6790/0 conn(0x7f643805edd0 0x7f643805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 --2- 172.21.15.170:0/3042233953 >> v2:172.21.15.170:6791/0 conn(0x7f64380a6870 0x7f643807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 -- 172.21.15.170:0/3042233953 >> 172.21.15.170:0/3042233953 conn(0x7f6438098e70 msgr2=0x7f64380a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 -- 172.21.15.170:0/3042233953 shutdown_connections 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 -- 172.21.15.170:0/3042233953 wait complete. 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 Processor -- start 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.622+0000 7f643759e700 1 -- start start 2020-01-26T15:39:39.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6438065890 0x7f6438095d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6438132fd0 0x7f6438133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380a2300 con 0x7f64380957b0 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6438064750 con 0x7f6438065890 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6438133950 con 0x7f6438132fd0 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643cb7c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f6438132fd0 0x7f6438133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f6436d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f64380957b0 0x7f64380a31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44792/0 (socket says 172.21.15.170:44792) 2020-01-26T15:39:39.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f6436d9d700 1 -- 172.21.15.170:0/661653048 learned_addr learned my addr 172.21.15.170:0/661653048 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643659c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f6438065890 0x7f6438095d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643cb7c700 1 --2- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6791/0 conn(0x7f6438132fd0 0x7f6438133400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643659c700 1 --2- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6790/0 conn(0x7f6438065890 0x7f6438095d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304048201 0 0) 0x7f64380a2300 con 0x7f64380957b0 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f641c003230 con 0x7f64380957b0 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2563871917 0 0) 0x7f641c003230 con 0x7f64380957b0 2020-01-26T15:39:39.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64380a2300 con 0x7f64380957b0 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6428002b00 con 0x7f64380957b0 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3422848001 0 0) 0x7f64380a2300 con 0x7f64380957b0 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6791/0 conn(0x7f6438132fd0 msgr2=0x7f6438133400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 --2- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6791/0 conn(0x7f6438132fd0 0x7f6438133400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6790/0 conn(0x7f6438065890 msgr2=0x7f6438095d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 --2- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6790/0 conn(0x7f6438065890 0x7f6438095d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:39.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438133b40 con 0x7f64380957b0 2020-01-26T15:39:39.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6438133e10 con 0x7f64380957b0 2020-01-26T15:39:39.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6428001210 con 0x7f64380957b0 2020-01-26T15:39:39.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f643813a890 con 0x7f64380957b0 2020-01-26T15:39:39.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.626+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f6428001630 con 0x7f64380957b0 2020-01-26T15:39:39.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.630+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f6428001830 con 0x7f64380957b0 2020-01-26T15:39:39.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.630+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6438056600 con 0x7f64380957b0 2020-01-26T15:39:39.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.630+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f642804bdc0 con 0x7f64380957b0 2020-01-26T15:39:39.636 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.634+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f6428031340 con 0x7f64380957b0 2020-01-26T15:39:39.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.790+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f643805cc60 con 0x7f64380957b0 2020-01-26T15:39:39.793 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f64277fe700 1 -- 172.21.15.170:0/661653048 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f642804aa30 con 0x7f64380957b0 2020-01-26T15:39:39.794 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:39.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 >> v1:172.21.15.170:6800/17396 conn(0x7f641c03e1c0 legacy=0x7f641c0406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:39.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 >> v1:172.21.15.170:6791/0 conn(0x7f64380957b0 legacy=0x7f64380a31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:39.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 shutdown_connections 2020-01-26T15:39:39.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 --2- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6791/0 conn(0x7f6438132fd0 0x7f6438133400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:39.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 --2- 172.21.15.170:0/661653048 >> v2:172.21.15.170:6790/0 conn(0x7f6438065890 0x7f6438095d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:39.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 >> 172.21.15.170:0/661653048 conn(0x7f6438025490 msgr2=0x7f6438097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:39.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 shutdown_connections 2020-01-26T15:39:39.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:39.794+0000 7f643759e700 1 -- 172.21.15.170:0/661653048 wait complete. 2020-01-26T15:39:39.812 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:42.813 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:42.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 Processor -- start 2020-01-26T15:39:42.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 -- start start 2020-01-26T15:39:42.935 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f978805edd0 0x7f978805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f9788149040 0x7f978814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788098000 con 0x7f97880a6870 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f978805e050 con 0x7f978805edd0 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f97880a6ca0 con 0x7f9788149040 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978cbe0700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f978805edd0 0x7f978805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978cbe0700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f978805edd0 0x7f978805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:42.936 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f9787fff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f97880a6870 0x7f978807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49676/0 (socket says 172.21.15.170:49676) 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978e643700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f9788149040 0x7f978814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f9787fff700 1 -- 172.21.15.170:0/2543067771 learned_addr learned my addr 172.21.15.170:0/2543067771 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978e643700 1 --2- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6791/0 conn(0x7f9788149040 0x7f978814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438153011 0 0) 0x7f9788098000 con 0x7f97880a6870 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9770003230 con 0x7f97880a6870 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 221205043 0 0) 0x7f9770003230 con 0x7f97880a6870 2020-01-26T15:39:42.937 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6791/0 conn(0x7f9788149040 msgr2=0x7f978814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 --2- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6791/0 conn(0x7f9788149040 0x7f978814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6790/0 conn(0x7f978805edd0 msgr2=0x7f978805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 --2- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6790/0 conn(0x7f978805edd0 0x7f978805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978814c9e0 con 0x7f97880a6870 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f977c001710 con 0x7f97880a6870 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f977c001aa0 con 0x7f97880a6870 2020-01-26T15:39:42.938 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f97877fe700 1 -- 172.21.15.170:0/2543067771 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f977c004760 con 0x7f97880a6870 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.929+0000 7f978d3e1700 1 -- 172.21.15.170:0/2543067771 >> v1:172.21.15.170:6790/0 conn(0x7f97880a6870 legacy=0x7f978807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.933+0000 7f978d3e1700 1 -- 172.21.15.170:0/2543067771 shutdown_connections 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.933+0000 7f978d3e1700 1 --2- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6791/0 conn(0x7f9788149040 0x7f978814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.933+0000 7f978d3e1700 1 --2- 172.21.15.170:0/2543067771 >> v2:172.21.15.170:6790/0 conn(0x7f978805edd0 0x7f978805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.933+0000 7f978d3e1700 1 -- 172.21.15.170:0/2543067771 >> 172.21.15.170:0/2543067771 conn(0x7f9788098e70 msgr2=0x7f97880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.933+0000 7f978d3e1700 1 -- 172.21.15.170:0/2543067771 shutdown_connections 2020-01-26T15:39:42.939 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.933+0000 7f978d3e1700 1 -- 172.21.15.170:0/2543067771 wait complete. 2020-01-26T15:39:42.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978d3e1700 1 Processor -- start 2020-01-26T15:39:42.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978d3e1700 1 -- start start 2020-01-26T15:39:42.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978d3e1700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f97881376f0 0x7f9788139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:42.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978d3e1700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97880721b0 con 0x7f97880727b0 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978d3e1700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97881222c0 con 0x7f9788131480 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978d3e1700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f9788071c80 con 0x7f97881376f0 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978cbe0700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f97880727b0 0x7f9788079dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52802/0 (socket says 172.21.15.170:52802) 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978cbe0700 1 -- 172.21.15.170:0/2248744758 learned_addr learned my addr 172.21.15.170:0/2248744758 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f9787fff700 1 --1- 172.21.15.170:0/2248744758 >> v1:172.21.15.170:6790/0 conn(0x7f9788131480 0x7f97881318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49680/0 (socket says 172.21.15.170:49680) 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978e643700 -1 --2- 172.21.15.170:0/2248744758 >> v2:172.21.15.170:6791/0 conn(0x7f97881376f0 0x7f9788139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:42.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f978e643700 1 --2- 172.21.15.170:0/2248744758 >> v2:172.21.15.170:6791/0 conn(0x7f97881376f0 0x7f9788139b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320997507 0 0) 0x7f97881222c0 con 0x7f9788131480 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9768003230 con 0x7f9788131480 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967230691 0 0) 0x7f97880721b0 con 0x7f97880727b0 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97881222c0 con 0x7f97880727b0 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2916733818 0 0) 0x7f9768003230 con 0x7f9788131480 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97880721b0 con 0x7f9788131480 2020-01-26T15:39:42.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f977c001420 con 0x7f9788131480 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4177704837 0 0) 0x7f97881222c0 con 0x7f97880727b0 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9768003230 con 0x7f97880727b0 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f9778002ac0 con 0x7f97880727b0 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 >> v2:172.21.15.170:6791/0 conn(0x7f97881376f0 msgr2=0x7f9788139b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 --2- 172.21.15.170:0/2248744758 >> v2:172.21.15.170:6791/0 conn(0x7f97881376f0 0x7f9788139b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 >> v1:172.21.15.170:6790/0 conn(0x7f9788131480 legacy=0x7f97881318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:42.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 >> v1:172.21.15.170:6789/0 conn(0x7f97880727b0 legacy=0x7f9788079dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f97881222c0 con 0x7f976800ad40 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f97680041e0 con 0x7f9768004f00 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788071c80 con 0x7f9768003d40 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.937+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672367667 0 0) 0x7f97881222c0 con 0x7f976800ad40 2020-01-26T15:39:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f976800e990 con 0x7f976800ad40 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34377569 0 0) 0x7f97680041e0 con 0x7f9768004f00 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97881222c0 con 0x7f9768004f00 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 -- 172.21.15.170:0/2248744758 >> v1:172.21.15.170:6791/0 conn(0x7f9768004f00 legacy=0x7f9768003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 -- 172.21.15.170:0/2248744758 >> v1:172.21.15.170:6790/0 conn(0x7f976800ad40 legacy=0x7f976800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 -- 172.21.15.170:0/2248744758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f97880a31a0 con 0x7f9768003d40 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880a34b0 con 0x7f9768003d40 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97880a0f20 con 0x7f9768003d40 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f977c00cd00 con 0x7f9768003d40 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c0049b0 con 0x7f9768003d40 2020-01-26T15:39:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9760003360 con 0x7f9768003d40 2020-01-26T15:39:42.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f977c004ba0 con 0x7f9768003d40 2020-01-26T15:39:42.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.950 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.941+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f977c04ce90 con 0x7f9768003d40 2020-01-26T15:39:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.949+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:42.949+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f977c033040 con 0x7f9768003d40 2020-01-26T15:39:43.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.105+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9760003790 con 0x7f9768003d40 2020-01-26T15:39:43.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.105+0000 7f9787fff700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:43.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.105+0000 7f97857fa700 1 -- 172.21.15.170:0/2248744758 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f977c0332a0 con 0x7f9768003d40 2020-01-26T15:39:43.109 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:43.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 >> v1:172.21.15.170:6800/17396 conn(0x7f97680487c0 legacy=0x7f976804acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:43.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 msgr2=0x7f976800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:43.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978e643700 1 -- 172.21.15.170:0/2248744758 reap_dead start 2020-01-26T15:39:43.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f977c0045f0 tx=0x7f977c011110).stop 2020-01-26T15:39:43.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 shutdown_connections 2020-01-26T15:39:43.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 --2- 172.21.15.170:0/2248744758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9768003d40 0x7f976800a7f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:43.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 >> 172.21.15.170:0/2248744758 conn(0x7f978805edd0 msgr2=0x7f978807dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:43.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 shutdown_connections 2020-01-26T15:39:43.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:43.109+0000 7f978d3e1700 1 -- 172.21.15.170:0/2248744758 wait complete. 2020-01-26T15:39:43.120 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:46.122 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 Processor -- start 2020-01-26T15:39:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- start start 2020-01-26T15:39:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2a8405edd0 0x7f2a8405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2a84149040 0x7f2a8414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a84098000 con 0x7f2a840a6870 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8405e050 con 0x7f2a84149040 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2a840a6ca0 con 0x7f2a8405edd0 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8b314700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2a84149040 0x7f2a8414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a890b0700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f2a840a6870 0x7f2a8407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44820/0 (socket says 172.21.15.170:44820) 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a890b0700 1 -- 172.21.15.170:0/1605185937 learned_addr learned my addr 172.21.15.170:0/1605185937 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a898b1700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2a8405edd0 0x7f2a8405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8b314700 1 --2- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6790/0 conn(0x7f2a84149040 0x7f2a8414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a898b1700 1 --2- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6791/0 conn(0x7f2a8405edd0 0x7f2a8405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447673892 0 0) 0x7f2a84098000 con 0x7f2a840a6870 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a70003230 con 0x7f2a840a6870 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2808487125 0 0) 0x7f2a70003230 con 0x7f2a840a6870 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6791/0 conn(0x7f2a8405edd0 msgr2=0x7f2a8405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 --2- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6791/0 conn(0x7f2a8405edd0 0x7f2a8405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6790/0 conn(0x7f2a84149040 msgr2=0x7f2a8414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 --2- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6790/0 conn(0x7f2a84149040 0x7f2a8414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8414c9e0 con 0x7f2a840a6870 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2a74001710 con 0x7f2a840a6870 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2a74001910 con 0x7f2a840a6870 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a888af700 1 -- 172.21.15.170:0/1605185937 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2a740045b0 con 0x7f2a840a6870 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/1605185937 >> v1:172.21.15.170:6791/0 conn(0x7f2a840a6870 legacy=0x7f2a8407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/1605185937 shutdown_connections 2020-01-26T15:39:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 --2- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6790/0 conn(0x7f2a84149040 0x7f2a8414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 --2- 172.21.15.170:0/1605185937 >> v2:172.21.15.170:6791/0 conn(0x7f2a8405edd0 0x7f2a8405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/1605185937 >> 172.21.15.170:0/1605185937 conn(0x7f2a84098e70 msgr2=0x7f2a840a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/1605185937 shutdown_connections 2020-01-26T15:39:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.233+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/1605185937 wait complete. 2020-01-26T15:39:46.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 Processor -- start 2020-01-26T15:39:46.246 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 -- start start 2020-01-26T15:39:46.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2a84099e50 0x7f2a8409e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:46.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2a8409ef10 0x7f2a8409e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:46.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8409a320 con 0x7f2a84122090 2020-01-26T15:39:46.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2a84097a00 con 0x7f2a84099e50 2020-01-26T15:39:46.247 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8a0b2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8409ad70 con 0x7f2a8409ef10 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a898b1700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2a84099e50 0x7f2a8409e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a890b0700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2a8409ef10 0x7f2a8409e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a898b1700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f2a84099e50 0x7f2a8409e030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a890b0700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2a8409ef10 0x7f2a8409e580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8b314700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2a84122090 0x7f2a841224c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52826/0 (socket says 172.21.15.170:52826) 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.237+0000 7f2a8b314700 1 -- 172.21.15.170:0/3336691558 learned_addr learned my addr 172.21.15.170:0/3336691558 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:46.248 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229416036 0 0) 0x7f2a8409a320 con 0x7f2a84122090 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a6c003230 con 0x7f2a84122090 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1229969530 0 0) 0x7f2a6c003230 con 0x7f2a84122090 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a8409a320 con 0x7f2a84122090 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2a7c0019a0 con 0x7f2a84122090 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 >> v2:172.21.15.170:6791/0 conn(0x7f2a8409ef10 msgr2=0x7f2a8409e580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 --2- 172.21.15.170:0/3336691558 >> v2:172.21.15.170:6791/0 conn(0x7f2a8409ef10 0x7f2a8409e580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 >> v2:172.21.15.170:6790/0 conn(0x7f2a84099e50 msgr2=0x7f2a8409e030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:46.249 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 --2- 172.21.15.170:0/3336691558 >> v2:172.21.15.170:6790/0 conn(0x7f2a84099e50 0x7f2a8409e030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 >> v1:172.21.15.170:6789/0 conn(0x7f2a84122090 legacy=0x7f2a841224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2a6c003230 con 0x7f2a6c00a7f0 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2a6c00f450 con 0x7f2a6c003a50 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a84097a00 con 0x7f2a6c003ee0 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081687542 0 0) 0x7f2a6c003230 con 0x7f2a6c00a7f0 2020-01-26T15:39:46.250 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a6c00e440 con 0x7f2a6c00a7f0 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186038825 0 0) 0x7f2a6c00f450 con 0x7f2a6c003a50 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 -- 172.21.15.170:0/3336691558 >> v1:172.21.15.170:6791/0 conn(0x7f2a6c003a50 legacy=0x7f2a6c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 -- 172.21.15.170:0/3336691558 >> v1:172.21.15.170:6790/0 conn(0x7f2a6c00a7f0 legacy=0x7f2a6c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a8b314700 1 -- 172.21.15.170:0/3336691558 reap_dead start 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 -- 172.21.15.170:0/3336691558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84121690 con 0x7f2a6c003ee0 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a84099a00 con 0x7f2a6c003ee0 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a84099e50 con 0x7f2a6c003ee0 2020-01-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2a7400c930 con 0x7f2a6c003ee0 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7400cb30 con 0x7f2a6c003ee0 2020-01-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2a740044f0 con 0x7f2a6c003ee0 2020-01-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.241+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a60003360 con 0x7f2a6c003ee0 2020-01-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.245+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f2a740046f0 con 0x7f2a6c003ee0 2020-01-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.245+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.245+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f2a7404cc70 con 0x7f2a6c003ee0 2020-01-26T15:39:46.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.249+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.254 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.249+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f2a74032dc0 con 0x7f2a6c003ee0 2020-01-26T15:39:46.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.405+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2a60003790 con 0x7f2a6c003ee0 2020-01-26T15:39:46.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.405+0000 7f2a890b0700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:46.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.405+0000 7f2a7a7fc700 1 -- 172.21.15.170:0/3336691558 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2a74033020 con 0x7f2a6c003ee0 2020-01-26T15:39:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 >> v1:172.21.15.170:6800/17396 conn(0x7f2a6c040980 legacy=0x7f2a6c042e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 msgr2=0x7f2a6c004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f2a74000f10 tx=0x7f2a740109c0).stop 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 shutdown_connections 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 --2- 172.21.15.170:0/3336691558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a6c003ee0 0x7f2a6c004da0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 >> 172.21.15.170:0/3336691558 conn(0x7f2a84024fa0 msgr2=0x7f2a8407def0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:46.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 shutdown_connections 2020-01-26T15:39:46.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:46.409+0000 7f2a8a0b2700 1 -- 172.21.15.170:0/3336691558 wait complete. 2020-01-26T15:39:46.421 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:49.422 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:49.552 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396a2bc700 1 Processor -- start 2020-01-26T15:39:49.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396a2bc700 1 -- start start 2020-01-26T15:39:49.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396a2bc700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f396405e5f0 0x7f39640a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:49.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396a2bc700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640a6dc0 con 0x7f3964149040 2020-01-26T15:39:49.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396a2bc700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396405ea20 con 0x7f396405edd0 2020-01-26T15:39:49.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396a2bc700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3964098000 con 0x7f396405e5f0 2020-01-26T15:39:49.553 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f39692ba700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f396405e5f0 0x7f39640a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:49.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396b51e700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3964149040 0x7f396414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52840/0 (socket says 172.21.15.170:52840) 2020-01-26T15:39:49.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f396b51e700 1 -- 172.21.15.170:0/3016460357 learned_addr learned my addr 172.21.15.170:0/3016460357 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:49.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f39692ba700 1 --2- 172.21.15.170:0/3016460357 >> v2:172.21.15.170:6791/0 conn(0x7f396405e5f0 0x7f39640a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:49.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f3969abb700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f396405edd0 0x7f396407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49712/0 (socket says 172.21.15.170:49712) 2020-01-26T15:39:49.554 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.541+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626646398 0 0) 0x7f39640a6dc0 con 0x7f3964149040 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3950003230 con 0x7f3964149040 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642482589 0 0) 0x7f396405ea20 con 0x7f396405edd0 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39640a6dc0 con 0x7f396405edd0 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1483853802 0 0) 0x7f3950003230 con 0x7f3964149040 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 >> v2:172.21.15.170:6791/0 conn(0x7f396405e5f0 msgr2=0x7f39640a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 --2- 172.21.15.170:0/3016460357 >> v2:172.21.15.170:6791/0 conn(0x7f396405e5f0 0x7f39640a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:49.555 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 >> v1:172.21.15.170:6790/0 conn(0x7f396405edd0 legacy=0x7f396407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396405e050 con 0x7f3964149040 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f395c001a90 con 0x7f3964149040 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 >> v1:172.21.15.170:6789/0 conn(0x7f3964149040 legacy=0x7f396414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3950003230 con 0x7f395000a7f0 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f396405ea20 con 0x7f39500045a0 2020-01-26T15:39:49.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964098000 con 0x7f3950003ac0 2020-01-26T15:39:49.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:49.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143215681 0 0) 0x7f396405ea20 con 0x7f39500045a0 2020-01-26T15:39:49.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 -- 172.21.15.170:0/3016460357 >> v1:172.21.15.170:6791/0 conn(0x7f39500045a0 legacy=0x7f39500049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 -- 172.21.15.170:0/3016460357 >> v1:172.21.15.170:6790/0 conn(0x7f395000a7f0 legacy=0x7f395000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 -- 172.21.15.170:0/3016460357 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950054530 con 0x7f3950003ac0 2020-01-26T15:39:49.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f395c001ec0 tx=0x7f395c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f395c001ec0 tx=0x7f395c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f395c001ec0 tx=0x7f395c0017a0).ready entity=mon.0 client_cookie=fc829fe05595ed8b server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f395c001ec0 tx=0x7f395c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3960010ab0 con 0x7f3950003ac0 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f395c001ec0 tx=0x7f395c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3960010cb0 con 0x7f3950003ac0 2020-01-26T15:39:49.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3969abb700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f395c001ec0 tx=0x7f395c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f3968ab9700 1 -- 172.21.15.170:0/3016460357 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f39600056d0 con 0x7f3950003ac0 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396a2bc700 1 -- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 msgr2=0x7f3950003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396a2bc700 1 --2- 172.21.15.170:0/3016460357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3950003ac0 0x7f3950003f10 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f395c001ec0 tx=0x7f395c0017a0).stop 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396b51e700 1 -- 172.21.15.170:0/3016460357 reap_dead start 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396a2bc700 1 -- 172.21.15.170:0/3016460357 shutdown_connections 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396a2bc700 1 -- 172.21.15.170:0/3016460357 >> 172.21.15.170:0/3016460357 conn(0x7f3964098e70 msgr2=0x7f39640a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:49.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396a2bc700 1 -- 172.21.15.170:0/3016460357 shutdown_connections 2020-01-26T15:39:49.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.545+0000 7f396a2bc700 1 -- 172.21.15.170:0/3016460357 wait complete. 2020-01-26T15:39:49.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 Processor -- start 2020-01-26T15:39:49.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 -- start start 2020-01-26T15:39:49.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f396411f620 0x7f3964123dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:49.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f39640a4b50 0x7f3964138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:49.564 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640a1ae0 con 0x7f3964099d70 2020-01-26T15:39:49.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3964124310 con 0x7f39640a4b50 2020-01-26T15:39:49.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396a2bc700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f39640a14e0 con 0x7f396411f620 2020-01-26T15:39:49.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396b51e700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f39640a4b50 0x7f3964138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:49.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f3969abb700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3964099d70 0x7f39640a4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52848/0 (socket says 172.21.15.170:52848) 2020-01-26T15:39:49.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f3969abb700 1 -- 172.21.15.170:0/2922844317 learned_addr learned my addr 172.21.15.170:0/2922844317 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:49.565 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f396b51e700 1 --2- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6790/0 conn(0x7f39640a4b50 0x7f3964138950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f39692ba700 -1 --2- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6791/0 conn(0x7f396411f620 0x7f3964123dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6791/0 conn(0x7f396411f620 0x7f3964123dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315083182 0 0) 0x7f39640a1ae0 con 0x7f3964099d70 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.549+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c003230 con 0x7f3964099d70 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2393244849 0 0) 0x7f394c003230 con 0x7f3964099d70 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39640a1ae0 con 0x7f3964099d70 2020-01-26T15:39:49.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f3960005e00 con 0x7f3964099d70 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6791/0 conn(0x7f396411f620 msgr2=0x7f3964123dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 --2- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6791/0 conn(0x7f396411f620 0x7f3964123dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6790/0 conn(0x7f39640a4b50 msgr2=0x7f3964138950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 --2- 172.21.15.170:0/2922844317 >> v2:172.21.15.170:6790/0 conn(0x7f39640a4b50 0x7f3964138950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 >> v1:172.21.15.170:6789/0 conn(0x7f3964099d70 legacy=0x7f39640a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:49.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f394c003230 con 0x7f394c003a20 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f394c00f450 con 0x7f394c00a7f0 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964124310 con 0x7f394c003eb0 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116953181 0 0) 0x7f394c003230 con 0x7f394c003a20 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c00e440 con 0x7f394c003a20 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357318923 0 0) 0x7f394c00f450 con 0x7f394c00a7f0 2020-01-26T15:39:49.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c003230 con 0x7f394c00a7f0 2020-01-26T15:39:49.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 -- 172.21.15.170:0/2922844317 >> v1:172.21.15.170:6791/0 conn(0x7f394c00a7f0 legacy=0x7f394c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 -- 172.21.15.170:0/2922844317 >> v1:172.21.15.170:6790/0 conn(0x7f394c003a20 legacy=0x7f394c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 -- 172.21.15.170:0/2922844317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640a0fb0 con 0x7f394c003eb0 2020-01-26T15:39:49.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f396b51e700 1 -- 172.21.15.170:0/2922844317 reap_dead start 2020-01-26T15:39:49.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.569 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3964123960 con 0x7f394c003eb0 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3964099d70 con 0x7f394c003eb0 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3954005880 con 0x7f394c003eb0 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.570 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954005a80 con 0x7f394c003eb0 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f39540112c0 con 0x7f394c003eb0 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f39540114c0 con 0x7f394c003eb0 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940003360 con 0x7f394c003eb0 2020-01-26T15:39:49.571 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.553+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f395404cd70 con 0x7f394c003eb0 2020-01-26T15:39:49.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.561+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.561+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f3954032ec0 con 0x7f394c003eb0 2020-01-26T15:39:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.717+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3940003790 con 0x7f394c003eb0 2020-01-26T15:39:49.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.717+0000 7f39692ba700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:49.721 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.717+0000 7f395a7fc700 1 -- 172.21.15.170:0/2922844317 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3954033120 con 0x7f394c003eb0 2020-01-26T15:39:49.721 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:49.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 >> v1:172.21.15.170:6800/17396 conn(0x7f394c040b80 legacy=0x7f394c043090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 msgr2=0x7f394c004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f3954000b80 tx=0x7f3954010970).stop 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 shutdown_connections 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 --2- 172.21.15.170:0/2922844317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f394c003eb0 0x7f394c004da0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 >> 172.21.15.170:0/2922844317 conn(0x7f39640970b0 msgr2=0x7f39641229c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 shutdown_connections 2020-01-26T15:39:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:49.721+0000 7f396a2bc700 1 -- 172.21.15.170:0/2922844317 wait complete. 2020-01-26T15:39:49.734 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:52.735 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 Processor -- start 2020-01-26T15:39:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 -- start start 2020-01-26T15:39:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f16700a5750 0x7f16700a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700a5b80 con 0x7f167005f250 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1670080440 con 0x7f16700a4b50 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f16700a43f0 con 0x7f16700a5750 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166f7fe700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f16700a5750 0x7f16700a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166ffff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f167005f250 0x7f167014bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49742/0 (socket says 172.21.15.170:49742) 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166ffff700 1 -- 172.21.15.170:0/2464169384 learned_addr learned my addr 172.21.15.170:0/2464169384 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166effd700 1 --1- 172.21.15.170:0/2464169384 >> v1:172.21.15.170:6791/0 conn(0x7f16700a4b50 0x7f167005ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44864/0 (socket says 172.21.15.170:44864) 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166f7fe700 1 --2- 172.21.15.170:0/2464169384 >> v2:172.21.15.170:6790/0 conn(0x7f16700a5750 0x7f16700a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380898554 0 0) 0x7f1670080440 con 0x7f16700a4b50 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1650003230 con 0x7f16700a4b50 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995640491 0 0) 0x7f16700a5b80 con 0x7f167005f250 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1670080440 con 0x7f167005f250 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 171234877 0 0) 0x7f1650003230 con 0x7f16700a4b50 2020-01-26T15:39:52.860 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 >> v2:172.21.15.170:6790/0 conn(0x7f16700a5750 msgr2=0x7f16700a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 --2- 172.21.15.170:0/2464169384 >> v2:172.21.15.170:6790/0 conn(0x7f16700a5750 0x7f16700a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 >> v1:172.21.15.170:6790/0 conn(0x7f167005f250 legacy=0x7f167014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700a3210 con 0x7f16700a4b50 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1668001a90 con 0x7f16700a4b50 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1668001d60 con 0x7f16700a4b50 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f166e7fc700 1 -- 172.21.15.170:0/2464169384 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1668004870 con 0x7f16700a4b50 2020-01-26T15:39:52.861 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.848+0000 7f1675454700 1 -- 172.21.15.170:0/2464169384 >> v1:172.21.15.170:6791/0 conn(0x7f16700a4b50 legacy=0x7f167005ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- 172.21.15.170:0/2464169384 shutdown_connections 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 --2- 172.21.15.170:0/2464169384 >> v2:172.21.15.170:6790/0 conn(0x7f16700a5750 0x7f16700a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- 172.21.15.170:0/2464169384 >> 172.21.15.170:0/2464169384 conn(0x7f167005e050 msgr2=0x7f1670098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- 172.21.15.170:0/2464169384 shutdown_connections 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- 172.21.15.170:0/2464169384 wait complete. 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 Processor -- start 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- start start 2020-01-26T15:39:52.862 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f16700a1e80 0x7f16700a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700a1330 con 0x7f167007ea00 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167007f630 con 0x7f1670093940 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1675454700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1670124510 con 0x7f16700a1e80 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f166effd700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f16700a1e80 0x7f16700a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f166f7fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f1670093940 0x7f1670065c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49744/0 (socket says 172.21.15.170:49744) 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f166f7fe700 1 -- 172.21.15.170:0/2305625621 learned_addr learned my addr 172.21.15.170:0/2305625621 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:52.863 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f166effd700 1 --2- 172.21.15.170:0/2305625621 >> v2:172.21.15.170:6791/0 conn(0x7f16700a1e80 0x7f16700a0de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212769554 0 0) 0x7f167007f630 con 0x7f1670093940 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1648003230 con 0x7f1670093940 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910681752 0 0) 0x7f16700a1330 con 0x7f167007ea00 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f167007f630 con 0x7f167007ea00 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 908347936 0 0) 0x7f1648003230 con 0x7f1670093940 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f16700a1330 con 0x7f1670093940 2020-01-26T15:39:52.864 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.852+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f1660002780 con 0x7f1670093940 2020-01-26T15:39:52.865 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1517576804 0 0) 0x7f16700a1330 con 0x7f1670093940 2020-01-26T15:39:52.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 >> v2:172.21.15.170:6791/0 conn(0x7f16700a1e80 msgr2=0x7f16700a0de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:52.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 --2- 172.21.15.170:0/2305625621 >> v2:172.21.15.170:6791/0 conn(0x7f16700a1e80 0x7f16700a0de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:52.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 >> v1:172.21.15.170:6789/0 conn(0x7f167007ea00 legacy=0x7f167007ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:52.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1670065780 con 0x7f1670093940 2020-01-26T15:39:52.866 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167013bcf0 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f167013c240 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1660000f10 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f16600012f0 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f16600014f0 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f166004bb40 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.856+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c003360 con 0x7f1670093940 2020-01-26T15:39:52.867 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:52.860+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1660031060 con 0x7f1670093940 2020-01-26T15:39:53.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f164c0037d0 con 0x7f1670093940 2020-01-26T15:39:53.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1667fff700 1 -- 172.21.15.170:0/2305625621 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f166004a750 con 0x7f1670093940 2020-01-26T15:39:53.020 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:53.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 >> v1:172.21.15.170:6800/17396 conn(0x7f164803e260 legacy=0x7f1648040770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:53.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 >> v1:172.21.15.170:6790/0 conn(0x7f1670093940 legacy=0x7f1670065c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:53.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 shutdown_connections 2020-01-26T15:39:53.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 --2- 172.21.15.170:0/2305625621 >> v2:172.21.15.170:6791/0 conn(0x7f16700a1e80 0x7f16700a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:53.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 >> 172.21.15.170:0/2305625621 conn(0x7f16700a4110 msgr2=0x7f167011cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:53.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 shutdown_connections 2020-01-26T15:39:53.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:53.016+0000 7f1675454700 1 -- 172.21.15.170:0/2305625621 wait complete. 2020-01-26T15:39:53.038 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:56.039 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:56.162 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031d34700 1 Processor -- start 2020-01-26T15:39:56.162 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031d34700 1 -- start start 2020-01-26T15:39:56.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031d34700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff02c05edd0 0x7ff02c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:56.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031d34700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c098000 con 0x7ff02c0a6870 2020-01-26T15:39:56.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031d34700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c05e050 con 0x7ff02c149040 2020-01-26T15:39:56.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031d34700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0a6ca0 con 0x7ff02c05edd0 2020-01-26T15:39:56.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031533700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff02c05edd0 0x7ff02c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:56.163 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff031533700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff02c05edd0 0x7ff02c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff032f96700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff02c149040 0x7ff02c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49754/0 (socket says 172.21.15.170:49754) 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff032f96700 1 -- 172.21.15.170:0/3347970460 learned_addr learned my addr 172.21.15.170:0/3347970460 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff030d32700 1 --1- 172.21.15.170:0/3347970460 >> v1:172.21.15.170:6789/0 conn(0x7ff02c0a6870 0x7ff02c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52878/0 (socket says 172.21.15.170:52878) 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037272411 0 0) 0x7ff02c098000 con 0x7ff02c0a6870 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff018003230 con 0x7ff02c0a6870 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644724242 0 0) 0x7ff02c05e050 con 0x7ff02c149040 2020-01-26T15:39:56.164 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.152+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c098000 con 0x7ff02c149040 2020-01-26T15:39:56.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 422547389 0 0) 0x7ff018003230 con 0x7ff02c0a6870 2020-01-26T15:39:56.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 >> v2:172.21.15.170:6791/0 conn(0x7ff02c05edd0 msgr2=0x7ff02c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:56.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 --2- 172.21.15.170:0/3347970460 >> v2:172.21.15.170:6791/0 conn(0x7ff02c05edd0 0x7ff02c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:56.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 >> v1:172.21.15.170:6790/0 conn(0x7ff02c149040 legacy=0x7ff02c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.165 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c14ecb0 con 0x7ff02c0a6870 2020-01-26T15:39:56.166 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff020001710 con 0x7ff02c0a6870 2020-01-26T15:39:56.166 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 >> v1:172.21.15.170:6789/0 conn(0x7ff02c0a6870 legacy=0x7ff02c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.166 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff018003230 con 0x7ff01800a7f0 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff02c098000 con 0x7ff018004b20 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0a6ca0 con 0x7ff018004f70 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697286574 0 0) 0x7ff02c098000 con 0x7ff018004b20 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c05e050 con 0x7ff018004b20 2020-01-26T15:39:56.167 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324292481 0 0) 0x7ff018003230 con 0x7ff01800a7f0 2020-01-26T15:39:56.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c098000 con 0x7ff01800a7f0 2020-01-26T15:39:56.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 -- 172.21.15.170:0/3347970460 >> v1:172.21.15.170:6791/0 conn(0x7ff018004b20 legacy=0x7ff018003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 -- 172.21.15.170:0/3347970460 >> v1:172.21.15.170:6790/0 conn(0x7ff01800a7f0 legacy=0x7ff01800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 -- 172.21.15.170:0/3347970460 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018054560 con 0x7ff018004f70 2020-01-26T15:39:56.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff020001520 tx=0x7ff02000c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:56.168 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff020001520 tx=0x7ff02000c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7ff020001520 tx=0x7ff02000c150).ready entity=mon.0 client_cookie=7e1eea5f46e067b8 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff020001520 tx=0x7ff02000c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff020010310 con 0x7ff018004f70 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff020001520 tx=0x7ff02000c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff030d32700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7ff020001520 tx=0x7ff02000c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff020010510 con 0x7ff018004f70 2020-01-26T15:39:56.169 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff01ffff700 1 -- 172.21.15.170:0/3347970460 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff020005520 con 0x7ff018004f70 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff031d34700 1 -- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 msgr2=0x7ff018003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff031d34700 1 --2- 172.21.15.170:0/3347970460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff018004f70 0x7ff018003d40 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7ff020001520 tx=0x7ff02000c150).stop 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff032f96700 1 -- 172.21.15.170:0/3347970460 reap_dead start 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff031d34700 1 -- 172.21.15.170:0/3347970460 shutdown_connections 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff031d34700 1 -- 172.21.15.170:0/3347970460 >> 172.21.15.170:0/3347970460 conn(0x7ff02c098e70 msgr2=0x7ff02c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff031d34700 1 -- 172.21.15.170:0/3347970460 shutdown_connections 2020-01-26T15:39:56.170 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.156+0000 7ff031d34700 1 -- 172.21.15.170:0/3347970460 wait complete. 2020-01-26T15:39:56.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031d34700 1 Processor -- start 2020-01-26T15:39:56.174 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031d34700 1 -- start start 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031d34700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff02c062700 0x7ff02c024860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031d34700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c060750 con 0x7ff02c1363d0 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031d34700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c130ff0 con 0x7ff02c07db90 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031d34700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0254c0 con 0x7ff02c062700 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031533700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff02c07db90 0x7ff02c061f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44890/0 (socket says 172.21.15.170:44890) 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff030d32700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff02c062700 0x7ff02c024860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:56.175 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff032f96700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff02c1363d0 0x7ff02c138810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49766/0 (socket says 172.21.15.170:49766) 2020-01-26T15:39:56.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff031533700 1 -- 172.21.15.170:0/226199425 learned_addr learned my addr 172.21.15.170:0/226199425 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:56.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff030d32700 1 --2- 172.21.15.170:0/226199425 >> v2:172.21.15.170:6791/0 conn(0x7ff02c062700 0x7ff02c024860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867015533 0 0) 0x7ff02c130ff0 con 0x7ff02c07db90 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff00c003230 con 0x7ff02c07db90 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425297512 0 0) 0x7ff02c060750 con 0x7ff02c1363d0 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.160+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c130ff0 con 0x7ff02c1363d0 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2479288873 0 0) 0x7ff00c003230 con 0x7ff02c07db90 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff02c060750 con 0x7ff02c07db90 2020-01-26T15:39:56.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff0280016a0 con 0x7ff02c07db90 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 514392395 0 0) 0x7ff02c130ff0 con 0x7ff02c1363d0 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff00c003230 con 0x7ff02c1363d0 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff024001770 con 0x7ff02c1363d0 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3448147059 0 0) 0x7ff02c060750 con 0x7ff02c07db90 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 >> v2:172.21.15.170:6791/0 conn(0x7ff02c062700 msgr2=0x7ff02c024860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 --2- 172.21.15.170:0/226199425 >> v2:172.21.15.170:6791/0 conn(0x7ff02c062700 0x7ff02c024860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 >> v1:172.21.15.170:6790/0 conn(0x7ff02c1363d0 legacy=0x7ff02c138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.178 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c09e510 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c060b90 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c13a020 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff028001970 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff028001d90 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff004003360 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7ff028001f90 con 0x7ff02c07db90 2020-01-26T15:39:56.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.164+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7ff02804ba50 con 0x7ff02c07db90 2020-01-26T15:39:56.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.172+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7ff028030f70 con 0x7ff02c07db90 2020-01-26T15:39:56.333 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.328+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff0040037d0 con 0x7ff02c07db90 2020-01-26T15:39:56.334 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.328+0000 7ff01dffb700 1 -- 172.21.15.170:0/226199425 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7ff02804a6c0 con 0x7ff02c07db90 2020-01-26T15:39:56.334 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:56.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 >> v1:172.21.15.170:6800/17396 conn(0x7ff00c03e500 legacy=0x7ff00c040a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.336 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 >> v1:172.21.15.170:6791/0 conn(0x7ff02c07db90 legacy=0x7ff02c061f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 shutdown_connections 2020-01-26T15:39:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 --2- 172.21.15.170:0/226199425 >> v2:172.21.15.170:6791/0 conn(0x7ff02c062700 0x7ff02c024860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 >> 172.21.15.170:0/226199425 conn(0x7ff02c05f150 msgr2=0x7ff02c0a3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 shutdown_connections 2020-01-26T15:39:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:56.332+0000 7ff031d34700 1 -- 172.21.15.170:0/226199425 wait complete. 2020-01-26T15:39:56.353 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:39:59.354 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:39:59.475 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a8121700 1 Processor -- start 2020-01-26T15:39:59.475 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a8121700 1 -- start start 2020-01-26T15:39:59.475 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a8121700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f22a014a880 0x7f22a014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:59.475 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a8121700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00a5b80 con 0x7f22a0146c30 2020-01-26T15:39:59.475 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a8121700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a0080440 con 0x7f22a00a5750 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a8121700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f22a00a43f0 con 0x7f22a014a880 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a66be700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f22a00a5750 0x7f22a00a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44898/0 (socket says 172.21.15.170:44898) 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a66be700 1 -- 172.21.15.170:0/4050328635 learned_addr learned my addr 172.21.15.170:0/4050328635 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a6ebf700 -1 --2- 172.21.15.170:0/4050328635 >> v2:172.21.15.170:6791/0 conn(0x7f22a014a880 0x7f22a014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a6ebf700 1 --2- 172.21.15.170:0/4050328635 >> v2:172.21.15.170:6791/0 conn(0x7f22a014a880 0x7f22a014ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359408422 0 0) 0x7f22a0080440 con 0x7f22a00a5750 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2288003230 con 0x7f22a00a5750 2020-01-26T15:39:59.476 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240982223 0 0) 0x7f22a00a5b80 con 0x7f22a0146c30 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a0080440 con 0x7f22a0146c30 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.464+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4285559847 0 0) 0x7f22a0080440 con 0x7f22a0146c30 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 >> v2:172.21.15.170:6791/0 conn(0x7f22a014a880 msgr2=0x7f22a014ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 --2- 172.21.15.170:0/4050328635 >> v2:172.21.15.170:6791/0 conn(0x7f22a014a880 0x7f22a014ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 >> v1:172.21.15.170:6791/0 conn(0x7f22a00a5750 legacy=0x7f22a00a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a00a4e00 con 0x7f22a0146c30 2020-01-26T15:39:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2294001670 con 0x7f22a0146c30 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 >> v1:172.21.15.170:6789/0 conn(0x7f22a0146c30 legacy=0x7f22a0149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f22a0080440 con 0x7f2288004af0 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2288003230 con 0x7f228800a7f0 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00a43f0 con 0x7f2288004f40 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:39:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980493888 0 0) 0x7f22a0080440 con 0x7f2288004af0 2020-01-26T15:39:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a00a5b80 con 0x7f2288004af0 2020-01-26T15:39:59.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161081362 0 0) 0x7f2288003230 con 0x7f228800a7f0 2020-01-26T15:39:59.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a0080440 con 0x7f228800a7f0 2020-01-26T15:39:59.480 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 -- 172.21.15.170:0/4050328635 >> v1:172.21.15.170:6791/0 conn(0x7f228800a7f0 legacy=0x7f228800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.481 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2196640296 0 0) 0x7f22a0080440 con 0x7f228800a7f0 2020-01-26T15:39:59.481 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 -- 172.21.15.170:0/4050328635 >> v1:172.21.15.170:6790/0 conn(0x7f2288004af0 legacy=0x7f2288003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.481 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 -- 172.21.15.170:0/4050328635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288054470 con 0x7f2288004f40 2020-01-26T15:39:59.481 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2298001640 tx=0x7f229400bfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:59.481 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2298001640 tx=0x7f229400bfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f2298001640 tx=0x7f229400bfa0).ready entity=mon.0 client_cookie=aef6ff12f7efb88 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f2298001640 tx=0x7f229400bfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2298001400 con 0x7f2288004f40 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f2298001640 tx=0x7f229400bfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229400ea20 con 0x7f2288004f40 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f2298001640 tx=0x7f229400bfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:39:59.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a56bc700 1 -- 172.21.15.170:0/4050328635 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f229400edc0 con 0x7f2288004f40 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a8121700 1 -- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 msgr2=0x7f2288003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a8121700 1 --2- 172.21.15.170:0/4050328635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2288004f40 0x7f2288003d40 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f2298001640 tx=0x7f229400bfa0).stop 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a6ebf700 1 -- 172.21.15.170:0/4050328635 reap_dead start 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a8121700 1 -- 172.21.15.170:0/4050328635 shutdown_connections 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a8121700 1 -- 172.21.15.170:0/4050328635 >> 172.21.15.170:0/4050328635 conn(0x7f22a005e050 msgr2=0x7f22a0098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a8121700 1 -- 172.21.15.170:0/4050328635 shutdown_connections 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.468+0000 7f22a8121700 1 -- 172.21.15.170:0/4050328635 wait complete. 2020-01-26T15:39:59.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 Processor -- start 2020-01-26T15:39:59.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 -- start start 2020-01-26T15:39:59.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f22a008fb10 0x7f22a0133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:59.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f22a0138670 0x7f22a013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:39:59.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00621d0 con 0x7f22a0090810 2020-01-26T15:39:59.486 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0061930 con 0x7f22a008fb10 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0090c40 con 0x7f22a0138670 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a5ebd700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f22a008fb10 0x7f22a0133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a66be700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f22a0090810 0x7f22a0133290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49788/0 (socket says 172.21.15.170:49788) 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a66be700 1 -- 172.21.15.170:0/381565481 learned_addr learned my addr 172.21.15.170:0/381565481 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a6ebf700 -1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6791/0 conn(0x7f22a0138670 0x7f22a013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a5ebd700 1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6790/0 conn(0x7f22a008fb10 0x7f22a0133a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:59.487 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a6ebf700 1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6791/0 conn(0x7f22a0138670 0x7f22a013aab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528742049 0 0) 0x7f22a00a5b80 con 0x7f22a0090810 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003230 con 0x7f22a0090810 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 973920880 0 0) 0x7f2280003230 con 0x7f22a0090810 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22a00a5b80 con 0x7f22a0090810 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2290001d20 con 0x7f22a0090810 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1665335813 0 0) 0x7f22a00a5b80 con 0x7f22a0090810 2020-01-26T15:39:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6791/0 conn(0x7f22a0138670 msgr2=0x7f22a013aab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6791/0 conn(0x7f22a0138670 0x7f22a013aab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6790/0 conn(0x7f22a008fb10 msgr2=0x7f22a0133a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6790/0 conn(0x7f22a008fb10 0x7f22a0133a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0133fe0 con 0x7f22a0090810 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a008f4b0 con 0x7f22a0090810 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a008ff40 con 0x7f22a0090810 2020-01-26T15:39:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2290004ce0 con 0x7f22a0090810 2020-01-26T15:39:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.472+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2290005080 con 0x7f22a0090810 2020-01-26T15:39:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.476+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c003360 con 0x7f22a0090810 2020-01-26T15:39:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.476+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f2290005300 con 0x7f22a0090810 2020-01-26T15:39:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.476+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f22a00621d0 con 0x7f22a0090810 2020-01-26T15:39:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.480+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f2290031570 con 0x7f22a0090810 2020-01-26T15:39:59.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.632+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f227c0037d0 con 0x7f22a0090810 2020-01-26T15:39:59.638 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f229effd700 1 -- 172.21.15.170:0/381565481 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f2290005690 con 0x7f22a0090810 2020-01-26T15:39:59.639 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:39:59.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 >> v1:172.21.15.170:6800/17396 conn(0x7f228003e070 legacy=0x7f2280040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 >> v1:172.21.15.170:6790/0 conn(0x7f22a0090810 legacy=0x7f22a0133290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:39:59.641 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 shutdown_connections 2020-01-26T15:39:59.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6791/0 conn(0x7f22a0138670 0x7f22a013aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:59.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 --2- 172.21.15.170:0/381565481 >> v2:172.21.15.170:6790/0 conn(0x7f22a008fb10 0x7f22a0133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:39:59.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 >> 172.21.15.170:0/381565481 conn(0x7f22a0098e50 msgr2=0x7f22a005ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:39:59.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 shutdown_connections 2020-01-26T15:39:59.642 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:39:59.636+0000 7f22a8121700 1 -- 172.21.15.170:0/381565481 wait complete. 2020-01-26T15:39:59.659 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:02.666 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:02.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 Processor -- start 2020-01-26T15:40:02.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- start start 2020-01-26T15:40:02.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f493c05e5f0 0x7f493c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:02.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0a6dc0 con 0x7f493c05edd0 2020-01-26T15:40:02.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c05ea20 con 0x7f493c149040 2020-01-26T15:40:02.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f493c098000 con 0x7f493c05e5f0 2020-01-26T15:40:02.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493affd700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f493c05e5f0 0x7f493c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:02.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493b7fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f493c05edd0 0x7f493c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49792/0 (socket says 172.21.15.170:49792) 2020-01-26T15:40:02.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493affd700 1 --2- 172.21.15.170:0/176321900 >> v2:172.21.15.170:6790/0 conn(0x7f493c05e5f0 0x7f493c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:02.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493b7fe700 1 -- 172.21.15.170:0/176321900 learned_addr learned my addr 172.21.15.170:0/176321900 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:02.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f4941646700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f493c149040 0x7f493c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44922/0 (socket says 172.21.15.170:44922) 2020-01-26T15:40:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129014737 0 0) 0x7f493c05ea20 con 0x7f493c149040 2020-01-26T15:40:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4928003230 con 0x7f493c149040 2020-01-26T15:40:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157171910 0 0) 0x7f493c0a6dc0 con 0x7f493c05edd0 2020-01-26T15:40:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f493c05ea20 con 0x7f493c05edd0 2020-01-26T15:40:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2462288154 0 0) 0x7f4928003230 con 0x7f493c149040 2020-01-26T15:40:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 >> v2:172.21.15.170:6790/0 conn(0x7f493c05e5f0 msgr2=0x7f493c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 --2- 172.21.15.170:0/176321900 >> v2:172.21.15.170:6790/0 conn(0x7f493c05e5f0 0x7f493c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 >> v1:172.21.15.170:6790/0 conn(0x7f493c05edd0 legacy=0x7f493c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c05e050 con 0x7f493c149040 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4934001a90 con 0x7f493c149040 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4934001d60 con 0x7f493c149040 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- 172.21.15.170:0/176321900 >> v1:172.21.15.170:6791/0 conn(0x7f493c149040 legacy=0x7f493c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.790 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493a7fc700 1 -- 172.21.15.170:0/176321900 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4934004870 con 0x7f493c149040 2020-01-26T15:40:02.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- 172.21.15.170:0/176321900 shutdown_connections 2020-01-26T15:40:02.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 --2- 172.21.15.170:0/176321900 >> v2:172.21.15.170:6790/0 conn(0x7f493c05e5f0 0x7f493c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:02.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- 172.21.15.170:0/176321900 >> 172.21.15.170:0/176321900 conn(0x7f493c098e70 msgr2=0x7f493c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:02.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- 172.21.15.170:0/176321900 shutdown_connections 2020-01-26T15:40:02.791 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.780+0000 7f493bfff700 1 -- 172.21.15.170:0/176321900 wait complete. 2020-01-26T15:40:02.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493bfff700 1 Processor -- start 2020-01-26T15:40:02.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493bfff700 1 -- start start 2020-01-26T15:40:02.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493bfff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f493c07a1b0 0x7f493c13be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:02.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493bfff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0a3b90 con 0x7f493c11e270 2020-01-26T15:40:02.795 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493bfff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c09e150 con 0x7f493c11f770 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493bfff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0991a0 con 0x7f493c07a1b0 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493affd700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f493c11f770 0x7f493c0799b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49798/0 (socket says 172.21.15.170:49798) 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493affd700 1 -- 172.21.15.170:0/2752029975 learned_addr learned my addr 172.21.15.170:0/2752029975 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4941646700 -1 --2- 172.21.15.170:0/2752029975 >> v2:172.21.15.170:6791/0 conn(0x7f493c07a1b0 0x7f493c13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4941646700 1 --2- 172.21.15.170:0/2752029975 >> v2:172.21.15.170:6791/0 conn(0x7f493c07a1b0 0x7f493c13be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876939040 0 0) 0x7f493c09e150 con 0x7f493c11f770 2020-01-26T15:40:02.796 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4920003230 con 0x7f493c11f770 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004921797 0 0) 0x7f493c0a3b90 con 0x7f493c11e270 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f493c09e150 con 0x7f493c11e270 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 618448764 0 0) 0x7f4920003230 con 0x7f493c11f770 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f493c0a3b90 con 0x7f493c11f770 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f4924002780 con 0x7f493c11f770 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 270438792 0 0) 0x7f493c09e150 con 0x7f493c11e270 2020-01-26T15:40:02.797 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4920003230 con 0x7f493c11e270 2020-01-26T15:40:02.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f492c001790 con 0x7f493c11e270 2020-01-26T15:40:02.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 >> v2:172.21.15.170:6791/0 conn(0x7f493c07a1b0 msgr2=0x7f493c13be80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:02.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 --2- 172.21.15.170:0/2752029975 >> v2:172.21.15.170:6791/0 conn(0x7f493c07a1b0 0x7f493c13be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:02.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 >> v1:172.21.15.170:6790/0 conn(0x7f493c11f770 legacy=0x7f493c0799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 >> v1:172.21.15.170:6789/0 conn(0x7f493c11e270 legacy=0x7f493c11ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.798 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:02.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f493c09e150 con 0x7f4920003a90 2020-01-26T15:40:02.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f492000f820 con 0x7f4920003ec0 2020-01-26T15:40:02.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0991a0 con 0x7f4920004f00 2020-01-26T15:40:02.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:02.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493b7fe700 1 -- 172.21.15.170:0/2752029975 >> v1:172.21.15.170:6791/0 conn(0x7f4920003ec0 legacy=0x7f492000d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.799 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493b7fe700 1 -- 172.21.15.170:0/2752029975 >> v1:172.21.15.170:6790/0 conn(0x7f4920003a90 legacy=0x7f49200097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64692366 0 0) 0x7f493c09e150 con 0x7f4920003a90 2020-01-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.784+0000 7f493b7fe700 1 -- 172.21.15.170:0/2752029975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f493c07a5e0 con 0x7f4920004f00 2020-01-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c11f770 con 0x7f4920004f00 2020-01-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c0799b0 con 0x7f4920004f00 2020-01-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:02.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f492c00c8e0 con 0x7f4920004f00 2020-01-26T15:40:02.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.801 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00cae0 con 0x7f4920004f00 2020-01-26T15:40:02.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914003360 con 0x7f4920004f00 2020-01-26T15:40:02.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f492c00ccd0 con 0x7f4920004f00 2020-01-26T15:40:02.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.802 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.788+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f492c04d270 con 0x7f4920004f00 2020-01-26T15:40:02.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.796+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.803 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.796+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f492c033440 con 0x7f4920004f00 2020-01-26T15:40:02.956 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.952+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4914003790 con 0x7f4920004f00 2020-01-26T15:40:02.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.952+0000 7f493b7fe700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:02.957 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.952+0000 7f4933fff700 1 -- 172.21.15.170:0/2752029975 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f492c0336a0 con 0x7f4920004f00 2020-01-26T15:40:02.958 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 >> v1:172.21.15.170:6800/17396 conn(0x7f49200485d0 legacy=0x7f492004aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 msgr2=0x7f4920003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 --2- 172.21.15.170:0/2752029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4920004f00 0x7f4920003540 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f492c000ed0 tx=0x7f492c011340).stop 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f4941646700 1 -- 172.21.15.170:0/2752029975 reap_dead start 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 shutdown_connections 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 >> 172.21.15.170:0/2752029975 conn(0x7f493c07f500 msgr2=0x7f493c07e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:02.959 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 shutdown_connections 2020-01-26T15:40:02.960 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:02.956+0000 7f493bfff700 1 -- 172.21.15.170:0/2752029975 wait complete. 2020-01-26T15:40:02.970 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:05.971 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:06.094 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.083+0000 7ff8ac8f2700 1 Processor -- start 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.083+0000 7ff8ac8f2700 1 -- start start 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff8a8146c30 0x7ff8a8149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a80a5b80 con 0x7ff8a80a5750 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a8080440 con 0x7ff8a81495c0 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80a43f0 con 0x7ff8a8146c30 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a659c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff8a8146c30 0x7ff8a8149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:06.095 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a6d9d700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff8a80a5750 0x7ff8a80a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49812/0 (socket says 172.21.15.170:49812) 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a6d9d700 1 -- 172.21.15.170:0/2627960637 learned_addr learned my addr 172.21.15.170:0/2627960637 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a659c700 1 --2- 172.21.15.170:0/2627960637 >> v2:172.21.15.170:6791/0 conn(0x7ff8a8146c30 0x7ff8a8149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a759e700 1 --1- 172.21.15.170:0/2627960637 >> v1:172.21.15.170:6791/0 conn(0x7ff8a81495c0 0x7ff8a814ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44942/0 (socket says 172.21.15.170:44942) 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523145402 0 0) 0x7ff8a8080440 con 0x7ff8a81495c0 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff890003230 con 0x7ff8a81495c0 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623746814 0 0) 0x7ff8a80a5b80 con 0x7ff8a80a5750 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a8080440 con 0x7ff8a80a5750 2020-01-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4140591701 0 0) 0x7ff890003230 con 0x7ff8a81495c0 2020-01-26T15:40:06.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 >> v2:172.21.15.170:6791/0 conn(0x7ff8a8146c30 msgr2=0x7ff8a8149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:06.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 --2- 172.21.15.170:0/2627960637 >> v2:172.21.15.170:6791/0 conn(0x7ff8a8146c30 0x7ff8a8149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:06.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 >> v1:172.21.15.170:6790/0 conn(0x7ff8a80a5750 legacy=0x7ff8a80a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.097 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80a4e00 con 0x7ff8a81495c0 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff8a0001710 con 0x7ff8a81495c0 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff8a00019e0 con 0x7ff8a81495c0 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8a5d9b700 1 -- 172.21.15.170:0/2627960637 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff8a00044f0 con 0x7ff8a81495c0 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/2627960637 >> v1:172.21.15.170:6791/0 conn(0x7ff8a81495c0 legacy=0x7ff8a814ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/2627960637 shutdown_connections 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 --2- 172.21.15.170:0/2627960637 >> v2:172.21.15.170:6791/0 conn(0x7ff8a8146c30 0x7ff8a8149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/2627960637 >> 172.21.15.170:0/2627960637 conn(0x7ff8a805e050 msgr2=0x7ff8a8098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:06.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/2627960637 shutdown_connections 2020-01-26T15:40:06.099 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.087+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/2627960637 wait complete. 2020-01-26T15:40:06.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8ac8f2700 1 Processor -- start 2020-01-26T15:40:06.102 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8ac8f2700 1 -- start start 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8ac8f2700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff8a8062b10 0x7ff8a8061550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8ac8f2700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a8062020 con 0x7ff8a8061bf0 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8ac8f2700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a8121210 con 0x7ff8a8060820 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8ac8f2700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80630c0 con 0x7ff8a8062b10 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8a659c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff8a8062b10 0x7ff8a8061550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8a6d9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff8a8060820 0x7ff8a8095e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44944/0 (socket says 172.21.15.170:44944) 2020-01-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8a6d9d700 1 -- 172.21.15.170:0/3018956217 learned_addr learned my addr 172.21.15.170:0/3018956217 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8a659c700 1 --2- 172.21.15.170:0/3018956217 >> v2:172.21.15.170:6790/0 conn(0x7ff8a8062b10 0x7ff8a8061550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418902873 0 0) 0x7ff8a8121210 con 0x7ff8a8060820 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff88c003230 con 0x7ff8a8060820 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656156821 0 0) 0x7ff8a00019e0 con 0x7ff8a8061bf0 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a8121210 con 0x7ff8a8061bf0 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2237320394 0 0) 0x7ff88c003230 con 0x7ff8a8060820 2020-01-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8a00019e0 con 0x7ff8a8060820 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.091+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff898001bd0 con 0x7ff8a8060820 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 734982730 0 0) 0x7ff8a8121210 con 0x7ff8a8061bf0 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff88c003230 con 0x7ff8a8061bf0 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff8a00044f0 con 0x7ff8a8061bf0 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 >> v2:172.21.15.170:6790/0 conn(0x7ff8a8062b10 msgr2=0x7ff8a8061550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 --2- 172.21.15.170:0/3018956217 >> v2:172.21.15.170:6790/0 conn(0x7ff8a8062b10 0x7ff8a8061550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 >> v1:172.21.15.170:6791/0 conn(0x7ff8a8060820 legacy=0x7ff8a8095e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 >> v1:172.21.15.170:6789/0 conn(0x7ff8a8061bf0 legacy=0x7ff8a8096690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff8a8121210 con 0x7ff88c003ec0 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff88c00f820 con 0x7ff88c003a90 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80630c0 con 0x7ff88c004f00 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239248391 0 0) 0x7ff8a8121210 con 0x7ff88c003ec0 2020-01-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff88c00fa50 con 0x7ff88c003ec0 2020-01-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002529579 0 0) 0x7ff88c00f820 con 0x7ff88c003a90 2020-01-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a8121210 con 0x7ff88c003a90 2020-01-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1408993744 0 0) 0x7ff88c00fa50 con 0x7ff88c003ec0 2020-01-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 -- 172.21.15.170:0/3018956217 >> v1:172.21.15.170:6791/0 conn(0x7ff88c003a90 legacy=0x7ff88c0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 -- 172.21.15.170:0/3018956217 >> v1:172.21.15.170:6790/0 conn(0x7ff88c003ec0 legacy=0x7ff88c00d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 -- 172.21.15.170:0/3018956217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7ff8a81216a0 con 0x7ff88c004f00 2020-01-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a8060820 con 0x7ff88c004f00 2020-01-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a8095e90 con 0x7ff88c004f00 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff8a0004d00 con 0x7ff88c004f00 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.109 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898004870 con 0x7ff88c004f00 2020-01-26T15:40:06.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff880003360 con 0x7ff88c004f00 2020-01-26T15:40:06.110 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.095+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.099+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ff898004b30 con 0x7ff88c004f00 2020-01-26T15:40:06.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.099+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.099+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ff89804d940 con 0x7ff88c004f00 2020-01-26T15:40:06.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.103+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.111 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.103+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ff898033af0 con 0x7ff88c004f00 2020-01-26T15:40:06.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8800036b0 con 0x7ff88c004f00 2020-01-26T15:40:06.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8a6d9d700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:06.265 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8977fe700 1 -- 172.21.15.170:0/3018956217 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff898033d50 con 0x7ff88c004f00 2020-01-26T15:40:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:06.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 >> v1:172.21.15.170:6800/17396 conn(0x7ff88c048860 legacy=0x7ff88c04ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.266 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 msgr2=0x7ff88c003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8a759e700 1 -- 172.21.15.170:0/3018956217 reap_dead start 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7ff8a0001090 tx=0x7ff8a0000f20).stop 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 shutdown_connections 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 --2- 172.21.15.170:0/3018956217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff88c004f00 0x7ff88c003540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 >> 172.21.15.170:0/3018956217 conn(0x7ff8a80979c0 msgr2=0x7ff8a8123e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 shutdown_connections 2020-01-26T15:40:06.267 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:06.259+0000 7ff8ac8f2700 1 -- 172.21.15.170:0/3018956217 wait complete. 2020-01-26T15:40:06.278 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:09.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.387+0000 7ff1d7fff700 1 Processor -- start 2020-01-26T15:40:09.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.387+0000 7ff1d7fff700 1 -- start start 2020-01-26T15:40:09.398 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff1d80a6870 0x7ff1d814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:09.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d805ea20 con 0x7ff1d805e5f0 2020-01-26T15:40:09.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d8098000 con 0x7ff1d805edd0 2020-01-26T15:40:09.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d805e050 con 0x7ff1d80a6870 2020-01-26T15:40:09.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d77fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7ff1d805edd0 0x7ff1d807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44958/0 (socket says 172.21.15.170:44958) 2020-01-26T15:40:09.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d77fe700 1 -- 172.21.15.170:0/4031477902 learned_addr learned my addr 172.21.15.170:0/4031477902 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:09.399 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1dd7fc700 -1 --2- 172.21.15.170:0/4031477902 >> v2:172.21.15.170:6791/0 conn(0x7ff1d80a6870 0x7ff1d814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1dd7fc700 1 --2- 172.21.15.170:0/4031477902 >> v2:172.21.15.170:6791/0 conn(0x7ff1d80a6870 0x7ff1d814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420070213 0 0) 0x7ff1d805ea20 con 0x7ff1d805e5f0 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c4003230 con 0x7ff1d805e5f0 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680312524 0 0) 0x7ff1d8098000 con 0x7ff1d805edd0 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d805ea20 con 0x7ff1d805edd0 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2753266734 0 0) 0x7ff1c4003230 con 0x7ff1d805e5f0 2020-01-26T15:40:09.400 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 >> v2:172.21.15.170:6791/0 conn(0x7ff1d80a6870 msgr2=0x7ff1d814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:09.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 --2- 172.21.15.170:0/4031477902 >> v2:172.21.15.170:6791/0 conn(0x7ff1d80a6870 0x7ff1d814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:09.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 >> v1:172.21.15.170:6791/0 conn(0x7ff1d805edd0 legacy=0x7ff1d807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80a6ca0 con 0x7ff1d805e5f0 2020-01-26T15:40:09.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff1c0001710 con 0x7ff1d805e5f0 2020-01-26T15:40:09.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff1c00019e0 con 0x7ff1d805e5f0 2020-01-26T15:40:09.401 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d67fc700 1 -- 172.21.15.170:0/4031477902 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff1c0001ec0 con 0x7ff1d805e5f0 2020-01-26T15:40:09.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- 172.21.15.170:0/4031477902 >> v1:172.21.15.170:6790/0 conn(0x7ff1d805e5f0 legacy=0x7ff1d8149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- 172.21.15.170:0/4031477902 shutdown_connections 2020-01-26T15:40:09.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 --2- 172.21.15.170:0/4031477902 >> v2:172.21.15.170:6791/0 conn(0x7ff1d80a6870 0x7ff1d814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:09.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- 172.21.15.170:0/4031477902 >> 172.21.15.170:0/4031477902 conn(0x7ff1d8098e70 msgr2=0x7ff1d80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:09.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- 172.21.15.170:0/4031477902 shutdown_connections 2020-01-26T15:40:09.402 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.391+0000 7ff1d7fff700 1 -- 172.21.15.170:0/4031477902 wait complete. 2020-01-26T15:40:09.407 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d7fff700 1 Processor -- start 2020-01-26T15:40:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d7fff700 1 -- start start 2020-01-26T15:40:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d7fff700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7ff1d811f200 0x7ff1d80a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d7fff700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80a0cd0 con 0x7ff1d809ff30 2020-01-26T15:40:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d7fff700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80a1c70 con 0x7ff1d807b0d0 2020-01-26T15:40:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d7fff700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d811f920 con 0x7ff1d811f200 2020-01-26T15:40:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d77fe700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff1d807b0d0 0x7ff1d80a1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49838/0 (socket says 172.21.15.170:49838) 2020-01-26T15:40:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d77fe700 1 -- 172.21.15.170:0/2015297798 learned_addr learned my addr 172.21.15.170:0/2015297798 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1dd7fc700 -1 --2- 172.21.15.170:0/2015297798 >> v2:172.21.15.170:6790/0 conn(0x7ff1d811f200 0x7ff1d80a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1dd7fc700 1 --2- 172.21.15.170:0/2015297798 >> v2:172.21.15.170:6790/0 conn(0x7ff1d811f200 0x7ff1d80a0630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997831309 0 0) 0x7ff1d80a0cd0 con 0x7ff1d809ff30 2020-01-26T15:40:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1bc003230 con 0x7ff1d809ff30 2020-01-26T15:40:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583843528 0 0) 0x7ff1d80a1c70 con 0x7ff1d807b0d0 2020-01-26T15:40:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d80a0cd0 con 0x7ff1d807b0d0 2020-01-26T15:40:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2987288072 0 0) 0x7ff1bc003230 con 0x7ff1d809ff30 2020-01-26T15:40:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1d80a1c70 con 0x7ff1d809ff30 2020-01-26T15:40:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff1c0001b90 con 0x7ff1d809ff30 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 >> v2:172.21.15.170:6790/0 conn(0x7ff1d811f200 msgr2=0x7ff1d80a0630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 --2- 172.21.15.170:0/2015297798 >> v2:172.21.15.170:6790/0 conn(0x7ff1d811f200 0x7ff1d80a0630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 >> v1:172.21.15.170:6790/0 conn(0x7ff1d807b0d0 legacy=0x7ff1d80a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 >> v1:172.21.15.170:6789/0 conn(0x7ff1d809ff30 legacy=0x7ff1d80799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff1bc003230 con 0x7ff1bc0040c0 2020-01-26T15:40:09.411 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff1bc011660 con 0x7ff1bc00a7f0 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d811f920 con 0x7ff1bc003c30 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.395+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375528174 0 0) 0x7ff1bc003230 con 0x7ff1bc0040c0 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1bc00e580 con 0x7ff1bc0040c0 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689916072 0 0) 0x7ff1bc011660 con 0x7ff1bc00a7f0 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 -- 172.21.15.170:0/2015297798 >> v1:172.21.15.170:6791/0 conn(0x7ff1bc00a7f0 legacy=0x7ff1bc00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.412 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 -- 172.21.15.170:0/2015297798 >> v1:172.21.15.170:6790/0 conn(0x7ff1bc0040c0 legacy=0x7ff1bc004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 -- 172.21.15.170:0/2015297798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d807a1b0 con 0x7ff1bc003c30 2020-01-26T15:40:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d807b0d0 con 0x7ff1bc003c30 2020-01-26T15:40:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d807a6a0 con 0x7ff1bc003c30 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d8056600 con 0x7ff1bc003c30 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff1c8012660 con 0x7ff1bc003c30 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8012860 con 0x7ff1bc003c30 2020-01-26T15:40:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff1c8012c80 con 0x7ff1bc003c30 2020-01-26T15:40:09.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ff1c800c650 con 0x7ff1bc003c30 2020-01-26T15:40:09.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.399+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.415 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.403+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ff1c804d4f0 con 0x7ff1bc003c30 2020-01-26T15:40:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.403+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.403+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ff1c80336a0 con 0x7ff1bc003c30 2020-01-26T15:40:09.561 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.555+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff1d8099290 con 0x7ff1bc003c30 2020-01-26T15:40:09.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.555+0000 7ff1d77fe700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:09.562 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.555+0000 7ff1cffff700 1 -- 172.21.15.170:0/2015297798 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff1c8033900 con 0x7ff1bc003c30 2020-01-26T15:40:09.563 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:09.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 >> v1:172.21.15.170:6800/17396 conn(0x7ff1bc04c800 legacy=0x7ff1bc04ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 msgr2=0x7ff1bc0045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:09.566 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7ff1c8001510 tx=0x7ff1c8010c60).stop 2020-01-26T15:40:09.567 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1dd7fc700 1 -- 172.21.15.170:0/2015297798 reap_dead start 2020-01-26T15:40:09.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 shutdown_connections 2020-01-26T15:40:09.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 --2- 172.21.15.170:0/2015297798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1bc003c30 0x7ff1bc0045a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:09.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 >> 172.21.15.170:0/2015297798 conn(0x7ff1d80a7b50 msgr2=0x7ff1d807e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:09.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 shutdown_connections 2020-01-26T15:40:09.568 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:09.559+0000 7ff1d7fff700 1 -- 172.21.15.170:0/2015297798 wait complete. 2020-01-26T15:40:09.575 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:12.576 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:12.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 Processor -- start 2020-01-26T15:40:12.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 -- start start 2020-01-26T15:40:12.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa5b805edd0 0x7fa5b805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:12.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa5b8149040 0x7fa5b814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:12.698 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b8098000 con 0x7fa5b80a6870 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b805e050 con 0x7fa5b8149040 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bd41b700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b80a6ca0 con 0x7fa5b805edd0 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bcc1a700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa5b805edd0 0x7fa5b805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5b7fff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fa5b80a6870 0x7fa5b807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44980/0 (socket says 172.21.15.170:44980) 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5b7fff700 1 -- 172.21.15.170:0/1625604527 learned_addr learned my addr 172.21.15.170:0/1625604527 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5bcc1a700 1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6791/0 conn(0x7fa5b805edd0 0x7fa5b805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:12.699 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5be67d700 -1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8149040 0x7fa5b814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.687+0000 7fa5be67d700 1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8149040 0x7fa5b814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129793281 0 0) 0x7fa5b8098000 con 0x7fa5b80a6870 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a8003230 con 0x7fa5b80a6870 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 795944361 0 0) 0x7fa5a8003230 con 0x7fa5b80a6870 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6791/0 conn(0x7fa5b805edd0 msgr2=0x7fa5b805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6791/0 conn(0x7fa5b805edd0 0x7fa5b805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:12.700 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8149040 msgr2=0x7fa5b814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8149040 0x7fa5b814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b814c9e0 con 0x7fa5b80a6870 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa5a4001710 con 0x7fa5b80a6870 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa5a4001910 con 0x7fa5b80a6870 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5b77fe700 1 -- 172.21.15.170:0/1625604527 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa5a40045b0 con 0x7fa5b80a6870 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1625604527 >> v1:172.21.15.170:6791/0 conn(0x7fa5b80a6870 legacy=0x7fa5b807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1625604527 shutdown_connections 2020-01-26T15:40:12.701 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8149040 0x7fa5b814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:12.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 --2- 172.21.15.170:0/1625604527 >> v2:172.21.15.170:6791/0 conn(0x7fa5b805edd0 0x7fa5b805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:12.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1625604527 >> 172.21.15.170:0/1625604527 conn(0x7fa5b8098e70 msgr2=0x7fa5b80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:12.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1625604527 shutdown_connections 2020-01-26T15:40:12.702 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.691+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1625604527 wait complete. 2020-01-26T15:40:12.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 Processor -- start 2020-01-26T15:40:12.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 -- start start 2020-01-26T15:40:12.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa5b809b3a0 0x7fa5b807c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:12.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa5b8130460 0x7fa5b81370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:12.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b809b7d0 con 0x7fa5b807cf30 2020-01-26T15:40:12.705 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b809bb20 con 0x7fa5b8130460 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b8130890 con 0x7fa5b809b3a0 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bcc1a700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa5b809b3a0 0x7fa5b807c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5be67d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fa5b8130460 0x7fa5b81370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b7fff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fa5b807cf30 0x7fa5b812fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44986/0 (socket says 172.21.15.170:44986) 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bcc1a700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fa5b809b3a0 0x7fa5b807c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b7fff700 1 -- 172.21.15.170:0/1781308423 learned_addr learned my addr 172.21.15.170:0/1781308423 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:12.706 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5be67d700 1 --2- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8130460 0x7fa5b81370b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103062863 0 0) 0x7fa5b809b7d0 con 0x7fa5b807cf30 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa598003230 con 0x7fa5b807cf30 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3574292756 0 0) 0x7fa598003230 con 0x7fa5b807cf30 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa5b809b7d0 con 0x7fa5b807cf30 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa5a40019e0 con 0x7fa5b807cf30 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2246583119 0 0) 0x7fa5b809b7d0 con 0x7fa5b807cf30 2020-01-26T15:40:12.707 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6791/0 conn(0x7fa5b809b3a0 msgr2=0x7fa5b807c9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 --2- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6791/0 conn(0x7fa5b809b3a0 0x7fa5b807c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8130460 msgr2=0x7fa5b81370b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 --2- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8130460 0x7fa5b81370b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b807d360 con 0x7fa5b807cf30 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b80a4920 con 0x7fa5b807cf30 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b8137600 con 0x7fa5b807cf30 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa5a4004b30 con 0x7fa5b807cf30 2020-01-26T15:40:12.708 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.695+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fa5a4004d20 con 0x7fa5b807cf30 2020-01-26T15:40:12.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.699+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590003360 con 0x7fa5b807cf30 2020-01-26T15:40:12.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.699+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fa5a4010760 con 0x7fa5b807cf30 2020-01-26T15:40:12.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.699+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7fa5a404bc50 con 0x7fa5b807cf30 2020-01-26T15:40:12.709 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.703+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fa5a4030f10 con 0x7fa5b807cf30 2020-01-26T15:40:12.869 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.863+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa5900037d0 con 0x7fa5b807cf30 2020-01-26T15:40:12.871 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5b57fa700 1 -- 172.21.15.170:0/1781308423 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fa5a4031170 con 0x7fa5b807cf30 2020-01-26T15:40:12.871 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:12.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 >> v1:172.21.15.170:6800/17396 conn(0x7fa59803dfb0 legacy=0x7fa5980404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:12.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 >> v1:172.21.15.170:6791/0 conn(0x7fa5b807cf30 legacy=0x7fa5b812fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:12.873 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 shutdown_connections 2020-01-26T15:40:12.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 --2- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6790/0 conn(0x7fa5b8130460 0x7fa5b81370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:12.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 --2- 172.21.15.170:0/1781308423 >> v2:172.21.15.170:6791/0 conn(0x7fa5b809b3a0 0x7fa5b807c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:12.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 >> 172.21.15.170:0/1781308423 conn(0x7fa5b8097e00 msgr2=0x7fa5b8123420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:12.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 shutdown_connections 2020-01-26T15:40:12.874 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:12.867+0000 7fa5bd41b700 1 -- 172.21.15.170:0/1781308423 wait complete. 2020-01-26T15:40:12.884 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:15.885 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 Processor -- start 2020-01-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- start start 2020-01-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff4b014a880 0x7ff4b014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00a5b80 con 0x7ff4b00a5750 2020-01-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0080440 con 0x7ff4b0146c30 2020-01-26T15:40:16.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00a43f0 con 0x7ff4b014a880 2020-01-26T15:40:16.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff4b014a880 0x7ff4b014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:16.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4aed9d700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff4b00a5750 0x7ff4b00a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:52988/0 (socket says 172.21.15.170:52988) 2020-01-26T15:40:16.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4aed9d700 1 -- 172.21.15.170:0/393817234 learned_addr learned my addr 172.21.15.170:0/393817234 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:16.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4ae59c700 1 --1- 172.21.15.170:0/393817234 >> v1:172.21.15.170:6791/0 conn(0x7ff4b0146c30 0x7ff4b0149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:44990/0 (socket says 172.21.15.170:44990) 2020-01-26T15:40:16.007 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> v2:172.21.15.170:6791/0 conn(0x7ff4b014a880 0x7ff4b014ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571309968 0 0) 0x7ff4b00a5b80 con 0x7ff4b00a5750 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490003230 con 0x7ff4b00a5750 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382374612 0 0) 0x7ff4b0080440 con 0x7ff4b0146c30 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b00a5b80 con 0x7ff4b0146c30 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4287350276 0 0) 0x7ff490003230 con 0x7ff4b00a5750 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 >> v2:172.21.15.170:6791/0 conn(0x7ff4b014a880 msgr2=0x7ff4b014ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:16.008 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 --2- 172.21.15.170:0/393817234 >> v2:172.21.15.170:6791/0 conn(0x7ff4b014a880 0x7ff4b014ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 >> v1:172.21.15.170:6791/0 conn(0x7ff4b0146c30 legacy=0x7ff4b0149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00a4e00 con 0x7ff4b00a5750 2020-01-26T15:40:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff4a8001710 con 0x7ff4b00a5750 2020-01-26T15:40:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 >> v1:172.21.15.170:6789/0 conn(0x7ff4b00a5750 legacy=0x7ff4b00a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff490003230 con 0x7ff490003ec0 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff4b00a5b80 con 0x7ff490003a90 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00a43f0 con 0x7ff49000b800 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87689648 0 0) 0x7ff490003230 con 0x7ff490003ec0 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b0080440 con 0x7ff490003ec0 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059513545 0 0) 0x7ff4b00a5b80 con 0x7ff490003a90 2020-01-26T15:40:16.010 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490003230 con 0x7ff490003a90 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 -- 172.21.15.170:0/393817234 >> v1:172.21.15.170:6791/0 conn(0x7ff490003a90 legacy=0x7ff4900045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 -- 172.21.15.170:0/393817234 >> v1:172.21.15.170:6790/0 conn(0x7ff490003ec0 legacy=0x7ff490004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 -- 172.21.15.170:0/393817234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49000e2d0 con 0x7ff49000b800 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff498002f30 tx=0x7ff49800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff498002f30 tx=0x7ff49800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7ff498002f30 tx=0x7ff49800fe60).ready entity=mon.0 client_cookie=911fe02442ebd875 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:16.011 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7ff498002f30 tx=0x7ff49800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7ff498002f30 tx=0x7ff49800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff498008c60 con 0x7ff49000b800 2020-01-26T15:40:16.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7ff498002f30 tx=0x7ff49800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.012 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498005780 con 0x7ff49000b800 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4add9b700 1 -- 172.21.15.170:0/393817234 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff498005b20 con 0x7ff49000b800 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 msgr2=0x7ff49000dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 --2- 172.21.15.170:0/393817234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49000b800 0x7ff49000dc40 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7ff498002f30 tx=0x7ff49800fe60).stop 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4af59e700 1 -- 172.21.15.170:0/393817234 reap_dead start 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/393817234 shutdown_connections 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/393817234 >> 172.21.15.170:0/393817234 conn(0x7ff4b005e050 msgr2=0x7ff4b0098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/393817234 shutdown_connections 2020-01-26T15:40:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/393817234 wait complete. 2020-01-26T15:40:16.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:15.999+0000 7ff4b4cbe700 1 Processor -- start 2020-01-26T15:40:16.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 -- start start 2020-01-26T15:40:16.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7ff4b011e3f0 0x7ff4b00a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:16.018 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00a1490 con 0x7ff4b011dac0 2020-01-26T15:40:16.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00a2070 con 0x7ff4b011d690 2020-01-26T15:40:16.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b0121890 con 0x7ff4b011e3f0 2020-01-26T15:40:16.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4ae59c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7ff4b011d690 0x7ff4b012f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49876/0 (socket says 172.21.15.170:49876) 2020-01-26T15:40:16.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4ae59c700 1 -- 172.21.15.170:0/1392529256 learned_addr learned my addr 172.21.15.170:0/1392529256 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:16.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 -1 --2- 172.21.15.170:0/1392529256 >> v2:172.21.15.170:6791/0 conn(0x7ff4b011e3f0 0x7ff4b00a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:16.019 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> v2:172.21.15.170:6791/0 conn(0x7ff4b011e3f0 0x7ff4b00a1b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238668934 0 0) 0x7ff4b00a2070 con 0x7ff4b011d690 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff488003230 con 0x7ff4b011d690 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767942913 0 0) 0x7ff4b00a1490 con 0x7ff4b011dac0 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b00a2070 con 0x7ff4b011dac0 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3877795776 0 0) 0x7ff4b00a2070 con 0x7ff4b011dac0 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4b00a1490 con 0x7ff4b011dac0 2020-01-26T15:40:16.020 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2106146525 0 0) 0x7ff488003230 con 0x7ff4b011d690 2020-01-26T15:40:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4b00a2070 con 0x7ff4b011d690 2020-01-26T15:40:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7ff498005db0 con 0x7ff4b011dac0 2020-01-26T15:40:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 >> v2:172.21.15.170:6791/0 conn(0x7ff4b011e3f0 msgr2=0x7ff4b00a1b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 --2- 172.21.15.170:0/1392529256 >> v2:172.21.15.170:6791/0 conn(0x7ff4b011e3f0 0x7ff4b00a1b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 >> v1:172.21.15.170:6790/0 conn(0x7ff4b011d690 legacy=0x7ff4b012f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.021 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 >> v1:172.21.15.170:6789/0 conn(0x7ff4b011dac0 legacy=0x7ff4b0130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:16.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff488003230 con 0x7ff488004af0 2020-01-26T15:40:16.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff48800f820 con 0x7ff488004f20 2020-01-26T15:40:16.022 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0121890 con 0x7ff488003f70 2020-01-26T15:40:16.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:16.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484320649 0 0) 0x7ff48800f820 con 0x7ff488004f20 2020-01-26T15:40:16.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff48800e810 con 0x7ff488004f20 2020-01-26T15:40:16.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128110796 0 0) 0x7ff488003230 con 0x7ff488004af0 2020-01-26T15:40:16.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 -- 172.21.15.170:0/1392529256 >> v1:172.21.15.170:6791/0 conn(0x7ff488004f20 legacy=0x7ff48800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.023 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 -- 172.21.15.170:0/1392529256 >> v1:172.21.15.170:6790/0 conn(0x7ff488004af0 legacy=0x7ff4880097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 -- 172.21.15.170:0/1392529256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b011def0 con 0x7ff488003f70 2020-01-26T15:40:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b00a2500 con 0x7ff488003f70 2020-01-26T15:40:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b011d830 con 0x7ff488003f70 2020-01-26T15:40:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.003+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff4a800c840 con 0x7ff488003f70 2020-01-26T15:40:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800ca40 con 0x7ff488003f70 2020-01-26T15:40:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff4a80045b0 con 0x7ff488003f70 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c003360 con 0x7ff488003f70 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ff4a8004880 con 0x7ff488003f70 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.007+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ff4a804cb60 con 0x7ff488003f70 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.011+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.026 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.011+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ff4a8032cf0 con 0x7ff488003f70 2020-01-26T15:40:16.176 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff48c003790 con 0x7ff488003f70 2020-01-26T15:40:16.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4aed9d700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:16.177 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4a77fe700 1 -- 172.21.15.170:0/1392529256 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff4a8032f50 con 0x7ff488003f70 2020-01-26T15:40:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:16.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 >> v1:172.21.15.170:6800/17396 conn(0x7ff488049730 legacy=0x7ff48804bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 msgr2=0x7ff4880045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:16.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 --2- 172.21.15.170:0/1392529256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff488003f70 0x7ff4880045a0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7ff4a80010d0 tx=0x7ff4a8010a00).stop 2020-01-26T15:40:16.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4af59e700 1 -- 172.21.15.170:0/1392529256 reap_dead start 2020-01-26T15:40:16.179 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4af59e700 1 -- 172.21.15.170:0/1392529256 reap_dead start 2020-01-26T15:40:16.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 shutdown_connections 2020-01-26T15:40:16.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 >> 172.21.15.170:0/1392529256 conn(0x7ff4b00a6fc0 msgr2=0x7ff4b007ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:16.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 shutdown_connections 2020-01-26T15:40:16.180 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:16.175+0000 7ff4b4cbe700 1 -- 172.21.15.170:0/1392529256 wait complete. 2020-01-26T15:40:16.190 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:19.191 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:19.313 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 Processor -- start 2020-01-26T15:40:19.313 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 -- start start 2020-01-26T15:40:19.313 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fccf40a6870 0x7fccf414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:19.313 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf405ea20 con 0x7fccf405edd0 2020-01-26T15:40:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf4098000 con 0x7fccf405e5f0 2020-01-26T15:40:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fccf405e050 con 0x7fccf40a6870 2020-01-26T15:40:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf3fff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fccf405edd0 0x7fccf407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49890/0 (socket says 172.21.15.170:49890) 2020-01-26T15:40:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf3fff700 1 -- 172.21.15.170:0/1507362938 learned_addr learned my addr 172.21.15.170:0/1507362938 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf9a90700 -1 --2- 172.21.15.170:0/1507362938 >> v2:172.21.15.170:6790/0 conn(0x7fccf40a6870 0x7fccf414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:19.314 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf9a90700 1 --2- 172.21.15.170:0/1507362938 >> v2:172.21.15.170:6790/0 conn(0x7fccf40a6870 0x7fccf414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906627557 0 0) 0x7fccf405ea20 con 0x7fccf405edd0 2020-01-26T15:40:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce0003230 con 0x7fccf405edd0 2020-01-26T15:40:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497406419 0 0) 0x7fccf4098000 con 0x7fccf405e5f0 2020-01-26T15:40:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf405ea20 con 0x7fccf405e5f0 2020-01-26T15:40:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2071905837 0 0) 0x7fcce0003230 con 0x7fccf405edd0 2020-01-26T15:40:19.315 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 >> v2:172.21.15.170:6790/0 conn(0x7fccf40a6870 msgr2=0x7fccf414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 --2- 172.21.15.170:0/1507362938 >> v2:172.21.15.170:6790/0 conn(0x7fccf40a6870 0x7fccf414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 >> v1:172.21.15.170:6791/0 conn(0x7fccf405e5f0 legacy=0x7fccf4149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:19.316 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40a6ca0 con 0x7fccf405edd0 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcce4001a90 con 0x7fccf405edd0 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcce4001c90 con 0x7fccf405edd0 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf2ffd700 1 -- 172.21.15.170:0/1507362938 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fcce4004930 con 0x7fccf405edd0 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.306+0000 7fccf882e700 1 -- 172.21.15.170:0/1507362938 >> v1:172.21.15.170:6790/0 conn(0x7fccf405edd0 legacy=0x7fccf407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- 172.21.15.170:0/1507362938 shutdown_connections 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 --2- 172.21.15.170:0/1507362938 >> v2:172.21.15.170:6790/0 conn(0x7fccf40a6870 0x7fccf414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:19.317 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- 172.21.15.170:0/1507362938 >> 172.21.15.170:0/1507362938 conn(0x7fccf4098e70 msgr2=0x7fccf40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:19.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- 172.21.15.170:0/1507362938 shutdown_connections 2020-01-26T15:40:19.318 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- 172.21.15.170:0/1507362938 wait complete. 2020-01-26T15:40:19.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 Processor -- start 2020-01-26T15:40:19.320 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- start start 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fccf411fb10 0x7fccf411eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fccf4070780 0x7fccf4070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf411ebd0 con 0x7fccf4131750 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fccf40a1b40 con 0x7fccf4070780 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf882e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fccf40a12c0 con 0x7fccf411fb10 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf37fe700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fccf4131750 0x7fccf4131b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:45022/0 (socket says 172.21.15.170:45022) 2020-01-26T15:40:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf37fe700 1 -- 172.21.15.170:0/1978114307 learned_addr learned my addr 172.21.15.170:0/1978114307 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf9a90700 -1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6790/0 conn(0x7fccf4070780 0x7fccf4070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf3fff700 -1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6791/0 conn(0x7fccf411fb10 0x7fccf411eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf9a90700 1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6790/0 conn(0x7fccf4070780 0x7fccf4070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.310+0000 7fccf3fff700 1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6791/0 conn(0x7fccf411fb10 0x7fccf411eed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297211163 0 0) 0x7fccf411ebd0 con 0x7fccf4131750 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd8003230 con 0x7fccf4131750 2020-01-26T15:40:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3059101368 0 0) 0x7fccd8003230 con 0x7fccf4131750 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fccf411ebd0 con 0x7fccf4131750 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fccdc0029a0 con 0x7fccf4131750 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2617239062 0 0) 0x7fccf411ebd0 con 0x7fccf4131750 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6791/0 conn(0x7fccf411fb10 msgr2=0x7fccf411eed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6791/0 conn(0x7fccf411fb10 0x7fccf411eed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6790/0 conn(0x7fccf4070780 msgr2=0x7fccf4070bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:19.323 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6790/0 conn(0x7fccf4070780 0x7fccf4070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4071100 con 0x7fccf4131750 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf40713d0 con 0x7fccf4131750 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf4138740 con 0x7fccf4131750 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fccdc001620 con 0x7fccf4131750 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fccdc001a40 con 0x7fccf4131750 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc003360 con 0x7fccf4131750 2020-01-26T15:40:19.324 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7fccdc001c40 con 0x7fccf4131750 2020-01-26T15:40:19.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.314+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7fccdc04bb20 con 0x7fccf4131750 2020-01-26T15:40:19.325 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.322+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fccdc0310a0 con 0x7fccf4131750 2020-01-26T15:40:19.481 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.478+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 --> v1:172.21.15.170:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcccc0037d0 con 0x7fccf4131750 2020-01-26T15:40:19.482 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.478+0000 7fccf0ff9700 1 -- 172.21.15.170:0/1978114307 <== mon.2 v1:172.21.15.170:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fccdc001f50 con 0x7fccf4131750 2020-01-26T15:40:19.482 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:19.483 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 >> v1:172.21.15.170:6800/17396 conn(0x7fccd803e0a0 legacy=0x7fccd80405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:19.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 >> v1:172.21.15.170:6791/0 conn(0x7fccf4131750 legacy=0x7fccf4131b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:19.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 shutdown_connections 2020-01-26T15:40:19.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6790/0 conn(0x7fccf4070780 0x7fccf4070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:19.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 --2- 172.21.15.170:0/1978114307 >> v2:172.21.15.170:6791/0 conn(0x7fccf411fb10 0x7fccf411eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:19.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 >> 172.21.15.170:0/1978114307 conn(0x7fccf4098e10 msgr2=0x7fccf40247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:19.484 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 shutdown_connections 2020-01-26T15:40:19.485 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:19.482+0000 7fccf882e700 1 -- 172.21.15.170:0/1978114307 wait complete. 2020-01-26T15:40:19.495 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:22.496 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.610+0000 7f21eb59e700 1 Processor -- start 2020-01-26T15:40:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.610+0000 7f21eb59e700 1 -- start start 2020-01-26T15:40:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f21ec05e5f0 0x7f21ec0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f21ec149040 0x7f21ec14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ec0a6dc0 con 0x7f21ec05edd0 2020-01-26T15:40:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec05ea20 con 0x7f21ec149040 2020-01-26T15:40:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec098000 con 0x7f21ec05e5f0 2020-01-26T15:40:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21ea59c700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f21ec05e5f0 0x7f21ec0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21ead9d700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f21ec05edd0 0x7f21ec07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:45030/0 (socket says 172.21.15.170:45030) 2020-01-26T15:40:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21ead9d700 1 -- 172.21.15.170:0/1703892360 learned_addr learned my addr 172.21.15.170:0/1703892360 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21f0f18700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f21ec149040 0x7f21ec14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21ea59c700 1 --2- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6791/0 conn(0x7f21ec05e5f0 0x7f21ec0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21f0f18700 1 --2- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6790/0 conn(0x7f21ec149040 0x7f21ec14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079599102 0 0) 0x7f21ec0a6dc0 con 0x7f21ec05edd0 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d8003230 con 0x7f21ec05edd0 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1355875573 0 0) 0x7f21d8003230 con 0x7f21ec05edd0 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6791/0 conn(0x7f21ec05e5f0 msgr2=0x7f21ec0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 --2- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6791/0 conn(0x7f21ec05e5f0 0x7f21ec0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6790/0 conn(0x7f21ec149040 msgr2=0x7f21ec14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 --2- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6790/0 conn(0x7f21ec149040 0x7f21ec14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec05e050 con 0x7f21ec05edd0 2020-01-26T15:40:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f21dc001a90 con 0x7f21ec05edd0 2020-01-26T15:40:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f21dc001e20 con 0x7f21ec05edd0 2020-01-26T15:40:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- 172.21.15.170:0/1703892360 >> v1:172.21.15.170:6791/0 conn(0x7f21ec05edd0 legacy=0x7f21ec07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21e9d9b700 1 -- 172.21.15.170:0/1703892360 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f21dc004ae0 con 0x7f21ec05edd0 2020-01-26T15:40:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- 172.21.15.170:0/1703892360 shutdown_connections 2020-01-26T15:40:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 --2- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6790/0 conn(0x7f21ec149040 0x7f21ec14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 --2- 172.21.15.170:0/1703892360 >> v2:172.21.15.170:6791/0 conn(0x7f21ec05e5f0 0x7f21ec0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- 172.21.15.170:0/1703892360 >> 172.21.15.170:0/1703892360 conn(0x7f21ec098e70 msgr2=0x7f21ec0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- 172.21.15.170:0/1703892360 shutdown_connections 2020-01-26T15:40:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.614+0000 7f21eb59e700 1 -- 172.21.15.170:0/1703892360 wait complete. 2020-01-26T15:40:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 Processor -- start 2020-01-26T15:40:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 -- start start 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f21ec09ed80 0x7f21ec09ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f21ec122960 0x7f21ec1385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ec099a00 con 0x7f21ec099eb0 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec0a4ad0 con 0x7f21ec09ed80 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21eb59e700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec05eea0 con 0x7f21ec122960 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21ead9d700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f21ec09ed80 0x7f21ec09ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21ead9d700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f21ec09ed80 0x7f21ec09ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:22.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21ea59c700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f21ec099eb0 0x7f21ec122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49914/0 (socket says 172.21.15.170:49914) 2020-01-26T15:40:22.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21ea59c700 1 -- 172.21.15.170:0/803627664 learned_addr learned my addr 172.21.15.170:0/803627664 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:22.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21f0f18700 -1 --2- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6791/0 conn(0x7f21ec122960 0x7f21ec1385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:22.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.618+0000 7f21f0f18700 1 --2- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6791/0 conn(0x7f21ec122960 0x7f21ec1385d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:22.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328801791 0 0) 0x7f21ec099a00 con 0x7f21ec099eb0 2020-01-26T15:40:22.631 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d0003230 con 0x7f21ec099eb0 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2848462861 0 0) 0x7f21d0003230 con 0x7f21ec099eb0 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f21ec099a00 con 0x7f21ec099eb0 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f21d4002780 con 0x7f21ec099eb0 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1013781581 0 0) 0x7f21ec099a00 con 0x7f21ec099eb0 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6791/0 conn(0x7f21ec122960 msgr2=0x7f21ec1385d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 --2- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6791/0 conn(0x7f21ec122960 0x7f21ec1385d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6790/0 conn(0x7f21ec09ed80 msgr2=0x7f21ec09ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 --2- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6790/0 conn(0x7f21ec09ed80 0x7f21ec09ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec0a45a0 con 0x7f21ec099eb0 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec09b1a0 con 0x7f21ec099eb0 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f21d4000e90 con 0x7f21ec099eb0 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec121d50 con 0x7f21ec099eb0 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f21d40012b0 con 0x7f21ec099eb0 2020-01-26T15:40:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 7 ==== mgrmap(e 8) v1 ==== 47155+0+0 (unknown 2892709018 0 0) 0x7f21d40014b0 con 0x7f21ec099eb0 2020-01-26T15:40:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1585972489 0 0) 0x7f21d404baa0 con 0x7f21ec099eb0 2020-01-26T15:40:22.634 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.622+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec056600 con 0x7f21ec099eb0 2020-01-26T15:40:22.635 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.630+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f21ec121d50 con 0x7f21ec099eb0 2020-01-26T15:40:22.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.782+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 --> v1:172.21.15.170:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21ec09b510 con 0x7f21ec099eb0 2020-01-26T15:40:22.786 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.782+0000 7f21e37fe700 1 -- 172.21.15.170:0/803627664 <== mon.1 v1:172.21.15.170:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f21d4030fc0 con 0x7f21ec099eb0 2020-01-26T15:40:22.786 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:22.787 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 >> v1:172.21.15.170:6800/17396 conn(0x7f21d003e240 legacy=0x7f21d0040750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 >> v1:172.21.15.170:6790/0 conn(0x7f21ec099eb0 legacy=0x7f21ec122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 shutdown_connections 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 --2- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6791/0 conn(0x7f21ec122960 0x7f21ec1385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 --2- 172.21.15.170:0/803627664 >> v2:172.21.15.170:6790/0 conn(0x7f21ec09ed80 0x7f21ec09ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 >> 172.21.15.170:0/803627664 conn(0x7f21ec05c110 msgr2=0x7f21ec097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 shutdown_connections 2020-01-26T15:40:22.788 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:22.786+0000 7f21eb59e700 1 -- 172.21.15.170:0/803627664 wait complete. 2020-01-26T15:40:22.799 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:25.801 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:25.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61c1ae700 1 Processor -- start 2020-01-26T15:40:25.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61c1ae700 1 -- start start 2020-01-26T15:40:25.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61c1ae700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fe61414a880 0x7fe61414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:25.917 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61c1ae700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140a5b80 con 0x7fe614146c30 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61c1ae700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe614080440 con 0x7fe6140a5750 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61c1ae700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140a43f0 con 0x7fe61414a880 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61a74b700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7fe6140a5750 0x7fe6140a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49920/0 (socket says 172.21.15.170:49920) 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61a74b700 1 -- 172.21.15.170:0/2759758614 learned_addr learned my addr 172.21.15.170:0/2759758614 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61af4c700 -1 --2- 172.21.15.170:0/2759758614 >> v2:172.21.15.170:6791/0 conn(0x7fe61414a880 0x7fe61414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe61af4c700 1 --2- 172.21.15.170:0/2759758614 >> v2:172.21.15.170:6791/0 conn(0x7fe61414a880 0x7fe61414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:25.918 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078877313 0 0) 0x7fe6140a5b80 con 0x7fe614146c30 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe600003230 con 0x7fe614146c30 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236503946 0 0) 0x7fe614080440 con 0x7fe6140a5750 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6140a5b80 con 0x7fe6140a5750 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3330521626 0 0) 0x7fe600003230 con 0x7fe614146c30 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 >> v2:172.21.15.170:6791/0 conn(0x7fe61414a880 msgr2=0x7fe61414ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 --2- 172.21.15.170:0/2759758614 >> v2:172.21.15.170:6791/0 conn(0x7fe61414a880 0x7fe61414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:25.919 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 >> v1:172.21.15.170:6790/0 conn(0x7fe6140a5750 legacy=0x7fe6140a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140a4e00 con 0x7fe614146c30 2020-01-26T15:40:25.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe604001710 con 0x7fe614146c30 2020-01-26T15:40:25.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 >> v1:172.21.15.170:6789/0 conn(0x7fe614146c30 legacy=0x7fe614149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.920 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe600003230 con 0x7fe600004b20 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe6140a5b80 con 0x7fe60000a7f0 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140a43f0 con 0x7fe600004f50 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845358908 0 0) 0x7fe6140a5b80 con 0x7fe60000a7f0 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619f4a700 1 -- 172.21.15.170:0/2759758614 >> v1:172.21.15.170:6791/0 conn(0x7fe60000a7f0 legacy=0x7fe60000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.921 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619f4a700 1 -- 172.21.15.170:0/2759758614 >> v1:172.21.15.170:6790/0 conn(0x7fe600004b20 legacy=0x7fe600003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619f4a700 1 -- 172.21.15.170:0/2759758614 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600054530 con 0x7fe600004f50 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.910+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe604001520 tx=0x7fe60400c130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe604001520 tx=0x7fe60400c130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fe604001520 tx=0x7fe60400c130).ready entity=mon.0 client_cookie=6c3d124b0a0561f3 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fe604001520 tx=0x7fe60400c130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fe604001520 tx=0x7fe60400c130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe604010b50 con 0x7fe600004f50 2020-01-26T15:40:25.922 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fe604001520 tx=0x7fe60400c130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe604010d50 con 0x7fe600004f50 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619749700 1 -- 172.21.15.170:0/2759758614 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe60400c960 con 0x7fe600004f50 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 msgr2=0x7fe600003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 --2- 172.21.15.170:0/2759758614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe600004f50 0x7fe600003d40 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fe604001520 tx=0x7fe60400c130).stop 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61af4c700 1 -- 172.21.15.170:0/2759758614 reap_dead start 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- 172.21.15.170:0/2759758614 shutdown_connections 2020-01-26T15:40:25.923 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- 172.21.15.170:0/2759758614 >> 172.21.15.170:0/2759758614 conn(0x7fe61405e050 msgr2=0x7fe614098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:25.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- 172.21.15.170:0/2759758614 shutdown_connections 2020-01-26T15:40:25.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- 172.21.15.170:0/2759758614 wait complete. 2020-01-26T15:40:25.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 Processor -- start 2020-01-26T15:40:25.924 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- start start 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe6140a26c0 0x7fe614094b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140a11f0 con 0x7fe6140939b0 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140961d0 con 0x7fe6140a20d0 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61c1ae700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe614121ff0 con 0x7fe6140a26c0 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61af4c700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fe6140a26c0 0x7fe614094b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe6140939b0 0x7fe614138220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:53058/0 (socket says 172.21.15.170:53058) 2020-01-26T15:40:25.928 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe619f4a700 1 -- 172.21.15.170:0/286718767 learned_addr learned my addr 172.21.15.170:0/286718767 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61af4c700 1 --2- 172.21.15.170:0/286718767 >> v2:172.21.15.170:6790/0 conn(0x7fe6140a26c0 0x7fe614094b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330179199 0 0) 0x7fe6140961d0 con 0x7fe6140a20d0 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc003230 con 0x7fe6140a20d0 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991375032 0 0) 0x7fe6140a11f0 con 0x7fe6140939b0 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6140961d0 con 0x7fe6140939b0 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 55211024 0 0) 0x7fe5fc003230 con 0x7fe6140a20d0 2020-01-26T15:40:25.929 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6140a11f0 con 0x7fe6140a20d0 2020-01-26T15:40:25.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe610001740 con 0x7fe6140a20d0 2020-01-26T15:40:25.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1463077518 0 0) 0x7fe6140961d0 con 0x7fe6140939b0 2020-01-26T15:40:25.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5fc003230 con 0x7fe6140939b0 2020-01-26T15:40:25.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fe60400edd0 con 0x7fe6140939b0 2020-01-26T15:40:25.930 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 >> v2:172.21.15.170:6790/0 conn(0x7fe6140a26c0 msgr2=0x7fe614094b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:25.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 --2- 172.21.15.170:0/286718767 >> v2:172.21.15.170:6790/0 conn(0x7fe6140a26c0 0x7fe614094b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:25.942 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 >> v1:172.21.15.170:6790/0 conn(0x7fe6140a20d0 legacy=0x7fe61407d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 >> v1:172.21.15.170:6789/0 conn(0x7fe6140939b0 legacy=0x7fe614138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:25.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe6140961d0 con 0x7fe5fc003a90 2020-01-26T15:40:25.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe5fc0042f0 con 0x7fe5fc003ec0 2020-01-26T15:40:25.943 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614121ff0 con 0x7fe5fc004f00 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908730872 0 0) 0x7fe6140961d0 con 0x7fe5fc003a90 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc00e780 con 0x7fe5fc003a90 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61a74b700 1 -- 172.21.15.170:0/286718767 >> v1:172.21.15.170:6791/0 conn(0x7fe5fc003ec0 legacy=0x7fe5fc00cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61a74b700 1 -- 172.21.15.170:0/286718767 >> v1:172.21.15.170:6790/0 conn(0x7fe5fc003a90 legacy=0x7fe5fc009750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.914+0000 7fe61a74b700 1 -- 172.21.15.170:0/286718767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fe61413da60 con 0x7fe5fc004f00 2020-01-26T15:40:25.944 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6140a20d0 con 0x7fe5fc004f00 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61407d110 con 0x7fe5fc004f00 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe61000ac40 con 0x7fe5fc004f00 2020-01-26T15:40:25.945 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000a1a0 con 0x7fe5fc004f00 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f0003360 con 0x7fe5fc004f00 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe61000a390 con 0x7fe5fc004f00 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.918+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(38..38 src has 1..38) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fe61004d990 con 0x7fe5fc004f00 2020-01-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.922+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:25.947 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:25.922+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe610033b40 con 0x7fe5fc004f00 2020-01-26T15:40:26.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.070+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5f0003790 con 0x7fe5fc004f00 2020-01-26T15:40:26.075 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61a74b700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:26.076 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe60affd700 1 -- 172.21.15.170:0/286718767 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe610033da0 con 0x7fe5fc004f00 2020-01-26T15:40:26.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:26.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 >> v1:172.21.15.170:6800/17396 conn(0x7fe5fc048510 legacy=0x7fe5fc04aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:26.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 msgr2=0x7fe5fc003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:26.077 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 --2- 172.21.15.170:0/286718767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc004f00 0x7fe5fc003540 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7fe6100019c0 tx=0x7fe610011a00).stop 2020-01-26T15:40:26.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61af4c700 1 -- 172.21.15.170:0/286718767 reap_dead start 2020-01-26T15:40:26.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 shutdown_connections 2020-01-26T15:40:26.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 >> 172.21.15.170:0/286718767 conn(0x7fe614122270 msgr2=0x7fe61407f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:26.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 shutdown_connections 2020-01-26T15:40:26.078 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:26.074+0000 7fe61c1ae700 1 -- 172.21.15.170:0/286718767 wait complete. 2020-01-26T15:40:26.088 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:29.090 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:29.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 Processor -- start 2020-01-26T15:40:29.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 -- start start 2020-01-26T15:40:29.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc72805edd0 0x7fc72805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:29.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7fc728149040 0x7fc72814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:29.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728098000 con 0x7fc7280a6870 2020-01-26T15:40:29.210 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc72805e050 con 0x7fc728149040 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280a6ca0 con 0x7fc72805edd0 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e147700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc72805edd0 0x7fc72805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e147700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc72805edd0 0x7fc72805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d946700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7fc7280a6870 0x7fc72807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:45074/0 (socket says 172.21.15.170:45074) 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d946700 1 -- 172.21.15.170:0/1305296115 learned_addr learned my addr 172.21.15.170:0/1305296115 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72fbaa700 -1 --2- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6790/0 conn(0x7fc728149040 0x7fc72814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:29.211 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72fbaa700 1 --2- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6790/0 conn(0x7fc728149040 0x7fc72814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125322561 0 0) 0x7fc728098000 con 0x7fc7280a6870 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc710003230 con 0x7fc7280a6870 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3071004906 0 0) 0x7fc710003230 con 0x7fc7280a6870 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6791/0 conn(0x7fc72805edd0 msgr2=0x7fc72805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 --2- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6791/0 conn(0x7fc72805edd0 0x7fc72805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6790/0 conn(0x7fc728149040 msgr2=0x7fc72814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:29.212 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 --2- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6790/0 conn(0x7fc728149040 0x7fc72814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:29.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72814c9e0 con 0x7fc7280a6870 2020-01-26T15:40:29.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc71c001710 con 0x7fc7280a6870 2020-01-26T15:40:29.213 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc71c001aa0 con 0x7fc7280a6870 2020-01-26T15:40:29.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72d145700 1 -- 172.21.15.170:0/1305296115 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc71c004760 con 0x7fc7280a6870 2020-01-26T15:40:29.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.202+0000 7fc72e948700 1 -- 172.21.15.170:0/1305296115 >> v1:172.21.15.170:6791/0 conn(0x7fc7280a6870 legacy=0x7fc72807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- 172.21.15.170:0/1305296115 shutdown_connections 2020-01-26T15:40:29.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 --2- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6790/0 conn(0x7fc728149040 0x7fc72814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:29.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 --2- 172.21.15.170:0/1305296115 >> v2:172.21.15.170:6791/0 conn(0x7fc72805edd0 0x7fc72805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:29.214 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- 172.21.15.170:0/1305296115 >> 172.21.15.170:0/1305296115 conn(0x7fc728098e70 msgr2=0x7fc7280a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:29.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- 172.21.15.170:0/1305296115 shutdown_connections 2020-01-26T15:40:29.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- 172.21.15.170:0/1305296115 wait complete. 2020-01-26T15:40:29.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 Processor -- start 2020-01-26T15:40:29.215 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- start start 2020-01-26T15:40:29.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc728079440 0x7fc728079870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:29.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72811f380 con 0x7fc728079dc0 2020-01-26T15:40:29.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728120a20 con 0x7fc72811fdf0 2020-01-26T15:40:29.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72e948700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc72811dfc0 con 0x7fc728079440 2020-01-26T15:40:29.219 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72d946700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7fc728079440 0x7fc728079870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72fbaa700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc728079dc0 0x7fc72813a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:53078/0 (socket says 172.21.15.170:53078) 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72fbaa700 1 -- 172.21.15.170:0/430399350 learned_addr learned my addr 172.21.15.170:0/430399350 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> v2:172.21.15.170:6791/0 conn(0x7fc728079440 0x7fc728079870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422011622 0 0) 0x7fc72811f380 con 0x7fc728079dc0 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc708003230 con 0x7fc728079dc0 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060138024 0 0) 0x7fc728120a20 con 0x7fc72811fdf0 2020-01-26T15:40:29.220 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.206+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72811f380 con 0x7fc72811fdf0 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 748414711 0 0) 0x7fc708003230 con 0x7fc728079dc0 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc728120a20 con 0x7fc728079dc0 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7fc718001620 con 0x7fc728079dc0 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 >> v2:172.21.15.170:6791/0 conn(0x7fc728079440 msgr2=0x7fc728079870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 --2- 172.21.15.170:0/430399350 >> v2:172.21.15.170:6791/0 conn(0x7fc728079440 0x7fc728079870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 >> v1:172.21.15.170:6790/0 conn(0x7fc72811fdf0 legacy=0x7fc728120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.221 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 >> v1:172.21.15.170:6789/0 conn(0x7fc728079dc0 legacy=0x7fc72813a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc708003230 con 0x7fc708004ca0 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc708005170 con 0x7fc708003c30 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72811dfc0 con 0x7fc7080040f0 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760174438 0 0) 0x7fc708003230 con 0x7fc708004ca0 2020-01-26T15:40:29.222 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc708005fc0 con 0x7fc708004ca0 2020-01-26T15:40:29.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518149790 0 0) 0x7fc708005170 con 0x7fc708003c30 2020-01-26T15:40:29.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc708003230 con 0x7fc708003c30 2020-01-26T15:40:29.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 -- 172.21.15.170:0/430399350 >> v1:172.21.15.170:6791/0 conn(0x7fc708003c30 legacy=0x7fc7080087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 -- 172.21.15.170:0/430399350 >> v1:172.21.15.170:6790/0 conn(0x7fc708004ca0 legacy=0x7fc7080057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.223 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 -- 172.21.15.170:0/430399350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728122c70 con 0x7fc7080040f0 2020-01-26T15:40:29.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72807a1f0 con 0x7fc7080040f0 2020-01-26T15:40:29.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72811e990 con 0x7fc7080040f0 2020-01-26T15:40:29.224 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc71c007330 con 0x7fc7080040f0 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c007530 con 0x7fc7080040f0 2020-01-26T15:40:29.225 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc71c0079b0 con 0x7fc7080040f0 2020-01-26T15:40:29.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc704003360 con 0x7fc7080040f0 2020-01-26T15:40:29.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc71c007bb0 con 0x7fc7080040f0 2020-01-26T15:40:29.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.226 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.210+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fc71c04cd20 con 0x7fc7080040f0 2020-01-26T15:40:29.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.218+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.227 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.218+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc71c033130 con 0x7fc7080040f0 2020-01-26T15:40:29.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.370+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc704003790 con 0x7fc7080040f0 2020-01-26T15:40:29.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.370+0000 7fc72d946700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:29.375 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.370+0000 7fc726ffd700 1 -- 172.21.15.170:0/430399350 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc71c033ce0 con 0x7fc7080040f0 2020-01-26T15:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:29.376 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 >> v1:172.21.15.170:6800/17396 conn(0x7fc708048580 legacy=0x7fc70804aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 msgr2=0x7fc708004620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:29.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72fbaa700 1 -- 172.21.15.170:0/430399350 reap_dead start 2020-01-26T15:40:29.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fc71c0011d0 tx=0x7fc71c010a90).stop 2020-01-26T15:40:29.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 shutdown_connections 2020-01-26T15:40:29.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 --2- 172.21.15.170:0/430399350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7080040f0 0x7fc708004620 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:29.377 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 >> 172.21.15.170:0/430399350 conn(0x7fc728098e10 msgr2=0x7fc72807ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:29.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 shutdown_connections 2020-01-26T15:40:29.378 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:29.374+0000 7fc72e948700 1 -- 172.21.15.170:0/430399350 wait complete. 2020-01-26T15:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:32.388 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:32.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.502+0000 7feb35338700 1 Processor -- start 2020-01-26T15:40:32.516 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.502+0000 7feb35338700 1 -- start start 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.502+0000 7feb35338700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7feb3005e5f0 0x7feb300a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.502+0000 7feb35338700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb300a6dc0 con 0x7feb30149040 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.502+0000 7feb35338700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3005ea20 con 0x7feb3005edd0 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.502+0000 7feb35338700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7feb30098000 con 0x7feb3005e5f0 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb3659a700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7feb30149040 0x7feb3014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49968/0 (socket says 172.21.15.170:49968) 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb3659a700 1 -- 172.21.15.170:0/2790270771 learned_addr learned my addr 172.21.15.170:0/2790270771 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:32.517 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2ffff700 -1 --2- 172.21.15.170:0/2790270771 >> v2:172.21.15.170:6790/0 conn(0x7feb3005e5f0 0x7feb300a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2ffff700 1 --2- 172.21.15.170:0/2790270771 >> v2:172.21.15.170:6790/0 conn(0x7feb3005e5f0 0x7feb300a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607956818 0 0) 0x7feb3005ea20 con 0x7feb3005edd0 2020-01-26T15:40:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb18003230 con 0x7feb3005edd0 2020-01-26T15:40:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808735671 0 0) 0x7feb300a6dc0 con 0x7feb30149040 2020-01-26T15:40:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb3005ea20 con 0x7feb30149040 2020-01-26T15:40:32.518 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3387191282 0 0) 0x7feb18003230 con 0x7feb3005edd0 2020-01-26T15:40:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 >> v2:172.21.15.170:6790/0 conn(0x7feb3005e5f0 msgr2=0x7feb300a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 --2- 172.21.15.170:0/2790270771 >> v2:172.21.15.170:6790/0 conn(0x7feb3005e5f0 0x7feb300a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 >> v1:172.21.15.170:6790/0 conn(0x7feb30149040 legacy=0x7feb3014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3005e050 con 0x7feb3005edd0 2020-01-26T15:40:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7feb28001a90 con 0x7feb3005edd0 2020-01-26T15:40:32.519 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7feb28001d60 con 0x7feb3005edd0 2020-01-26T15:40:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb2f7fe700 1 -- 172.21.15.170:0/2790270771 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7feb28002180 con 0x7feb3005edd0 2020-01-26T15:40:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 -- 172.21.15.170:0/2790270771 >> v1:172.21.15.170:6791/0 conn(0x7feb3005edd0 legacy=0x7feb3007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 -- 172.21.15.170:0/2790270771 shutdown_connections 2020-01-26T15:40:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 --2- 172.21.15.170:0/2790270771 >> v2:172.21.15.170:6790/0 conn(0x7feb3005e5f0 0x7feb300a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 -- 172.21.15.170:0/2790270771 >> 172.21.15.170:0/2790270771 conn(0x7feb30098e70 msgr2=0x7feb300a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:32.520 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 -- 172.21.15.170:0/2790270771 shutdown_connections 2020-01-26T15:40:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 -- 172.21.15.170:0/2790270771 wait complete. 2020-01-26T15:40:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.506+0000 7feb35338700 1 Processor -- start 2020-01-26T15:40:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 -- start start 2020-01-26T15:40:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7feb3007e040 0x7feb30079dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7feb3007e760 0x7feb3007f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:32.521 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3007f5f0 con 0x7feb3007c4e0 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7feb3009e650 con 0x7feb3007e040 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7feb3007dbe0 con 0x7feb3007e760 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7feb3007e760 0x7feb3007f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7feb3007e760 0x7feb3007f0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb3659a700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7feb3007c4e0 0x7feb3007c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:53098/0 (socket says 172.21.15.170:53098) 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb3659a700 1 -- 172.21.15.170:0/1430273101 learned_addr learned my addr 172.21.15.170:0/1430273101 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:32.522 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb34b37700 -1 --2- 172.21.15.170:0/1430273101 >> v2:172.21.15.170:6790/0 conn(0x7feb3007e040 0x7feb30079dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:32.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb34b37700 1 --2- 172.21.15.170:0/1430273101 >> v2:172.21.15.170:6790/0 conn(0x7feb3007e040 0x7feb30079dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:32.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402125499 0 0) 0x7feb3007f5f0 con 0x7feb3007c4e0 2020-01-26T15:40:32.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb10003230 con 0x7feb3007c4e0 2020-01-26T15:40:32.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3497355656 0 0) 0x7feb10003230 con 0x7feb3007c4e0 2020-01-26T15:40:32.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feb3007f5f0 con 0x7feb3007c4e0 2020-01-26T15:40:32.523 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7feb24001230 con 0x7feb3007c4e0 2020-01-26T15:40:32.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 >> v2:172.21.15.170:6791/0 conn(0x7feb3007e760 msgr2=0x7feb3007f0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:32.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 --2- 172.21.15.170:0/1430273101 >> v2:172.21.15.170:6791/0 conn(0x7feb3007e760 0x7feb3007f0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:32.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 >> v2:172.21.15.170:6790/0 conn(0x7feb3007e040 msgr2=0x7feb30079dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:32.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 --2- 172.21.15.170:0/1430273101 >> v2:172.21.15.170:6790/0 conn(0x7feb3007e040 0x7feb30079dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:32.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 >> v1:172.21.15.170:6789/0 conn(0x7feb3007c4e0 legacy=0x7feb3007c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.524 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7feb10003230 con 0x7feb10003a20 2020-01-26T15:40:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7feb10005350 con 0x7feb1000a7f0 2020-01-26T15:40:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3009e650 con 0x7feb10003eb0 2020-01-26T15:40:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202754462 0 0) 0x7feb10005350 con 0x7feb1000a7f0 2020-01-26T15:40:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb1000e440 con 0x7feb1000a7f0 2020-01-26T15:40:32.525 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714149736 0 0) 0x7feb10003230 con 0x7feb10003a20 2020-01-26T15:40:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb10005350 con 0x7feb10003a20 2020-01-26T15:40:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1187178540 0 0) 0x7feb1000e440 con 0x7feb1000a7f0 2020-01-26T15:40:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feb10003230 con 0x7feb1000a7f0 2020-01-26T15:40:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7feb24004ab0 con 0x7feb1000a7f0 2020-01-26T15:40:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1715257352 0 0) 0x7feb10005350 con 0x7feb10003a20 2020-01-26T15:40:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feb1000e440 con 0x7feb10003a20 2020-01-26T15:40:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7feb28001f10 con 0x7feb10003a20 2020-01-26T15:40:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 -- 172.21.15.170:0/1430273101 >> v1:172.21.15.170:6791/0 conn(0x7feb1000a7f0 legacy=0x7feb1000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.2 v1:172.21.15.170:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2395688540 0 0) 0x7feb10003230 con 0x7feb1000a7f0 2020-01-26T15:40:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 -- 172.21.15.170:0/1430273101 >> v1:172.21.15.170:6790/0 conn(0x7feb10003a20 legacy=0x7feb100045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.527 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 -- 172.21.15.170:0/1430273101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3007eb90 con 0x7feb10003eb0 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb3659a700 1 -- 172.21.15.170:0/1430273101 reap_dead start 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3009e150 con 0x7feb10003eb0 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3007e980 con 0x7feb10003eb0 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:32.528 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.510+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7feb20008ab0 con 0x7feb10003eb0 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb20008cb0 con 0x7feb10003eb0 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7feb20005a20 con 0x7feb10003eb0 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb08003360 con 0x7feb10003eb0 2020-01-26T15:40:32.529 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7feb20005c20 con 0x7feb10003eb0 2020-01-26T15:40:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.530 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.514+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3387+0+0 (secure 0 0 0) 0x7feb2004cba0 con 0x7feb10003eb0 2020-01-26T15:40:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.518+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.518+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7feb20032d50 con 0x7feb10003eb0 2020-01-26T15:40:32.679 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.674+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feb08003790 con 0x7feb10003eb0 2020-01-26T15:40:32.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb2ffff700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:32.680 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb2d7fa700 1 -- 172.21.15.170:0/1430273101 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7feb20032fb0 con 0x7feb10003eb0 2020-01-26T15:40:32.680 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:32.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 >> v1:172.21.15.170:6800/17396 conn(0x7feb10040e60 legacy=0x7feb10043370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.682 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 msgr2=0x7feb10004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:32.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7feb20002f30 tx=0x7feb28001400).stop 2020-01-26T15:40:32.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 shutdown_connections 2020-01-26T15:40:32.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 --2- 172.21.15.170:0/1430273101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb10003eb0 0x7feb10004da0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:32.683 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 >> 172.21.15.170:0/1430273101 conn(0x7feb3005c110 msgr2=0x7feb300a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 shutdown_connections 2020-01-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:32.678+0000 7feb35338700 1 -- 172.21.15.170:0/1430273101 wait complete. 2020-01-26T15:40:32.698 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:35.699 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:35.822 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 Processor -- start 2020-01-26T15:40:35.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 -- start start 2020-01-26T15:40:35.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2140146c30 0x7f2140149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:35.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f21401495c0 0x7f214014ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:35.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400a5b80 con 0x7f21400a5750 2020-01-26T15:40:35.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f21400a43f0 con 0x7f21401495c0 2020-01-26T15:40:35.823 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f21484ec700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f21400a5210 con 0x7f2140146c30 2020-01-26T15:40:35.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f2146a89700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f21400a5750 0x7f21400a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:49984/0 (socket says 172.21.15.170:49984) 2020-01-26T15:40:35.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f2146a89700 1 -- 172.21.15.170:0/983545970 learned_addr learned my addr 172.21.15.170:0/983545970 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:35.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f214728a700 -1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6790/0 conn(0x7f21401495c0 0x7f214014ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:35.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f2146288700 -1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6791/0 conn(0x7f2140146c30 0x7f2140149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:35.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f214728a700 1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6790/0 conn(0x7f21401495c0 0x7f214014ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:35.824 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.814+0000 7f2146288700 1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6791/0 conn(0x7f2140146c30 0x7f2140149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321332612 0 0) 0x7f21400a5b80 con 0x7f21400a5750 2020-01-26T15:40:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212c003230 con 0x7f21400a5750 2020-01-26T15:40:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2284283302 0 0) 0x7f212c003230 con 0x7f21400a5750 2020-01-26T15:40:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6791/0 conn(0x7f2140146c30 msgr2=0x7f2140149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6791/0 conn(0x7f2140146c30 0x7f2140149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6790/0 conn(0x7f21401495c0 msgr2=0x7f214014ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6790/0 conn(0x7f21401495c0 0x7f214014ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140080440 con 0x7f21400a5750 2020-01-26T15:40:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f213c001710 con 0x7f21400a5750 2020-01-26T15:40:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f213c001aa0 con 0x7f21400a5750 2020-01-26T15:40:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f2145a87700 1 -- 172.21.15.170:0/983545970 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f213c004760 con 0x7f21400a5750 2020-01-26T15:40:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 -- 172.21.15.170:0/983545970 >> v1:172.21.15.170:6790/0 conn(0x7f21400a5750 legacy=0x7f21400a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 -- 172.21.15.170:0/983545970 shutdown_connections 2020-01-26T15:40:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6790/0 conn(0x7f21401495c0 0x7f214014ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 --2- 172.21.15.170:0/983545970 >> v2:172.21.15.170:6791/0 conn(0x7f2140146c30 0x7f2140149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 -- 172.21.15.170:0/983545970 >> 172.21.15.170:0/983545970 conn(0x7f214005e050 msgr2=0x7f2140098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 -- 172.21.15.170:0/983545970 shutdown_connections 2020-01-26T15:40:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.818+0000 7f21484ec700 1 -- 172.21.15.170:0/983545970 wait complete. 2020-01-26T15:40:35.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 Processor -- start 2020-01-26T15:40:35.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 -- start start 2020-01-26T15:40:35.843 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2140121ac0 0x7f214011cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:35.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f214011e3a0 0x7f2140129a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:35.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400a2090 con 0x7f21400a1c60 2020-01-26T15:40:35.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f21400a0f90 con 0x7f214011e3a0 2020-01-26T15:40:35.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f214012ff00 con 0x7f2140121ac0 2020-01-26T15:40:35.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f214011e3a0 0x7f2140129a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:35.844 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f214011e3a0 0x7f2140129a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f2146a89700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2140121ac0 0x7f214011cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f2146a89700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f2140121ac0 0x7f214011cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f2146288700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f21400a1c60 0x7f214011dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:53116/0 (socket says 172.21.15.170:53116) 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f2146288700 1 -- 172.21.15.170:0/4245579421 learned_addr learned my addr 172.21.15.170:0/4245579421 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203285738 0 0) 0x7f21400a2090 con 0x7f21400a1c60 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2128003230 con 0x7f21400a1c60 2020-01-26T15:40:35.845 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 147203803 0 0) 0x7f2128003230 con 0x7f21400a1c60 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f21400a2090 con 0x7f21400a1c60 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f2130002740 con 0x7f21400a1c60 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 >> v2:172.21.15.170:6791/0 conn(0x7f2140121ac0 msgr2=0x7f214011cc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 --2- 172.21.15.170:0/4245579421 >> v2:172.21.15.170:6791/0 conn(0x7f2140121ac0 0x7f214011cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 >> v2:172.21.15.170:6790/0 conn(0x7f214011e3a0 msgr2=0x7f2140129a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 --2- 172.21.15.170:0/4245579421 >> v2:172.21.15.170:6790/0 conn(0x7f214011e3a0 0x7f2140129a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:35.846 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 >> v1:172.21.15.170:6789/0 conn(0x7f21400a1c60 legacy=0x7f214011dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2128003230 con 0x7f2128003aa0 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f212800f390 con 0x7f2128003fb0 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400a0f90 con 0x7f212800b800 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581761988 0 0) 0x7f212800f390 con 0x7f2128003fb0 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212800e380 con 0x7f2128003fb0 2020-01-26T15:40:35.847 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477630417 0 0) 0x7f2128003230 con 0x7f2128003aa0 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212800f390 con 0x7f2128003aa0 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 -- 172.21.15.170:0/4245579421 >> v1:172.21.15.170:6791/0 conn(0x7f2128003fb0 legacy=0x7f2128004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 -- 172.21.15.170:0/4245579421 >> v1:172.21.15.170:6790/0 conn(0x7f2128003aa0 legacy=0x7f21280045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 -- 172.21.15.170:0/4245579421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140129fa0 con 0x7f212800b800 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214012a270 con 0x7f212800b800 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2140137350 con 0x7f212800b800 2020-01-26T15:40:35.848 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 -- 172.21.15.170:0/4245579421 reap_dead start 2020-01-26T15:40:35.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.822+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:35.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f21380126b0 con 0x7f212800b800 2020-01-26T15:40:35.849 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21380128b0 con 0x7f212800b800 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2138012c50 con 0x7f212800b800 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c003360 con 0x7f212800b800 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f2138011330 con 0x7f212800b800 2020-01-26T15:40:35.850 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.826+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f213804d970 con 0x7f212800b800 2020-01-26T15:40:35.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.834+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.851 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.834+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f2138033aa0 con 0x7f212800b800 2020-01-26T15:40:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.990+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f211c003790 con 0x7f212800b800 2020-01-26T15:40:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f214728a700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21377fe700 1 -- 172.21.15.170:0/4245579421 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2138033d00 con 0x7f212800b800 2020-01-26T15:40:35.996 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 >> v1:172.21.15.170:6800/17396 conn(0x7f2128040d10 legacy=0x7f2128043220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 msgr2=0x7f212800dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f21380032b0 tx=0x7f2138010d60).stop 2020-01-26T15:40:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 shutdown_connections 2020-01-26T15:40:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 --2- 172.21.15.170:0/4245579421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f212800b800 0x7f212800dd10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 >> 172.21.15.170:0/4245579421 conn(0x7f21400a4110 msgr2=0x7f214007f500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 shutdown_connections 2020-01-26T15:40:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:35.994+0000 7f21484ec700 1 -- 172.21.15.170:0/4245579421 wait complete. 2020-01-26T15:40:36.009 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:39.010 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:39.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 Processor -- start 2020-01-26T15:40:39.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 -- start start 2020-01-26T15:40:39.129 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0df40a5750 0x7f0df40a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f0df40a4b50 0x7f0df405ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40a5b80 con 0x7f0df405efa0 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 -- --> v2:172.21.15.170:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40a43f0 con 0x7f0df40a4b50 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df9467700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40a4f80 con 0x7f0df40a5750 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df2ffd700 -1 --2- >> v2:172.21.15.170:6790/0 conn(0x7f0df40a4b50 0x7f0df405ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6790/0 is using msgr V1 protocol 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df37fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0df40a5750 0x7f0df40a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:39.130 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df3fff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f0df405efa0 0x7f0df414ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:50004/0 (socket says 172.21.15.170:50004) 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df37fe700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0df40a5750 0x7f0df40a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df3fff700 1 -- 172.21.15.170:0/555372128 learned_addr learned my addr 172.21.15.170:0/555372128 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6790/0 conn(0x7f0df40a4b50 0x7f0df405ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916811053 0 0) 0x7f0df40a5b80 con 0x7f0df405efa0 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de0003230 con 0x7f0df405efa0 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1293685841 0 0) 0x7f0de0003230 con 0x7f0df405efa0 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6791/0 conn(0x7f0df40a5750 msgr2=0x7f0df40a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:39.131 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 --2- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6791/0 conn(0x7f0df40a5750 0x7f0df40a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6790/0 conn(0x7f0df40a4b50 msgr2=0x7f0df405ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 --2- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6790/0 conn(0x7f0df40a4b50 0x7f0df405ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 --> v1:172.21.15.170:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4080440 con 0x7f0df405efa0 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.122+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0de4001710 con 0x7f0df405efa0 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 <== mon.1 v1:172.21.15.170:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0de4001910 con 0x7f0df405efa0 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 -- 172.21.15.170:0/555372128 >> v1:172.21.15.170:6790/0 conn(0x7f0df405efa0 legacy=0x7f0df414ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.132 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df27fc700 1 -- 172.21.15.170:0/555372128 <== mon.1 v1:172.21.15.170:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0de40045b0 con 0x7f0df405efa0 2020-01-26T15:40:39.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 -- 172.21.15.170:0/555372128 shutdown_connections 2020-01-26T15:40:39.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 --2- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6791/0 conn(0x7f0df40a5750 0x7f0df40a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:39.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 --2- 172.21.15.170:0/555372128 >> v2:172.21.15.170:6790/0 conn(0x7f0df40a4b50 0x7f0df405ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:39.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 -- 172.21.15.170:0/555372128 >> 172.21.15.170:0/555372128 conn(0x7f0df405e050 msgr2=0x7f0df4098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:39.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 -- 172.21.15.170:0/555372128 shutdown_connections 2020-01-26T15:40:39.133 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 -- 172.21.15.170:0/555372128 wait complete. 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 Processor -- start 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.126+0000 7f0df9467700 1 -- start start 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df9467700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df411ea00 con 0x7f0df40961d0 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df9467700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40968b0 con 0x7f0df40a2690 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df9467700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40950b0 con 0x7f0df40a2260 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df3fff700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f0df40a2690 0x7f0df40a1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:50012/0 (socket says 172.21.15.170:50012) 2020-01-26T15:40:39.138 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df37fe700 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0df40961d0 0x7f0df41204e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:53134/0 (socket says 172.21.15.170:53134) 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df3fff700 1 -- 172.21.15.170:0/2538216811 learned_addr learned my addr 172.21.15.170:0/2538216811 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019443161 0 0) 0x7f0df40950b0 con 0x7f0df40a2260 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd8003230 con 0x7f0df40a2260 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446709652 0 0) 0x7f0df411ea00 con 0x7f0df40961d0 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df40950b0 con 0x7f0df40961d0 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734158294 0 0) 0x7f0df40968b0 con 0x7f0df40a2690 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df411ea00 con 0x7f0df40a2690 2020-01-26T15:40:39.139 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3941828846 0 0) 0x7f0dd8003230 con 0x7f0df40a2260 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0df40968b0 con 0x7f0df40a2260 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0ddc002620 con 0x7f0df40a2260 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2980257541 0 0) 0x7f0df40950b0 con 0x7f0df40961d0 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0dd8003230 con 0x7f0df40961d0 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0dec0029c0 con 0x7f0df40961d0 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 >> v1:172.21.15.170:6791/0 conn(0x7f0df40a2260 legacy=0x7f0df40a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.140 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 >> v1:172.21.15.170:6790/0 conn(0x7f0df40a2690 legacy=0x7f0df40a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 >> v1:172.21.15.170:6789/0 conn(0x7f0df40961d0 legacy=0x7f0df41204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0df40968b0 con 0x7f0dd8005130 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0df40950b0 con 0x7f0dd800ad40 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80109b0 con 0x7f0dd8003d40 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908986912 0 0) 0x7f0df40950b0 con 0x7f0dd800ad40 2020-01-26T15:40:39.141 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd800e990 con 0x7f0dd800ad40 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018551487 0 0) 0x7f0df40968b0 con 0x7f0dd8005130 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df40950b0 con 0x7f0dd8005130 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df2ffd700 1 -- 172.21.15.170:0/2538216811 >> v1:172.21.15.170:6791/0 conn(0x7f0dd800ad40 legacy=0x7f0dd800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df2ffd700 1 -- 172.21.15.170:0/2538216811 >> v1:172.21.15.170:6790/0 conn(0x7f0dd8005130 legacy=0x7f0dd8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df2ffd700 1 -- 172.21.15.170:0/2538216811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f0df40a64c0 con 0x7f0dd8003d40 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.130+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df40979c0 con 0x7f0dd8003d40 2020-01-26T15:40:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df40a2260 con 0x7f0dd8003d40 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0ddc005910 con 0x7f0dd8003d40 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc005b10 con 0x7f0dd8003d40 2020-01-26T15:40:39.143 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc003360 con 0x7f0dd8003d40 2020-01-26T15:40:39.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f0ddc010160 con 0x7f0dd8003d40 2020-01-26T15:40:39.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.134+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(39..39 src has 1..39) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f0ddc04d910 con 0x7f0dd8003d40 2020-01-26T15:40:39.144 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.142+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.145 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.142+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f0ddc033cc0 con 0x7f0dd8003d40 2020-01-26T15:40:39.300 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0dcc003790 con 0x7f0dd8003d40 2020-01-26T15:40:39.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df2ffd700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:39.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0debfff700 1 -- 172.21.15.170:0/2538216811 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0ddc005d00 con 0x7f0dd8003d40 2020-01-26T15:40:39.431 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 >> v1:172.21.15.170:6800/17396 conn(0x7f0dd8048970 legacy=0x7f0dd804ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 msgr2=0x7f0dd800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 --2- 172.21.15.170:0/2538216811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8003d40 0x7f0dd800a7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f0ddc001f60 tx=0x7f0ddc0116d0).stop 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df3fff700 1 -- 172.21.15.170:0/2538216811 reap_dead start 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 shutdown_connections 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 >> 172.21.15.170:0/2538216811 conn(0x7f0df4095540 msgr2=0x7f0df40a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 shutdown_connections 2020-01-26T15:40:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:39.298+0000 7f0df9467700 1 -- 172.21.15.170:0/2538216811 wait complete. 2020-01-26T15:40:39.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:39.433 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:42.434 INFO:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:40:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.545+0000 7f023c9b5700 1 Processor -- start 2020-01-26T15:40:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.545+0000 7f023c9b5700 1 -- start start 2020-01-26T15:40:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f02380a6870 0x7f023814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:40:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023805ea20 con 0x7f023805e5f0 2020-01-26T15:40:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0238098000 con 0x7f023805edd0 2020-01-26T15:40:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f023805e050 con 0x7f02380a6870 2020-01-26T15:40:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0237fff700 1 --1- >> v1:172.21.15.170:6791/0 conn(0x7f023805edd0 0x7f023807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6791/0 says I am v1:172.21.15.170:45150/0 (socket says 172.21.15.170:45150) 2020-01-26T15:40:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0237fff700 1 -- 172.21.15.170:0/1117791443 learned_addr learned my addr 172.21.15.170:0/1117791443 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023dc17700 -1 --2- 172.21.15.170:0/1117791443 >> v2:172.21.15.170:6791/0 conn(0x7f02380a6870 0x7f023814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f02377fe700 1 --1- 172.21.15.170:0/1117791443 >> v1:172.21.15.170:6790/0 conn(0x7f023805e5f0 0x7f0238149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:50026/0 (socket says 172.21.15.170:50026) 2020-01-26T15:40:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023dc17700 1 --2- 172.21.15.170:0/1117791443 >> v2:172.21.15.170:6791/0 conn(0x7f02380a6870 0x7f023814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 <== mon.2 v1:172.21.15.170:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622074489 0 0) 0x7f0238098000 con 0x7f023805edd0 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 --> v1:172.21.15.170:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0220003230 con 0x7f023805edd0 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279817329 0 0) 0x7f023805ea20 con 0x7f023805e5f0 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0238098000 con 0x7f023805e5f0 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 <== mon.2 v1:172.21.15.170:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 524058831 0 0) 0x7f0220003230 con 0x7f023805edd0 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 >> v2:172.21.15.170:6791/0 conn(0x7f02380a6870 msgr2=0x7f023814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 --2- 172.21.15.170:0/1117791443 >> v2:172.21.15.170:6791/0 conn(0x7f02380a6870 0x7f023814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 >> v1:172.21.15.170:6790/0 conn(0x7f023805e5f0 legacy=0x7f0238149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 --> v1:172.21.15.170:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380a6ca0 con 0x7f023805edd0 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 <== mon.2 v1:172.21.15.170:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0228001a90 con 0x7f023805edd0 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 <== mon.2 v1:172.21.15.170:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0228001c90 con 0x7f023805edd0 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f0236ffd700 1 -- 172.21.15.170:0/1117791443 <== mon.2 v1:172.21.15.170:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0228004930 con 0x7f023805edd0 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- 172.21.15.170:0/1117791443 >> v1:172.21.15.170:6791/0 conn(0x7f023805edd0 legacy=0x7f023807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- 172.21.15.170:0/1117791443 shutdown_connections 2020-01-26T15:40:42.559 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 --2- 172.21.15.170:0/1117791443 >> v2:172.21.15.170:6791/0 conn(0x7f02380a6870 0x7f023814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:40:42.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- 172.21.15.170:0/1117791443 >> 172.21.15.170:0/1117791443 conn(0x7f0238098e70 msgr2=0x7f02380a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:42.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- 172.21.15.170:0/1117791443 shutdown_connections 2020-01-26T15:40:42.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.549+0000 7f023c9b5700 1 -- 172.21.15.170:0/1117791443 wait complete. 2020-01-26T15:40:42.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 Processor -- start 2020-01-26T15:40:42.560 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 -- start start 2020-01-26T15:40:42.572 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0238120a80 0x7f023811dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:42.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023811faa0 con 0x7f02380a0f90 2020-01-26T15:40:42.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 -- --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023811f4e0 con 0x7f023809fc00 2020-01-26T15:40:42.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 -- --> v2:172.21.15.170:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f02380a0830 con 0x7f0238120a80 2020-01-26T15:40:42.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 -1 --2- >> v2:172.21.15.170:6791/0 conn(0x7f0238120a80 0x7f023811dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.170:6791/0 is using msgr V1 protocol 2020-01-26T15:40:42.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023dc17700 1 --1- >> v1:172.21.15.170:6790/0 conn(0x7f023809fc00 0x7f02380a0030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.170:6790/0 says I am v1:172.21.15.170:50032/0 (socket says 172.21.15.170:50032) 2020-01-26T15:40:42.573 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023dc17700 1 -- 172.21.15.170:0/851964820 learned_addr learned my addr 172.21.15.170:0/851964820 (peer_addr_for_me v1:172.21.15.170:0/0) 2020-01-26T15:40:42.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> v2:172.21.15.170:6791/0 conn(0x7f0238120a80 0x7f023811dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:40:42.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.1 v1:172.21.15.170:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181852880 0 0) 0x7f023811f4e0 con 0x7f023809fc00 2020-01-26T15:40:42.574 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> v1:172.21.15.170:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0218003230 con 0x7f023809fc00 2020-01-26T15:40:42.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219510757 0 0) 0x7f023811faa0 con 0x7f02380a0f90 2020-01-26T15:40:42.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f023811f4e0 con 0x7f02380a0f90 2020-01-26T15:40:42.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.1 v1:172.21.15.170:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4228100504 0 0) 0x7f0218003230 con 0x7f023809fc00 2020-01-26T15:40:42.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> v1:172.21.15.170:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f023811faa0 con 0x7f023809fc00 2020-01-26T15:40:42.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2958415460 0 0) 0x7f023811f4e0 con 0x7f02380a0f90 2020-01-26T15:40:42.575 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> v1:172.21.15.170:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0218003230 con 0x7f02380a0f90 2020-01-26T15:40:42.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.1 v1:172.21.15.170:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f02300026d0 con 0x7f023809fc00 2020-01-26T15:40:42.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 3826720157 0 0) 0x7f0228001e20 con 0x7f02380a0f90 2020-01-26T15:40:42.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 >> v2:172.21.15.170:6791/0 conn(0x7f0238120a80 msgr2=0x7f023811dfc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:40:42.576 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 --2- 172.21.15.170:0/851964820 >> v2:172.21.15.170:6791/0 conn(0x7f0238120a80 0x7f023811dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:40:42.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 >> v1:172.21.15.170:6790/0 conn(0x7f023809fc00 legacy=0x7f02380a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 >> v1:172.21.15.170:6789/0 conn(0x7f02380a0f90 legacy=0x7f0238120280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.577 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:40:42.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> v1:172.21.15.170:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f023811f4e0 con 0x7f021800ad40 2020-01-26T15:40:42.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> v1:172.21.15.170:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f02180041b0 con 0x7f0218004fb0 2020-01-26T15:40:42.578 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380a0830 con 0x7f0218003d40 2020-01-26T15:40:42.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:40:42.579 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 -- 172.21.15.170:0/851964820 >> v1:172.21.15.170:6791/0 conn(0x7f0218004fb0 legacy=0x7f0218003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 -- 172.21.15.170:0/851964820 >> v1:172.21.15.170:6790/0 conn(0x7f021800ad40 legacy=0x7f021800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 -- 172.21.15.170:0/851964820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f02380a09f0 con 0x7f0218003d40 2020-01-26T15:40:42.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380a0c60 con 0x7f0218003d40 2020-01-26T15:40:42.580 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023809fda0 con 0x7f0218003d40 2020-01-26T15:40:42.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:40:42.581 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f022c005c70 con 0x7f0218003d40 2020-01-26T15:40:42.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.553+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c00a320 con 0x7f0218003d40 2020-01-26T15:40:42.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.557+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0210003360 con 0x7f0218003d40 2020-01-26T15:40:42.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.557+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.582 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.557+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mgrmap(e 8) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f022c00a560 con 0x7f0218003d40 2020-01-26T15:40:42.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.557+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.557+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v2:172.21.15.170:3300/0 4 ==== osd_map(39..39 src has 1..39) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f022c04d190 con 0x7f0218003d40 2020-01-26T15:40:42.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.561+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.583 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.561+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v2:172.21.15.170:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f022c033360 con 0x7f0218003d40 2020-01-26T15:40:42.719 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.713+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f02100036b0 con 0x7f0218003d40 2020-01-26T15:40:42.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.713+0000 7f02377fe700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:40:42.720 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.713+0000 7f0234ff9700 1 -- 172.21.15.170:0/851964820 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f022c0335c0 con 0x7f0218003d40 2020-01-26T15:40:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: 2020-01-26T15:40:42.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 >> v1:172.21.15.170:6800/17396 conn(0x7f02180484c0 legacy=0x7f021804a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 msgr2=0x7f021800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:40:42.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 --2- 172.21.15.170:0/851964820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0218003d40 0x7f021800a7f0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f02300024c0 tx=0x7f0228002020).stop 2020-01-26T15:40:42.722 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023dc17700 1 -- 172.21.15.170:0/851964820 reap_dead start 2020-01-26T15:40:42.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 shutdown_connections 2020-01-26T15:40:42.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 >> 172.21.15.170:0/851964820 conn(0x7f0238099040 msgr2=0x7f0238123cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:40:42.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 shutdown_connections 2020-01-26T15:40:42.723 INFO:teuthology.orchestra.run.smithi170.stderr:2020-01-26T15:40:42.717+0000 7f023c9b5700 1 -- 172.21.15.170:0/851964820 wait complete. 2020-01-26T15:40:42.732 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:40:42.732 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 86, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks/ceph.py", line 1480, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks/ceph_manager.py", line 2876, in wait_until_healthy 'timeout expired in wait_until_healthy' AssertionError: timeout expired in wait_until_healthy 2020-01-26T15:40:42.734 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-01-26T15:40:42.775 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2020-01-26T15:40:42.793 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-01-26T15:40:42.811 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-01-26T15:40:42.848 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2020-01-26T15:40:42.867 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-01-26T15:40:42.889 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-01-26T15:40:42.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:40:42.890 INFO:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2020-01-26T15:40:42.890 INFO:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.1 2020-01-26T15:40:42.901 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2020-01-26T15:40:42.901 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-01-26T15:40:42.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:40:42.901 INFO:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2020-01-26T15:40:42.901 INFO:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.1 2020-01-26T15:40:42.949 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2020-01-26T15:40:42.949 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-01-26T15:40:42.950 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2020-01-26T15:40:42.950 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-01-26T15:40:42.950 INFO:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2020-01-26T15:40:43.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:40:43.054 INFO:teuthology.orchestra.run.smithi163.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.1: Device or resource busy 2020-01-26T15:40:43.054 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi163.front.sepia.ceph.com, aborting... 2020-01-26T15:40:43.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:40:43.055 INFO:teuthology.orchestra.run.smithi163:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2020-01-26T15:55:43.079 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() timeout 2020-01-26T15:55:43.096 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() timeout 2020-01-27T03:04:45.369 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-01-27T03:04:45.393 DEBUG:teuthology.task.console_log:Killing console logger for smithi163 2020-01-27T03:04:45.394 DEBUG:teuthology.task.console_log:Killing console logger for smithi170 2020-01-27T03:04:45.394 DEBUG:teuthology.task.console_log:Killing console logger for smithi008 2020-01-27T03:04:45.394 DEBUG:teuthology.task.console_log:Killing console logger for smithi163 2020-01-27T03:04:45.395 DEBUG:teuthology.task.console_log:Killing console logger for smithi170 2020-01-27T03:04:45.395 DEBUG:teuthology.task.console_log:Killing console logger for smithi008 2020-01-27T03:04:45.395 DEBUG:teuthology.exit:Finished running handlers